-- Logs begin at Wed 2022-08-24 10:52:36 UTC, end at Wed 2022-08-24 11:47:15 UTC. -- Aug 24 11:18:59.805582 dv-cinder-848899-3-smb systemd[1]: Starting Devstack devstack@keystone.service... Aug 24 11:18:59.816598 dv-cinder-848899-3-smb devstack@keystone.service[81490]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 24 11:18:59.818702 dv-cinder-848899-3-smb devstack@keystone.service[81490]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 24 11:18:59 2022] *** Aug 24 11:18:59.818702 dv-cinder-848899-3-smb devstack@keystone.service[81490]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 24 11:18:59.818702 dv-cinder-848899-3-smb devstack@keystone.service[81490]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 24 11:18:59.818702 dv-cinder-848899-3-smb devstack@keystone.service[81490]: nodename: dv-cinder-848899-3-smb Aug 24 11:18:59.818702 dv-cinder-848899-3-smb devstack@keystone.service[81490]: machine: x86_64 Aug 24 11:18:59.818702 dv-cinder-848899-3-smb devstack@keystone.service[81490]: clock source: unix Aug 24 11:18:59.818702 dv-cinder-848899-3-smb devstack@keystone.service[81490]: pcre jit disabled Aug 24 11:18:59.818702 dv-cinder-848899-3-smb devstack@keystone.service[81490]: detected number of CPU cores: 4 Aug 24 11:18:59.818702 dv-cinder-848899-3-smb devstack@keystone.service[81490]: current working directory: / Aug 24 11:18:59.818702 dv-cinder-848899-3-smb devstack@keystone.service[81490]: detected binary path: /usr/bin/uwsgi-core Aug 24 11:18:59.818702 dv-cinder-848899-3-smb devstack@keystone.service[81490]: your processes number limit is 47680 Aug 24 11:18:59.819333 dv-cinder-848899-3-smb devstack@keystone.service[81490]: your memory page size is 4096 bytes Aug 24 11:18:59.819333 dv-cinder-848899-3-smb devstack@keystone.service[81490]: detected max file descriptor number: 2048 Aug 24 11:18:59.819333 dv-cinder-848899-3-smb devstack@keystone.service[81490]: lock engine: pthread robust mutexes Aug 24 11:18:59.819333 dv-cinder-848899-3-smb devstack@keystone.service[81490]: thunder lock: enabled Aug 24 11:18:59.819333 dv-cinder-848899-3-smb devstack@keystone.service[81490]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 24 11:18:59.819333 dv-cinder-848899-3-smb devstack@keystone.service[81490]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 24 11:18:59.861638 dv-cinder-848899-3-smb devstack@keystone.service[81490]: Python main interpreter initialized at 0x55ed03a0f9c0 Aug 24 11:18:59.861638 dv-cinder-848899-3-smb devstack@keystone.service[81490]: python threads support enabled Aug 24 11:18:59.861638 dv-cinder-848899-3-smb devstack@keystone.service[81490]: your server socket listen backlog is limited to 100 connections Aug 24 11:18:59.861638 dv-cinder-848899-3-smb devstack@keystone.service[81490]: your mercy for graceful operations on workers is 90 seconds Aug 24 11:18:59.861998 dv-cinder-848899-3-smb devstack@keystone.service[81490]: mapped 403077 bytes (393 KB) for 2 cores Aug 24 11:18:59.862078 dv-cinder-848899-3-smb devstack@keystone.service[81490]: *** Operational MODE: preforking *** Aug 24 11:18:59.862337 dv-cinder-848899-3-smb devstack@keystone.service[81490]: *** uWSGI is running in multiple interpreter mode *** Aug 24 11:18:59.862337 dv-cinder-848899-3-smb devstack@keystone.service[81490]: spawned uWSGI master process (pid: 81490) Aug 24 11:18:59.862524 dv-cinder-848899-3-smb systemd[1]: Started Devstack devstack@keystone.service. Aug 24 11:18:59.863614 dv-cinder-848899-3-smb devstack@keystone.service[81490]: spawned uWSGI worker 1 (pid: 81501, cores: 1) Aug 24 11:18:59.863614 dv-cinder-848899-3-smb devstack@keystone.service[81490]: spawned uWSGI worker 2 (pid: 81502, cores: 1) Aug 24 11:18:59.863614 dv-cinder-848899-3-smb devstack@keystone.service[81490]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 24 11:19:04.087026 dv-cinder-848899-3-smb devstack@keystone.service[81501]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 11:19:04.087026 dv-cinder-848899-3-smb devstack@keystone.service[81501]: from cryptography.utils import int_from_bytes Aug 24 11:19:04.087872 dv-cinder-848899-3-smb devstack@keystone.service[81501]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 11:19:04.087872 dv-cinder-848899-3-smb devstack@keystone.service[81501]: from cryptography.utils import int_from_bytes Aug 24 11:19:04.089233 dv-cinder-848899-3-smb devstack@keystone.service[81502]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 11:19:04.089233 dv-cinder-848899-3-smb devstack@keystone.service[81502]: from cryptography.utils import int_from_bytes Aug 24 11:19:04.089729 dv-cinder-848899-3-smb devstack@keystone.service[81502]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 11:19:04.089729 dv-cinder-848899-3-smb devstack@keystone.service[81502]: from cryptography.utils import int_from_bytes Aug 24 11:19:04.137386 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 11:19:04.137590 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 11:19:04.137751 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] command line args: [] {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 11:19:04.138011 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 11:19:04.138143 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] ================================================================================ {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 11:19:04.138421 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] admin_token = **** {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:19:04.138684 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] config_dir = [] {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:19:04.138814 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 11:19:04.138899 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:19:04.138968 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 11:19:04.139034 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] config_source = [] {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:19:04.139168 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] command line args: [] {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 11:19:04.139295 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] debug = True {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:19:04.139374 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:19:04.139597 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 11:19:04.139597 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] ================================================================================ {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 11:19:04.139728 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:19:04.139789 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] admin_token = **** {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:19:04.139846 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:19:04.140063 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] config_dir = [] {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:19:04.140180 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:19:04.140247 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:19:04.140316 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:19:04.140377 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] config_source = [] {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:19:04.140546 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] list_limit = None {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:19:04.140663 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] debug = True {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:19:04.140735 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] log_config_append = None {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:19:04.140807 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:19:04.140893 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:19:04.140953 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:19:04.141016 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] log_dir = None {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:19:04.141157 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:19:04.141275 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] log_file = None {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:19:04.141354 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:19:04.141421 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:19:04.141713 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:19:04.141814 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:19:04.141883 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] list_limit = None {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:19:04.141955 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:19:04.142026 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] log_config_append = None {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:19:04.142091 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:19:04.142157 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:19:04.142261 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:19:04.142499 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] log_dir = None {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:19:04.142673 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:19:04.142754 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] log_file = None {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:19:04.142822 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:19:04.142889 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:19:04.142949 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:19:04.143200 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:19:04.143343 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:19:04.143426 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:19:04.143505 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:19:04.143582 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:19:04.143655 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:19:04.143736 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:19:04.143816 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:19:04.143887 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:19:04.144025 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:19:04.144116 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:19:04.144270 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:19:04.144371 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:19:04.144527 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:19:04.144623 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:19:04.144757 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:19:04.144989 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:19:04.145073 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.27/identity {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:19:04.145186 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] publish_errors = False {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:19:04.145266 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:19:04.145415 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:19:04.145506 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:19:04.145639 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:19:04.145729 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:19:04.145804 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:19:04.145936 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:19:04.146029 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:19:04.146256 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:19:04.146470 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.27/identity {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:19:04.146572 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] standard_threads = False {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:19:04.146650 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] publish_errors = False {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:19:04.146717 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:19:04.146874 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:19:04.146969 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:19:04.147093 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:19:04.147180 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:19:04.147255 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] use_journal = False {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:19:04.147350 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:19:04.147431 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] use_json = False {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:19:04.147500 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:19:04.147567 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] use_stderr = False {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:19:04.147716 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:19:04.147815 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] use_syslog = False {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:19:04.147955 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:19:04.148031 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] standard_threads = False {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:19:04.148170 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:19:04.148256 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.148405 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.148500 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:19:04.148593 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:19:04.148671 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.148769 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] use_journal = False {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:19:04.148875 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.148960 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] use_json = False {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:19:04.149057 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] use_stderr = False {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:19:04.149143 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.149251 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] use_syslog = False {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:19:04.149326 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.149449 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:19:04.149565 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.149709 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.149803 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.149950 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.150043 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.150206 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.150302 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.150479 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.150578 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.151060 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.151140 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.151295 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.151373 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.151526 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.151617 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.151794 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.151948 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.152033 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.152111 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.152227 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.152342 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.152475 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.152568 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.152709 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.152787 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.152954 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.153046 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.153183 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.153261 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.153427 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.153511 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.153672 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.153832 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.153917 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.154051 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.154131 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.154257 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.154400 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.154493 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.154601 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.154685 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.154829 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.154907 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.155060 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.155141 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.155304 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.155383 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.155549 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.155633 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.155780 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.155866 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.156007 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.156086 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.156253 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.156338 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.156498 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.156583 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.156728 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.156804 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.156970 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.157049 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.157208 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.157289 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.157415 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.157504 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.157649 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.157725 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.157881 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.157960 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.158135 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.158220 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.158420 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.158567 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.158660 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.158826 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.158935 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.159064 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.159168 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.159334 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.159502 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.159588 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.159691 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.159834 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.159914 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.160067 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.160154 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.160298 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.160383 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.160538 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.160623 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.160787 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.160875 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.161013 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.161091 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.161247 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.161325 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.161478 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.161564 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.161709 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.161788 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.161940 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.162019 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.162171 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.162258 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.162417 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.162499 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.162654 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.162748 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.162885 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.162991 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.163118 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.163228 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.163327 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.163430 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.163573 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.163702 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.163803 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.163905 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.164040 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.164154 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.164280 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.164367 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.164517 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.164598 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.164751 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.164843 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.164998 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.165087 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.165236 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.165316 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.165467 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.165568 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.165685 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.165768 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.165914 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.165995 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.166145 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.166226 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.166403 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.166488 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.166638 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.166727 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.166869 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.166955 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.167108 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.167248 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.167350 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.167429 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.167546 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.167637 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.167775 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.167859 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.168011 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.168107 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.168248 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.168328 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.168504 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.168589 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.168741 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.168829 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.168974 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.169053 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.169215 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.169296 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.169450 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.169531 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.169683 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.169762 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.169946 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.170026 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.170182 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.170262 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.170438 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.170521 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.170669 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.170749 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.170908 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.170991 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.171136 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.171222 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.171370 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.171461 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.171604 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.171692 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.171832 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.171910 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.172063 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.172148 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.172294 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.172380 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.172530 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.172609 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.172764 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.172844 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.173004 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.173091 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.173239 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.173318 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] auth.external = None {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.173465 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.173543 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.173710 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.173826 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.174030 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.174110 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.174291 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.174403 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] auth.password = None {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.174545 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] auth.token = None {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.174659 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.174799 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] auth.external = None {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.174888 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.175032 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.175117 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.175275 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.175357 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.175502 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.175590 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.175743 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.175824 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] auth.password = None {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.175984 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.176064 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] auth.token = None {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.176210 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.176299 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.176441 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] credential.caching = True {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.176522 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.176683 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.176763 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.176911 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.177004 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.177156 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.177236 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.177384 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.177465 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.177616 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.177703 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.177848 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.177930 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] credential.caching = True {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.178093 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.178172 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.178343 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.178484 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.178595 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.178675 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.178834 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.178912 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.179078 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.179221 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.179354 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.179479 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.179612 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.179736 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.179859 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.179991 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.180120 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.180245 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.180373 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.180761 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] federation.caching = True {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.180761 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.181024 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.181024 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.181258 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.181386 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.181511 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.181511 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.181772 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.181897 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.182028 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.182175 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.182299 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] federation.caching = True {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.182460 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.182600 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.182759 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.182901 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.183038 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.183173 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.183309 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.183437 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.183585 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.183716 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.183854 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] identity.caching = True {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.183987 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.184137 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.184268 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.184398 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.184547 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.184691 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.184821 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.184992 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.185077 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.185152 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.185225 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.185298 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.185371 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] identity.caching = True {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.185516 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.185601 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.185679 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.185752 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.185826 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.185898 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.186026 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.186106 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.186179 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.186179 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.186321 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.186321 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.186498 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.186575 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.186648 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.186721 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.186793 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.186865 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.186946 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.187022 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.187115 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.187199 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.187273 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.187346 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.187451 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.187606 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.187746 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.187832 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.187916 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.188138 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.188250 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.188371 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.188458 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.188534 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.188608 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.188681 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.188801 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.188930 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.189020 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.189197 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.189324 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.189431 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.189522 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.189675 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.189801 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.189883 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.189959 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.190134 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.190274 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.190413 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.190497 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.190585 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.190662 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.190837 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.190978 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.191062 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.191138 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.191290 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.191417 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.191498 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.191588 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.191738 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.191864 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.192060 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.192184 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.192281 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.192366 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.192522 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.192648 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.192729 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.192804 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.192975 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.193102 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.193184 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.193260 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.193435 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.193561 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.193657 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.193735 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.193877 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.193959 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.194107 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.194187 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.194339 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.194453 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.194591 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.194672 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.194821 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] ldap.user = None {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.194906 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.195057 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.195231 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.195315 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.195390 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.195528 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.195613 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.195768 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.195849 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.195998 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.196078 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.196234 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.196314 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.196463 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.196544 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] ldap.user = None {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.196691 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.196777 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.196923 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.197073 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.197161 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.197320 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.197405 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.197574 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.197707 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.197837 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.197978 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.198126 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.198262 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.198448 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.198583 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.198711 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.198849 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.198976 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.199105 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.199231 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.199359 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.199485 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.199623 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.199752 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.199889 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.200014 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.200140 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.200266 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.200468 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.200591 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.200719 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.200846 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.200973 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.201100 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.201235 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.201362 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.201491 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.201617 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.201754 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.201881 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.202015 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.202143 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.202269 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.202409 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.202534 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.202661 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.202794 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.202919 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.203042 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.203165 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.203288 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.203411 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.203552 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.203677 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.203799 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.203922 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.204045 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.204168 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] resource.caching = True {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.204305 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.204433 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.204558 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.204682 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.204805 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.204927 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.205108 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.205244 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.205369 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.205498 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.205622 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.205745 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.205876 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.206000 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.206123 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.206246 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.206401 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] resource.caching = True {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.206526 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.206664 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.206791 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] role.caching = True {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.206791 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] role.driver = sql {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.207036 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.207162 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.207162 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.207407 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.207533 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.207659 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.207786 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.207913 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.208116 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.208244 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.208368 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.208495 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.208621 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.208746 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.208890 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.209017 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.209143 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.209268 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] role.caching = True {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.209394 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.209521 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] role.driver = sql {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.209657 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.209784 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.209911 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.210037 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.210161 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.210288 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.210446 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.210586 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.210586 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.210826 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.210955 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.211081 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.211215 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.211342 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.211469 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.211597 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.211724 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.211850 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.211986 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.212113 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.212249 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.212376 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.212502 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.212630 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.212764 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.212891 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.213020 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.213146 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.213146 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.213382 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.213513 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.213638 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.213761 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.213894 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.214018 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.214149 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.214272 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.214443 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.214569 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.214696 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.214822 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.214958 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.215085 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.215085 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.215322 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.215447 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] token.caching = True {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.215572 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.215718 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.215843 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.215968 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.216092 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.216218 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.216345 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.216478 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.216603 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.216730 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.216855 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.216981 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.217106 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.217240 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.217374 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.217501 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.217625 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.217749 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.217872 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.218006 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.218132 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.218258 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.218401 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] token.caching = True {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.218525 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.218648 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.218783 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.218908 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.219032 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.219165 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.219290 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.219414 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.219550 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.219673 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.219798 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.219922 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.220045 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] database.connection = **** {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.220182 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.220316 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.220449 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.220574 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.220720 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.220845 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.220979 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.221104 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.221234 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.221359 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.221482 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.221605 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.221735 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.221858 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.221988 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.222112 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.222236 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.222378 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.222501 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.222626 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.222768 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.222895 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.223019 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] database.connection = **** {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.223151 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.223283 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.223406 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.223530 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.223653 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.223783 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.223908 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.224031 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.224154 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.224277 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.224410 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.224410 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.224652 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.224776 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 11:19:04.224900 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.224900 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.224900 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.224900 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.224900 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.224900 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.224900 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.224900 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.224900 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.225912 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.225912 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.225912 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:19:04.225912 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 11:19:04.251352 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81501) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 11:19:04.251608 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81501) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 11:19:04.251830 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81501) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 11:19:04.253547 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81502) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 11:19:04.253783 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81502) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 11:19:04.254006 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81502) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 11:19:04.260274 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81501) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 11:19:04.262719 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81502) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 11:19:04.288455 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81501) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 11:19:04.288654 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81501) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 11:19:04.289687 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81502) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 11:19:04.289919 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81502) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 11:19:04.340921 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81501) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 11:19:04.341666 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81502) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 11:19:04.388864 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81501) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 11:19:04.389074 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81501) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 11:19:04.390509 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81502) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 11:19:04.390802 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81502) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 11:19:04.546910 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81501) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 11:19:04.547117 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81502) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 11:19:04.547246 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81501) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 11:19:04.547359 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81502) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 11:19:04.547496 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81501) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 11:19:04.547578 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81502) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 11:19:04.547641 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81501) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 11:19:04.547761 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81502) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 11:19:04.547878 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81501) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 11:19:04.548002 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81502) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 11:19:04.548082 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81501) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 11:19:04.548145 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81502) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 11:19:04.570887 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81501) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 11:19:04.571026 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81502) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 11:19:04.571153 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81501) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 11:19:04.571257 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81502) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 11:19:04.571387 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81501) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 11:19:04.571467 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81502) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 11:19:04.571531 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81501) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 11:19:04.571651 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81502) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 11:19:04.571759 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81501) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 11:19:04.571884 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81502) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 11:19:04.571964 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81501) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 11:19:04.572056 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81502) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 11:19:04.572144 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81501) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 11:19:04.572295 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81502) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 11:19:04.583186 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81501) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 11:19:04.583552 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81502) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 11:19:04.596122 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81501) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 11:19:04.596262 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81501) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 11:19:04.596496 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81501) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 11:19:04.596638 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81502) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 11:19:04.596792 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81501) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 11:19:04.596877 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81502) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 11:19:04.597002 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81501) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 11:19:04.597081 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81502) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 11:19:04.597216 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81501) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 11:19:04.597296 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81502) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 11:19:04.597359 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81501) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 11:19:04.597432 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81502) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 11:19:04.597549 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81502) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 11:19:04.597741 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81502) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 11:19:04.613839 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:19:04.614014 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 24 11:19:04.614255 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:19:04.614403 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:19:04.614544 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 24 11:19:04.614688 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 24 11:19:04.614897 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:19:04.615019 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:19:04.615019 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 24 11:19:04.615270 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:19:04.615368 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:19:04.615564 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:19:04.615713 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:19:04.615839 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:19:04.616076 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:19:04.616340 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:19:04.625145 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:19:04.625422 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:19:04.625692 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:19:04.625816 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:19:04.625962 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:19:04.626106 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:19:04.626241 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:19:04.626528 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:19:04.633014 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81501) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 11:19:04.633528 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81502) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 11:19:04.635921 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81501) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 11:19:04.636204 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:19:04.636435 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81502) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 11:19:04.636572 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:19:04.636766 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:19:04.636891 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:19:04.637043 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:19:04.637174 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:19:04.637300 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:19:04.637440 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:19:04.637563 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:19:04.637697 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:19:04.637863 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:19:04.637989 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:19:04.638116 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:19:04.638244 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:19:04.638411 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:19:04.638539 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:19:04.638668 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:19:04.638806 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:19:04.638935 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:19:04.639238 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:19:04.661422 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:19:04.662768 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:19:04.662894 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81501) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 11:19:04.663129 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:19:04.664234 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81502) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 11:19:04.664519 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:19:04.667745 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81501) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 11:19:04.668027 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:19:04.668304 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:19:04.669161 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81502) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 11:19:04.669444 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:19:04.669736 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:19:04.674588 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81501) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 11:19:04.674872 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:19:04.676076 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81502) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 11:19:04.676362 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:19:04.678894 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81501) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 11:19:04.679182 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:19:04.679459 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:19:04.679735 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:19:04.680011 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:19:04.680286 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:19:04.680410 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81502) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 11:19:04.680567 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:19:04.680697 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:19:04.680829 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:19:04.680966 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:19:04.681239 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:19:04.681537 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:19:04.681818 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:19:04.682088 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:19:04.682340 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:19:04.697742 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:19:04.697991 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:19:04.699670 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:19:04.699955 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:19:04.701855 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81501) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 11:19:04.703801 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81502) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 11:19:04.705034 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:19:04.705633 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:19:04.707056 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:19:04.707357 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:19:04.710087 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81501) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 11:19:04.711558 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81502) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 11:19:04.714154 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81501) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 11:19:04.714694 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81502) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 11:19:04.717894 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:19:04.718195 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:19:04.718516 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:19:04.718814 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:19:04.718938 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:19:04.719087 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:19:04.719234 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:19:04.719362 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:19:04.719495 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:19:04.719723 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:19:04.720017 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:19:04.720302 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:19:04.735433 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81502) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 11:19:04.735740 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:19:04.736014 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:19:04.736305 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:19:04.737102 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81501) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 11:19:04.737401 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:19:04.737668 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:19:04.737929 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:19:04.743205 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:19:04.744718 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:19:04.744915 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:19:04.745012 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:19:04.746309 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:19:04.746604 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:19:04.748000 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81502) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 11:19:04.748287 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:19:04.748586 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:19:04.748857 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:19:04.749169 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:19:04.749294 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81501) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 11:19:04.749510 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:19:04.749810 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:19:04.750106 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:19:04.750384 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:19:04.760516 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81502) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 11:19:04.760808 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:19:04.761092 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:19:04.761382 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:19:04.761665 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:19:04.761792 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81501) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 11:19:04.761960 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:19:04.762105 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:19:04.762240 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:19:04.762389 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:19:04.762532 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:19:04.762748 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:19:04.763024 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:19:04.763293 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:19:04.778150 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81502) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 11:19:04.778776 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81501) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 11:19:04.781204 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81502) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 11:19:04.781760 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81501) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 11:19:04.784174 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:19:04.784761 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:19:04.785610 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:19:04.786174 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:19:04.787113 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81502) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 11:19:04.787397 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:19:04.787667 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81501) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 11:19:04.787794 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:19:04.788082 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:19:04.788170 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:19:04.794103 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:19:04.794590 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:19:04.795908 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81502) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 11:19:04.796035 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81501) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 11:19:04.798903 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:19:04.799104 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:19:04.799201 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:19:04.799329 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:19:04.799471 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:19:04.799598 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:19:04.799752 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:19:04.799889 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:19:04.807571 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81501) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 11:19:04.807698 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81502) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 11:19:04.807845 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:19:04.807992 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:19:04.808134 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:19:04.808261 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:19:04.814999 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81501) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 11:19:04.815126 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81502) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 11:19:04.815274 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:19:04.815462 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:19:04.815554 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:19:04.815677 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:19:04.815802 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:19:04.815926 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:19:04.816062 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:19:04.816195 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:19:04.816363 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:19:04.816491 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:19:04.816619 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:19:04.816825 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:19:04.817018 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:19:04.817167 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:19:04.817300 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:19:04.817428 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:19:04.817568 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:19:04.817706 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:19:04.817834 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:19:04.817974 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:19:04.818110 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:19:04.818283 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:19:04.818438 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:19:04.818564 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:19:04.818689 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:19:04.818813 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:19:04.852043 dv-cinder-848899-3-smb devstack@keystone.service[81501]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55ed03a0f9c0 pid: 81501 (default app) Aug 24 11:19:04.853082 dv-cinder-848899-3-smb devstack@keystone.service[81502]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55ed03a0f9c0 pid: 81502 (default app) Aug 24 11:19:04.855481 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd659f52-7391-4d7b-b2cc-6eb8175d22bb None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:04.855769 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd659f52-7391-4d7b-b2cc-6eb8175d22bb None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:04.856036 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd659f52-7391-4d7b-b2cc-6eb8175d22bb None None] PATH_INFO: `/v3` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:04.860247 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1/1] 10.222.0.27 () {50 vars in 791 bytes} [Wed Aug 24 11:19:04 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:19:11.433163 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea83823-68ac-43ce-a0b1-2a932a96c6a4 None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:11.433676 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea83823-68ac-43ce-a0b1-2a932a96c6a4 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:11.433676 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea83823-68ac-43ce-a0b1-2a932a96c6a4 None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:11.437939 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1/2] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:19:11 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:19:11.445762 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8467a302-de3d-4eca-995c-2e1bbf6ed52b None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:11.446485 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8467a302-de3d-4eca-995c-2e1bbf6ed52b None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:11.446741 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8467a302-de3d-4eca-995c-2e1bbf6ed52b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:11.528643 dv-cinder-848899-3-smb devstack@keystone.service[81501]: INFO dbcounter [None req-8467a302-de3d-4eca-995c-2e1bbf6ed52b None None] Registered counter for database keystone Aug 24 11:19:11.550477 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG oslo_db.sqlalchemy.engines [None req-8467a302-de3d-4eca-995c-2e1bbf6ed52b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81501) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 11:19:11.559900 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writer thread running {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 11:19:11.757010 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG passlib.handlers.bcrypt [None req-8467a302-de3d-4eca-995c-2e1bbf6ed52b None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=81501) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 24 11:19:11.757433 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG passlib.handlers.bcrypt [None req-8467a302-de3d-4eca-995c-2e1bbf6ed52b None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81501) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 24 11:19:11.813411 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-8467a302-de3d-4eca-995c-2e1bbf6ed52b None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:19:11.815081 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-8467a302-de3d-4eca-995c-2e1bbf6ed52b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:19:11.961346 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 2/3] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:19:11 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 517 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 24 11:19:12.455559 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea83823-68ac-43ce-a0b1-2a932a96c6a4 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:12.535033 dv-cinder-848899-3-smb devstack@keystone.service[81502]: INFO dbcounter [None req-1ea83823-68ac-43ce-a0b1-2a932a96c6a4 None None] Registered counter for database keystone Aug 24 11:19:12.560789 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG oslo_db.sqlalchemy.engines [None req-1ea83823-68ac-43ce-a0b1-2a932a96c6a4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81502) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 11:19:12.572517 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writer thread running {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 11:19:12.694592 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea83823-68ac-43ce-a0b1-2a932a96c6a4 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:12.700097 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05531e01-9812-4564-bcac-784974cd5a78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:12.700736 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05531e01-9812-4564-bcac-784974cd5a78 admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:12.701008 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05531e01-9812-4564-bcac-784974cd5a78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:12.701275 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05531e01-9812-4564-bcac-784974cd5a78 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:12.709881 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05531e01-9812-4564-bcac-784974cd5a78 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:19:12.760725 dv-cinder-848899-3-smb devstack@keystone.service[81502]: WARNING keystone.common.rbac_enforcer.enforcer [None req-05531e01-9812-4564-bcac-784974cd5a78 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 24 11:19:12.761065 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05531e01-9812-4564-bcac-784974cd5a78 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:19:12.771126 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 2/4] 10.222.0.27 () {58 vars in 1324 bytes} [Wed Aug 24 11:19:12 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 11:19:12.778705 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8467a302-de3d-4eca-995c-2e1bbf6ed52b None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:12.795700 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8467a302-de3d-4eca-995c-2e1bbf6ed52b None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:12.801875 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a61284b-524a-4e6a-998f-31894c1890ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:12.803050 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a61284b-524a-4e6a-998f-31894c1890ac admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:12.803331 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a61284b-524a-4e6a-998f-31894c1890ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:12.803606 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a61284b-524a-4e6a-998f-31894c1890ac admin admin] PATH_INFO: `/v3/projects/5558cde3f9bd4a779ecb6a225f26878d` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:12.805407 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a61284b-524a-4e6a-998f-31894c1890ac admin admin] RBAC: Authorizing `identity:get_project(project_id=5558cde3f9bd4a779ecb6a225f26878d)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:19:12.857972 dv-cinder-848899-3-smb devstack@keystone.service[81501]: WARNING keystone.common.rbac_enforcer.enforcer [None req-9a61284b-524a-4e6a-998f-31894c1890ac admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 24 11:19:12.858329 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a61284b-524a-4e6a-998f-31894c1890ac admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:19:12.862971 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 3/5] 10.222.0.27 () {56 vars in 1207 bytes} [Wed Aug 24 11:19:12 2022] GET /identity/v3/projects/5558cde3f9bd4a779ecb6a225f26878d => generated 344 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:19:14.748604 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4025d405-76ec-49cb-96ed-42c877ab05f7 None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:14.749205 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4025d405-76ec-49cb-96ed-42c877ab05f7 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:14.749205 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4025d405-76ec-49cb-96ed-42c877ab05f7 None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:14.756008 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 3/6] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:19:14 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:19:14.765322 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207af9c6-231b-439e-b668-5be57f5f8257 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:14.765749 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207af9c6-231b-439e-b668-5be57f5f8257 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:14.765917 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207af9c6-231b-439e-b668-5be57f5f8257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:14.789872 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-207af9c6-231b-439e-b668-5be57f5f8257 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:19:14.791451 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-207af9c6-231b-439e-b668-5be57f5f8257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:19:14.801175 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 4/7] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:19:14 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 24 11:19:15.075426 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4025d405-76ec-49cb-96ed-42c877ab05f7 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:15.089487 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4025d405-76ec-49cb-96ed-42c877ab05f7 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:15.094969 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f83941-94a1-4d73-afd4-7feab4a0d82c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:15.095617 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f83941-94a1-4d73-afd4-7feab4a0d82c admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:15.095909 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f83941-94a1-4d73-afd4-7feab4a0d82c admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:15.096190 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f83941-94a1-4d73-afd4-7feab4a0d82c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:15.104234 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f83941-94a1-4d73-afd4-7feab4a0d82c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:19:15.106037 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f83941-94a1-4d73-afd4-7feab4a0d82c admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:19:15.115248 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 4/8] 10.222.0.27 () {58 vars in 1324 bytes} [Wed Aug 24 11:19:15 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 11:19:15.124324 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207af9c6-231b-439e-b668-5be57f5f8257 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:15.135294 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207af9c6-231b-439e-b668-5be57f5f8257 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:15.141124 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4db6e9-3c67-4557-84b2-555ebf186903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:15.141755 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4db6e9-3c67-4557-84b2-555ebf186903 admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:15.142032 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4db6e9-3c67-4557-84b2-555ebf186903 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:15.142300 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4db6e9-3c67-4557-84b2-555ebf186903 admin admin] PATH_INFO: `/v3/users/1e2e9ab325dc4dbf92dd6b59db4a0945` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:15.143815 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4db6e9-3c67-4557-84b2-555ebf186903 admin admin] RBAC: Authorizing `identity:get_user(user_id=1e2e9ab325dc4dbf92dd6b59db4a0945)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:19:15.145696 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4db6e9-3c67-4557-84b2-555ebf186903 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:19:15.147299 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 5/9] 10.222.0.27 () {56 vars in 1198 bytes} [Wed Aug 24 11:19:15 2022] GET /identity/v3/users/1e2e9ab325dc4dbf92dd6b59db4a0945 => generated 247 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:19:17.096050 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a51d4c-0704-4f2e-be0d-85032525147c None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:17.096638 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a51d4c-0704-4f2e-be0d-85032525147c None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:17.096638 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a51d4c-0704-4f2e-be0d-85032525147c None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:17.097989 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 5/10] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:19:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:19:17.103289 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6363713-bede-420c-862b-3afde954078a None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:17.103686 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6363713-bede-420c-862b-3afde954078a None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:17.103838 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6363713-bede-420c-862b-3afde954078a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:17.122848 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-d6363713-bede-420c-862b-3afde954078a None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:19:17.124045 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-d6363713-bede-420c-862b-3afde954078a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:19:17.141739 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c69f0c-33fa-4405-8a36-bbaefe6f5358 None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:17.142027 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c69f0c-33fa-4405-8a36-bbaefe6f5358 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:17.142333 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c69f0c-33fa-4405-8a36-bbaefe6f5358 None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:17.143842 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 6/11] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:19:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:19:17.148874 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acddd902-00c8-4311-8923-cc5ed2ed274f None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:17.149162 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acddd902-00c8-4311-8923-cc5ed2ed274f None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:17.149434 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acddd902-00c8-4311-8923-cc5ed2ed274f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:17.192801 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG passlib.handlers.bcrypt [None req-acddd902-00c8-4311-8923-cc5ed2ed274f None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=81502) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 24 11:19:17.193277 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG passlib.handlers.bcrypt [None req-acddd902-00c8-4311-8923-cc5ed2ed274f None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81502) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 24 11:19:17.207450 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 6/12] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:19:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 11:19:17.238296 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-acddd902-00c8-4311-8923-cc5ed2ed274f None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:19:17.239911 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-acddd902-00c8-4311-8923-cc5ed2ed274f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:19:17.341034 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 7/13] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:19:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 11:19:17.470333 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6363713-bede-420c-862b-3afde954078a None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:17.495445 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:17.578793 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6363713-bede-420c-862b-3afde954078a None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:17.603218 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acddd902-00c8-4311-8923-cc5ed2ed274f None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:17.614184 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde9813b-3a9a-4b36-9ab2-033bb9bb5949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:17.614891 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde9813b-3a9a-4b36-9ab2-033bb9bb5949 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:17.615172 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde9813b-3a9a-4b36-9ab2-033bb9bb5949 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:17.615448 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde9813b-3a9a-4b36-9ab2-033bb9bb5949 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:17.635850 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde9813b-3a9a-4b36-9ab2-033bb9bb5949 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:19:17.645165 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-dde9813b-3a9a-4b36-9ab2-033bb9bb5949 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 11:19:17.645165 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:19:17.645165 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:19:17.645165 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:19:17.645165 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:19:17.645165 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:19:17.645165 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:19:17.645165 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:19:17.645165 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:19:17.645165 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:19:17.645165 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:19:17.645165 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:19:17.645165 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:19:17.645165 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:19:17.645165 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:19:17.645165 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:19:17.646201 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:19:17.646201 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:19:17.646201 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:19:17.646201 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:19:17.646201 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:19:17.646201 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:19:17.646201 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:19:17.646201 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:19:17.646201 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:19:17.646201 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:19:17.646201 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:19:17.646201 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Aug 24 11:19:17.646201 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:19:17.646201 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:19:17.646201 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:19:17.646201 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:19:17.647329 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:19:17.647329 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:19:17.647329 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:19:17.647329 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:19:17.647329 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:19:17.647329 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:19:17.647329 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:19:17.647329 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:19:17.647329 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:19:17.647329 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:19:17.647329 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 11:19:17.647329 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:19:17.647329 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 7/14] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Aug 24 11:19:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:19:17.652733 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde9813b-3a9a-4b36-9ab2-033bb9bb5949 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:17.710705 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acddd902-00c8-4311-8923-cc5ed2ed274f None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:17.713464 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:17.735541 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:17.748055 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1285a8b7-9131-4a7d-9168-df5e847dfe38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:17.748924 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1285a8b7-9131-4a7d-9168-df5e847dfe38 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:17.749201 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1285a8b7-9131-4a7d-9168-df5e847dfe38 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:17.749468 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1285a8b7-9131-4a7d-9168-df5e847dfe38 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:17.753519 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde9813b-3a9a-4b36-9ab2-033bb9bb5949 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:17.786302 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d5f2ec-369d-4d10-adb9-2bddee0e4466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:17.786950 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d5f2ec-369d-4d10-adb9-2bddee0e4466 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:17.787230 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d5f2ec-369d-4d10-adb9-2bddee0e4466 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:17.787503 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d5f2ec-369d-4d10-adb9-2bddee0e4466 None admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:17.788257 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d5f2ec-369d-4d10-adb9-2bddee0e4466 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:19:17.788571 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d5f2ec-369d-4d10-adb9-2bddee0e4466 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:19:17.789993 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d5f2ec-369d-4d10-adb9-2bddee0e4466 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:19:17.801549 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 8/15] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 24 11:19:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:19:17.807213 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d5f2ec-369d-4d10-adb9-2bddee0e4466 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:17.817519 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1285a8b7-9131-4a7d-9168-df5e847dfe38 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:19:17.819123 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1285a8b7-9131-4a7d-9168-df5e847dfe38 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:19:17.907898 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d5f2ec-369d-4d10-adb9-2bddee0e4466 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:17.919475 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 8/16] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 24 11:19:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 11:19:17.925828 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1285a8b7-9131-4a7d-9168-df5e847dfe38 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:17.928562 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:17.943471 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc31f524-c94f-48f3-a0d7-4f7b779af361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:17.944121 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc31f524-c94f-48f3-a0d7-4f7b779af361 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:17.944403 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc31f524-c94f-48f3-a0d7-4f7b779af361 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:17.944677 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc31f524-c94f-48f3-a0d7-4f7b779af361 None admin] PATH_INFO: `/v3/users/1e2e9ab325dc4dbf92dd6b59db4a0945` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:17.945840 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc31f524-c94f-48f3-a0d7-4f7b779af361 None admin] RBAC: Authorizing `identity:get_user(user_id=1e2e9ab325dc4dbf92dd6b59db4a0945)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:19:17.947389 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc31f524-c94f-48f3-a0d7-4f7b779af361 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:19:17.949027 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 9/17] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Aug 24 11:19:17 2022] GET /identity/v3/users/1e2e9ab325dc4dbf92dd6b59db4a0945 => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:19:17.954595 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc31f524-c94f-48f3-a0d7-4f7b779af361 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:17.968768 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:18.023399 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1285a8b7-9131-4a7d-9168-df5e847dfe38 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:18.052808 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc31f524-c94f-48f3-a0d7-4f7b779af361 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:18.058869 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc364dd-d59f-47b8-a8e2-bcb5198403d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:18.059761 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc364dd-d59f-47b8-a8e2-bcb5198403d5 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:18.060029 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc364dd-d59f-47b8-a8e2-bcb5198403d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:18.060304 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc364dd-d59f-47b8-a8e2-bcb5198403d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:18.078940 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc364dd-d59f-47b8-a8e2-bcb5198403d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:19:18.080472 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc364dd-d59f-47b8-a8e2-bcb5198403d5 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:19:18.086644 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc502317-092b-4745-a64b-ed39a0c247a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:18.087298 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc502317-092b-4745-a64b-ed39a0c247a3 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:18.087577 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc502317-092b-4745-a64b-ed39a0c247a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:18.087850 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc502317-092b-4745-a64b-ed39a0c247a3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:18.088978 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc502317-092b-4745-a64b-ed39a0c247a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:19:18.090527 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc502317-092b-4745-a64b-ed39a0c247a3 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:19:18.092068 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 10/18] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 11:19:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:19:18.098142 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc502317-092b-4745-a64b-ed39a0c247a3 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:18.099163 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-bcc364dd-d59f-47b8-a8e2-bcb5198403d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:19:18.099163 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:19:18.099163 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:19:18.099163 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:19:18.099163 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:19:18.099163 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:19:18.099163 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:19:18.099163 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:19:18.099163 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:19:18.099163 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:19:18.099163 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:19:18.099163 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:19:18.099163 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 11:19:18.099163 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 11:19:18.099163 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 11:19:18.099163 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 11:19:18.100491 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:19:18.100491 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:19:18.100491 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:19:18.100491 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:19:18.100491 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:19:18.100491 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:19:18.100491 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:19:18.100491 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Aug 24 11:19:18.100491 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:19:18.100491 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:19:18.100491 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:19:18.100491 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:19:18.100491 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:19:18.100491 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:19:18.100491 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:19:18.100491 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:19:18.100491 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 11:19:18.101342 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 11:19:18.101342 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:19:18.101342 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Aug 24 11:19:18.101342 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 9/19] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 11:19:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 11:19:18.105995 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc364dd-d59f-47b8-a8e2-bcb5198403d5 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:18.163239 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:18.181948 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:18.201414 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc502317-092b-4745-a64b-ed39a0c247a3 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:18.206490 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc364dd-d59f-47b8-a8e2-bcb5198403d5 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:18.234025 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b6a755-d387-43e4-8a15-1427dccb26f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:18.234672 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b6a755-d387-43e4-8a15-1427dccb26f3 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:18.234947 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b6a755-d387-43e4-8a15-1427dccb26f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:18.235217 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b6a755-d387-43e4-8a15-1427dccb26f3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:18.235941 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b6a755-d387-43e4-8a15-1427dccb26f3 None admin] RBAC: Adding query filter params (role.id=30bb1e97257f4ca5b90c88545777317b, scope.domain.id=default, user.id=1e2e9ab325dc4dbf92dd6b59db4a0945) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:19:18.236240 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b6a755-d387-43e4-8a15-1427dccb26f3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:19:18.237698 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b6a755-d387-43e4-8a15-1427dccb26f3 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:19:18.239701 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9166dac8-dc63-4709-8146-deefc9cee4b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:18.240306 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9166dac8-dc63-4709-8146-deefc9cee4b2 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:18.240584 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9166dac8-dc63-4709-8146-deefc9cee4b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:18.240854 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9166dac8-dc63-4709-8146-deefc9cee4b2 None admin] PATH_INFO: `/v3/domains` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:18.241528 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9166dac8-dc63-4709-8146-deefc9cee4b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:19:18.241800 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9166dac8-dc63-4709-8146-deefc9cee4b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:19:18.243215 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9166dac8-dc63-4709-8146-deefc9cee4b2 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:19:18.244432 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 11/20] 10.222.0.27 () {56 vars in 1322 bytes} [Wed Aug 24 11:19:18 2022] GET /identity/v3/role_assignments?user.id=1e2e9ab325dc4dbf92dd6b59db4a0945&scope.domain.id=default&role.id=30bb1e97257f4ca5b90c88545777317b => generated 233 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:19:18.262221 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 10/21] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 24 11:19:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:19:20.341651 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393bce35-a9bf-412a-870c-b66c160a21c8 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:20.342651 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393bce35-a9bf-412a-870c-b66c160a21c8 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:20.343143 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393bce35-a9bf-412a-870c-b66c160a21c8 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:20.344678 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 12/22] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:19:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:19:20.351741 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc4c48e-86fc-4756-87bb-2c44dfbba9fd None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:20.352146 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc4c48e-86fc-4756-87bb-2c44dfbba9fd None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:20.352323 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc4c48e-86fc-4756-87bb-2c44dfbba9fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:20.379803 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-8cc4c48e-86fc-4756-87bb-2c44dfbba9fd None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:19:20.380928 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-8cc4c48e-86fc-4756-87bb-2c44dfbba9fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:19:20.475725 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 11/23] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:19:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 11:19:20.498526 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d400b1-1cc1-4f54-b36a-7b3bdc8c5d37 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:20.499209 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d400b1-1cc1-4f54-b36a-7b3bdc8c5d37 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:20.499692 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d400b1-1cc1-4f54-b36a-7b3bdc8c5d37 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:20.501239 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 13/24] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:19:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:19:20.506634 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffbf76b-f747-4ce2-a0d0-1ac0758fa455 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:20.506922 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffbf76b-f747-4ce2-a0d0-1ac0758fa455 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:20.507200 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffbf76b-f747-4ce2-a0d0-1ac0758fa455 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:20.535630 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-3ffbf76b-f747-4ce2-a0d0-1ac0758fa455 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:19:20.536825 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-3ffbf76b-f747-4ce2-a0d0-1ac0758fa455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:19:20.571880 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be4a61f-dbb0-4bc4-94e8-725987172eb1 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:20.572507 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be4a61f-dbb0-4bc4-94e8-725987172eb1 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:20.572990 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be4a61f-dbb0-4bc4-94e8-725987172eb1 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:20.577940 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 14/25] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:19:20 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:19:20.583315 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561fbdde-3424-4cd9-b997-487874bcb9e1 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:20.583857 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561fbdde-3424-4cd9-b997-487874bcb9e1 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:20.584328 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561fbdde-3424-4cd9-b997-487874bcb9e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:20.602716 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:20.619298 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-561fbdde-3424-4cd9-b997-487874bcb9e1 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:19:20.620651 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-561fbdde-3424-4cd9-b997-487874bcb9e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:19:20.653209 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 12/26] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:19:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 11:19:20.736909 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 15/27] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:19:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 11:19:20.900094 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffbf76b-f747-4ce2-a0d0-1ac0758fa455 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:21.033216 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffbf76b-f747-4ce2-a0d0-1ac0758fa455 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:21.073808 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d37dcc-6db9-4eec-af20-d131080ff494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:21.074474 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d37dcc-6db9-4eec-af20-d131080ff494 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:21.074754 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d37dcc-6db9-4eec-af20-d131080ff494 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:21.075020 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d37dcc-6db9-4eec-af20-d131080ff494 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:21.091832 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d37dcc-6db9-4eec-af20-d131080ff494 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:19:21.098364 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-18d37dcc-6db9-4eec-af20-d131080ff494 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 11:19:21.098364 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:19:21.098364 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:19:21.098364 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:19:21.098364 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:19:21.098364 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:19:21.098364 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:19:21.098364 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:19:21.098364 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:19:21.098364 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:19:21.098364 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:19:21.098364 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:19:21.098364 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:19:21.098364 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:19:21.098364 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:19:21.098364 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:19:21.099391 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:19:21.099391 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:19:21.099391 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:19:21.099391 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:19:21.099391 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:19:21.099391 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:19:21.099391 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:19:21.099391 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:19:21.099391 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:19:21.099391 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:19:21.099391 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:19:21.099391 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Aug 24 11:19:21.099391 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:19:21.099391 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:19:21.099391 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:19:21.099391 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:19:21.100297 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:19:21.100297 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:19:21.100297 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:19:21.100297 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:19:21.100297 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:19:21.100297 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:19:21.100297 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:19:21.100297 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:19:21.100297 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:19:21.100297 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:19:21.100297 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 11:19:21.100297 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Aug 24 11:19:21.100297 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 13/28] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Aug 24 11:19:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:19:21.103367 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561fbdde-3424-4cd9-b997-487874bcb9e1 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:21.118413 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d37dcc-6db9-4eec-af20-d131080ff494 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:21.188129 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:21.287440 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:21.299321 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d37dcc-6db9-4eec-af20-d131080ff494 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:21.334943 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561fbdde-3424-4cd9-b997-487874bcb9e1 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:21.340564 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bff530c-cb05-41c2-aab9-017ac8acd02d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:21.341183 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bff530c-cb05-41c2-aab9-017ac8acd02d None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:21.341461 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bff530c-cb05-41c2-aab9-017ac8acd02d None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:21.341735 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bff530c-cb05-41c2-aab9-017ac8acd02d None admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:21.342436 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bff530c-cb05-41c2-aab9-017ac8acd02d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:19:21.342730 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bff530c-cb05-41c2-aab9-017ac8acd02d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:19:21.344344 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bff530c-cb05-41c2-aab9-017ac8acd02d None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:19:21.358000 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 14/29] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 24 11:19:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:19:21.359669 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bff530c-cb05-41c2-aab9-017ac8acd02d None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:21.400133 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1d4de9-7604-45f9-8262-501c35dc06b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:21.402692 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1d4de9-7604-45f9-8262-501c35dc06b4 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:21.403471 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1d4de9-7604-45f9-8262-501c35dc06b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:21.404220 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1d4de9-7604-45f9-8262-501c35dc06b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:21.423779 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1d4de9-7604-45f9-8262-501c35dc06b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:19:21.427723 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1d4de9-7604-45f9-8262-501c35dc06b4 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:19:21.457554 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-dc1d4de9-7604-45f9-8262-501c35dc06b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:19:21.457554 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:19:21.457554 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:19:21.457554 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:19:21.457554 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:19:21.457554 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:19:21.457554 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:19:21.457554 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:19:21.457554 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:19:21.457554 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:19:21.457554 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:19:21.457554 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:19:21.457554 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 11:19:21.457554 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 11:19:21.457554 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 11:19:21.457554 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 11:19:21.458543 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:19:21.458543 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:19:21.458543 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:19:21.458543 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:19:21.458543 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:19:21.458543 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:19:21.458543 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:19:21.458543 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Aug 24 11:19:21.458543 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:19:21.458543 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:19:21.458543 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:19:21.458543 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:19:21.458543 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:19:21.458543 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:19:21.458543 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:19:21.458543 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:19:21.458543 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 11:19:21.459484 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 11:19:21.459484 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:19:21.459484 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:19:21.461471 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 16/30] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 11:19:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 359 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 11:19:21.464919 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cbf9fa-8890-43ea-8a4d-ea62aed7327a None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:21.465441 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cbf9fa-8890-43ea-8a4d-ea62aed7327a None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:21.466104 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cbf9fa-8890-43ea-8a4d-ea62aed7327a None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:21.477560 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 17/31] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:19:21 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:19:21.478982 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cbf9fa-8890-43ea-8a4d-ea62aed7327a None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:21.485163 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:21.487096 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bff530c-cb05-41c2-aab9-017ac8acd02d None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:21.557177 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f2ba7a-c4f0-4e06-8adc-9a9734862d16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:21.558088 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f2ba7a-c4f0-4e06-8adc-9a9734862d16 None admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:21.558529 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f2ba7a-c4f0-4e06-8adc-9a9734862d16 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:21.558939 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f2ba7a-c4f0-4e06-8adc-9a9734862d16 None admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:21.559865 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f2ba7a-c4f0-4e06-8adc-9a9734862d16 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:19:21.561438 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f2ba7a-c4f0-4e06-8adc-9a9734862d16 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:19:21.638163 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cbf9fa-8890-43ea-8a4d-ea62aed7327a None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:21.695583 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:21.707013 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417634fc-124c-42cb-b9b5-16637c8f5452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:21.707691 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417634fc-124c-42cb-b9b5-16637c8f5452 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:21.707970 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417634fc-124c-42cb-b9b5-16637c8f5452 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:21.709508 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417634fc-124c-42cb-b9b5-16637c8f5452 None admin] PATH_INFO: `/v3/users/1e2e9ab325dc4dbf92dd6b59db4a0945` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:21.711560 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417634fc-124c-42cb-b9b5-16637c8f5452 None admin] RBAC: Authorizing `identity:get_user(user_id=1e2e9ab325dc4dbf92dd6b59db4a0945)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:19:21.713068 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417634fc-124c-42cb-b9b5-16637c8f5452 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:19:21.717038 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 18/32] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Aug 24 11:19:21 2022] GET /identity/v3/users/1e2e9ab325dc4dbf92dd6b59db4a0945 => generated 247 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:19:21.719167 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417634fc-124c-42cb-b9b5-16637c8f5452 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:21.723276 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 15/33] 10.222.0.27 () {60 vars in 1131 bytes} [Wed Aug 24 11:19:21 2022] POST /identity/v3/roles => generated 219 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:19:21.724957 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f04664-8bf9-4ed7-98bf-9ed307841bb5 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:21.725575 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f04664-8bf9-4ed7-98bf-9ed307841bb5 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:21.726041 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f04664-8bf9-4ed7-98bf-9ed307841bb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:21.746716 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-f6f04664-8bf9-4ed7-98bf-9ed307841bb5 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:19:21.748664 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-f6f04664-8bf9-4ed7-98bf-9ed307841bb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:19:21.835681 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 16/34] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:19:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 11:19:21.837213 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f04664-8bf9-4ed7-98bf-9ed307841bb5 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:22.022165 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:22.027466 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417634fc-124c-42cb-b9b5-16637c8f5452 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:22.044581 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f04664-8bf9-4ed7-98bf-9ed307841bb5 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:22.105435 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b950ca-8876-4cc7-9d9d-16d33515c27f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:22.107126 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b950ca-8876-4cc7-9d9d-16d33515c27f None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:22.107126 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b950ca-8876-4cc7-9d9d-16d33515c27f None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:22.107126 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b950ca-8876-4cc7-9d9d-16d33515c27f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:22.108334 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b950ca-8876-4cc7-9d9d-16d33515c27f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:19:22.110053 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b950ca-8876-4cc7-9d9d-16d33515c27f None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:19:22.111771 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 17/35] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 11:19:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:19:22.128496 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b950ca-8876-4cc7-9d9d-16d33515c27f None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:22.153687 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f4de14-9cbc-442f-9c69-a79e241da9e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:22.154729 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f4de14-9cbc-442f-9c69-a79e241da9e5 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:22.155218 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f4de14-9cbc-442f-9c69-a79e241da9e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:22.155801 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f4de14-9cbc-442f-9c69-a79e241da9e5 None admin] PATH_INFO: `/v3/domains` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:22.156665 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f4de14-9cbc-442f-9c69-a79e241da9e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:19:22.157206 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f4de14-9cbc-442f-9c69-a79e241da9e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:19:22.163036 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f4de14-9cbc-442f-9c69-a79e241da9e5 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:19:22.202962 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 19/36] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 24 11:19:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 485 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:19:22.204285 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd9bed0-108c-4aa8-9347-226d30b4447d None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:22.204566 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd9bed0-108c-4aa8-9347-226d30b4447d None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:22.204838 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd9bed0-108c-4aa8-9347-226d30b4447d None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:22.216361 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 20/37] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:19:22 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:19:22.217288 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd9bed0-108c-4aa8-9347-226d30b4447d None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:22.296191 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:22.303203 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b950ca-8876-4cc7-9d9d-16d33515c27f None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:22.339824 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b28a6b-0b86-4c9d-ab3b-06360b28ad30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:22.340501 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b28a6b-0b86-4c9d-ab3b-06360b28ad30 None admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:22.340784 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b28a6b-0b86-4c9d-ab3b-06360b28ad30 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:22.341064 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b28a6b-0b86-4c9d-ab3b-06360b28ad30 None admin] PATH_INFO: `/v3/domains/default/users/1e2e9ab325dc4dbf92dd6b59db4a0945/roles/30bb1e97257f4ca5b90c88545777317b` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:22.343485 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b28a6b-0b86-4c9d-ab3b-06360b28ad30 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=1e2e9ab325dc4dbf92dd6b59db4a0945, role_id=30bb1e97257f4ca5b90c88545777317b)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:19:22.344964 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b28a6b-0b86-4c9d-ab3b-06360b28ad30 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:19:22.346201 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd9bed0-108c-4aa8-9347-226d30b4447d None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:22.364894 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 18/38] 10.222.0.27 () {58 vars in 1361 bytes} [Wed Aug 24 11:19:22 2022] PUT /identity/v3/domains/default/users/1e2e9ab325dc4dbf92dd6b59db4a0945/roles/30bb1e97257f4ca5b90c88545777317b => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:19:22.366062 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d8a2ad-7c25-4755-a962-2f417243b370 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:22.366369 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d8a2ad-7c25-4755-a962-2f417243b370 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:22.366660 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d8a2ad-7c25-4755-a962-2f417243b370 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:22.385253 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-41d8a2ad-7c25-4755-a962-2f417243b370 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:19:22.386538 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-41d8a2ad-7c25-4755-a962-2f417243b370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:19:22.396226 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76651b6-5497-4cdf-8cc9-46b25ca9a339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:22.396848 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76651b6-5497-4cdf-8cc9-46b25ca9a339 None admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:22.397121 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76651b6-5497-4cdf-8cc9-46b25ca9a339 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:22.397391 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76651b6-5497-4cdf-8cc9-46b25ca9a339 None admin] PATH_INFO: `/v3/projects` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:22.398079 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76651b6-5497-4cdf-8cc9-46b25ca9a339 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:19:22.399637 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76651b6-5497-4cdf-8cc9-46b25ca9a339 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:19:22.399818 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:22.478387 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 19/39] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:19:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 11:19:22.478387 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d8a2ad-7c25-4755-a962-2f417243b370 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:22.548990 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 21/40] 10.222.0.27 () {60 vars in 1141 bytes} [Wed Aug 24 11:19:22 2022] POST /identity/v3/projects => generated 301 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:19:22.550697 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c89706-e2ab-419e-89ca-f846405c519d None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:22.551056 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c89706-e2ab-419e-89ca-f846405c519d None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:22.551339 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c89706-e2ab-419e-89ca-f846405c519d None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:22.552591 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 22/41] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:19:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:19:22.558675 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0cb0a4-6992-490a-832b-eecb5805e1e7 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:22.558972 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0cb0a4-6992-490a-832b-eecb5805e1e7 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:22.559238 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0cb0a4-6992-490a-832b-eecb5805e1e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:22.580500 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-7e0cb0a4-6992-490a-832b-eecb5805e1e7 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:19:22.582247 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-7e0cb0a4-6992-490a-832b-eecb5805e1e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:19:22.596700 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d8a2ad-7c25-4755-a962-2f417243b370 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:22.652755 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7680ac13-b136-434a-9c92-118e92450ebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:22.653353 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7680ac13-b136-434a-9c92-118e92450ebf None admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:22.653639 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7680ac13-b136-434a-9c92-118e92450ebf None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:22.653914 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7680ac13-b136-434a-9c92-118e92450ebf None admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:22.654753 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7680ac13-b136-434a-9c92-118e92450ebf None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:19:22.656211 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7680ac13-b136-434a-9c92-118e92450ebf None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:19:22.671586 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 23/42] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:19:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 11:19:22.689597 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 20/43] 10.222.0.27 () {60 vars in 1131 bytes} [Wed Aug 24 11:19:22 2022] POST /identity/v3/roles => generated 225 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:19:22.824815 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0cb0a4-6992-490a-832b-eecb5805e1e7 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:22.866458 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:22.938199 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0cb0a4-6992-490a-832b-eecb5805e1e7 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:22.955944 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7680ac13-b136-434a-9c92-118e92450ebf None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:22.965881 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:22.984153 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f4878c-0607-421f-b55f-e319ca91da40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:22.984789 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f4878c-0607-421f-b55f-e319ca91da40 None admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:22.985226 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f4878c-0607-421f-b55f-e319ca91da40 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:22.985507 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f4878c-0607-421f-b55f-e319ca91da40 None admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:22.986706 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f4878c-0607-421f-b55f-e319ca91da40 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:19:22.988453 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f4878c-0607-421f-b55f-e319ca91da40 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:19:23.011624 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 24/44] 10.222.0.27 () {60 vars in 1131 bytes} [Wed Aug 24 11:19:22 2022] POST /identity/v3/roles => generated 223 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:19:23.078070 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7680ac13-b136-434a-9c92-118e92450ebf None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:23.124166 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af37aeef-ad35-40a9-867c-11490ce055c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:23.124850 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af37aeef-ad35-40a9-867c-11490ce055c6 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:23.125114 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af37aeef-ad35-40a9-867c-11490ce055c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:23.125386 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af37aeef-ad35-40a9-867c-11490ce055c6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:23.126779 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af37aeef-ad35-40a9-867c-11490ce055c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:19:23.128357 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af37aeef-ad35-40a9-867c-11490ce055c6 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:19:23.130154 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 21/45] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 11:19:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:19:23.136063 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f4878c-0607-421f-b55f-e319ca91da40 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:23.239615 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:23.246309 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f4878c-0607-421f-b55f-e319ca91da40 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:23.279441 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e79c3f-07e6-43c3-9014-47da28f2d3ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:23.280061 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e79c3f-07e6-43c3-9014-47da28f2d3ed None admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:23.280343 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e79c3f-07e6-43c3-9014-47da28f2d3ed None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:23.280615 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e79c3f-07e6-43c3-9014-47da28f2d3ed None admin] PATH_INFO: `/v3/projects` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:23.281265 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e79c3f-07e6-43c3-9014-47da28f2d3ed None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:19:23.282810 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e79c3f-07e6-43c3-9014-47da28f2d3ed None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:19:23.310424 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 25/46] 10.222.0.27 () {60 vars in 1141 bytes} [Wed Aug 24 11:19:23 2022] POST /identity/v3/projects => generated 312 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:19:24.371818 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8923963f-e1a1-4c58-a724-00ad3563d3e4 None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:24.372347 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8923963f-e1a1-4c58-a724-00ad3563d3e4 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:24.372347 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8923963f-e1a1-4c58-a724-00ad3563d3e4 None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:24.373622 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 22/47] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:19:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:19:24.379204 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a182d84-2067-494b-87ff-c62b613f2676 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:24.379625 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a182d84-2067-494b-87ff-c62b613f2676 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:24.379737 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a182d84-2067-494b-87ff-c62b613f2676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:24.509741 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-3a182d84-2067-494b-87ff-c62b613f2676 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:19:24.511006 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-3a182d84-2067-494b-87ff-c62b613f2676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:19:24.579556 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 26/48] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:19:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 11:19:24.840852 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8923963f-e1a1-4c58-a724-00ad3563d3e4 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:25.033335 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:25.062399 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8923963f-e1a1-4c58-a724-00ad3563d3e4 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:25.098498 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6857c5da-4560-47bb-8236-29e95a29de76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:25.101465 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6857c5da-4560-47bb-8236-29e95a29de76 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:25.101465 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6857c5da-4560-47bb-8236-29e95a29de76 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:25.101465 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6857c5da-4560-47bb-8236-29e95a29de76 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:25.112224 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6857c5da-4560-47bb-8236-29e95a29de76 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:19:25.117110 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-6857c5da-4560-47bb-8236-29e95a29de76 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 11:19:25.117110 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:19:25.117110 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:19:25.117110 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:19:25.117110 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:19:25.117110 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:19:25.117110 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:19:25.117110 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:19:25.117110 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:19:25.117110 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:19:25.117110 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:19:25.117110 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:19:25.117110 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:19:25.117110 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:19:25.117110 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:19:25.117110 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:19:25.117971 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:19:25.117971 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:19:25.117971 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:19:25.117971 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:19:25.117971 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:19:25.117971 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:19:25.117971 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:19:25.117971 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:19:25.117971 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:19:25.117971 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:19:25.117971 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:19:25.117971 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Aug 24 11:19:25.117971 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:19:25.117971 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:19:25.117971 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:19:25.117971 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:19:25.118868 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:19:25.118868 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:19:25.118868 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:19:25.118868 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:19:25.118868 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:19:25.118868 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:19:25.118868 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:19:25.118868 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:19:25.118868 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:19:25.118868 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:19:25.118868 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 11:19:25.118868 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Aug 24 11:19:25.118868 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 23/49] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Aug 24 11:19:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:19:25.124393 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a182d84-2067-494b-87ff-c62b613f2676 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:25.207732 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:25.221896 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eb35bc-3187-45a2-930c-537969bcdc98 None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:25.222154 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eb35bc-3187-45a2-930c-537969bcdc98 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:25.222807 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eb35bc-3187-45a2-930c-537969bcdc98 None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:25.224362 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 24/50] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:19:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:19:25.230225 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f4d938-3bb6-4713-8a6c-09b4f8e08443 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:25.230533 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f4d938-3bb6-4713-8a6c-09b4f8e08443 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:25.230807 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f4d938-3bb6-4713-8a6c-09b4f8e08443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:25.232240 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a182d84-2067-494b-87ff-c62b613f2676 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:25.249593 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-01f4d938-3bb6-4713-8a6c-09b4f8e08443 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:19:25.250952 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-01f4d938-3bb6-4713-8a6c-09b4f8e08443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:19:25.267990 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b483f962-8d3b-4d40-a6d5-05bb9b36c02b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:25.268615 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b483f962-8d3b-4d40-a6d5-05bb9b36c02b None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:25.268943 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b483f962-8d3b-4d40-a6d5-05bb9b36c02b None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:25.269218 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b483f962-8d3b-4d40-a6d5-05bb9b36c02b None admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:25.269920 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b483f962-8d3b-4d40-a6d5-05bb9b36c02b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:19:25.270230 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b483f962-8d3b-4d40-a6d5-05bb9b36c02b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:19:25.271670 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b483f962-8d3b-4d40-a6d5-05bb9b36c02b None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:19:25.285124 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 27/51] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 24 11:19:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:19:25.286157 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b483f962-8d3b-4d40-a6d5-05bb9b36c02b None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:25.317358 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 25/52] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:19:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 11:19:25.385459 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b483f962-8d3b-4d40-a6d5-05bb9b36c02b None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:25.420913 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37241657-cf29-42c5-b759-22ae9152f666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:25.421550 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37241657-cf29-42c5-b759-22ae9152f666 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:25.421825 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37241657-cf29-42c5-b759-22ae9152f666 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:25.422132 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37241657-cf29-42c5-b759-22ae9152f666 None admin] PATH_INFO: `/v3/users/1e2e9ab325dc4dbf92dd6b59db4a0945` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:25.423378 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37241657-cf29-42c5-b759-22ae9152f666 None admin] RBAC: Authorizing `identity:get_user(user_id=1e2e9ab325dc4dbf92dd6b59db4a0945)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:19:25.424853 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37241657-cf29-42c5-b759-22ae9152f666 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:19:25.426556 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 28/53] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Aug 24 11:19:25 2022] GET /identity/v3/users/1e2e9ab325dc4dbf92dd6b59db4a0945 => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:19:25.432637 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f4d938-3bb6-4713-8a6c-09b4f8e08443 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:25.498985 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:25.540013 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f4d938-3bb6-4713-8a6c-09b4f8e08443 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:25.574992 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd96f89-25d0-416a-85f1-1c2b0aeee7c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:25.575603 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd96f89-25d0-416a-85f1-1c2b0aeee7c5 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:25.575878 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd96f89-25d0-416a-85f1-1c2b0aeee7c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:25.576148 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd96f89-25d0-416a-85f1-1c2b0aeee7c5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:25.577279 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd96f89-25d0-416a-85f1-1c2b0aeee7c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:19:25.578861 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd96f89-25d0-416a-85f1-1c2b0aeee7c5 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:19:25.579070 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37241657-cf29-42c5-b759-22ae9152f666 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:25.580457 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 26/54] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 11:19:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:19:25.586124 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd96f89-25d0-416a-85f1-1c2b0aeee7c5 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:25.592055 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:25.683332 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37241657-cf29-42c5-b759-22ae9152f666 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:25.684438 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd96f89-25d0-416a-85f1-1c2b0aeee7c5 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:25.712696 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:25.717825 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99976be-13eb-43f2-8f2f-177bced2e75d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:25.718074 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c529e9-bd98-419f-a0dd-fd4d7fce0e9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:25.718498 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99976be-13eb-43f2-8f2f-177bced2e75d None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:25.718710 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c529e9-bd98-419f-a0dd-fd4d7fce0e9c None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:25.718812 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99976be-13eb-43f2-8f2f-177bced2e75d None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:25.718982 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c529e9-bd98-419f-a0dd-fd4d7fce0e9c None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:25.719081 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99976be-13eb-43f2-8f2f-177bced2e75d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:25.719255 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c529e9-bd98-419f-a0dd-fd4d7fce0e9c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:25.719979 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c529e9-bd98-419f-a0dd-fd4d7fce0e9c None admin] RBAC: Adding query filter params (role.id=30bb1e97257f4ca5b90c88545777317b, scope.domain.id=default, user.id=1e2e9ab325dc4dbf92dd6b59db4a0945) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:19:25.720163 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99976be-13eb-43f2-8f2f-177bced2e75d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:19:25.720286 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c529e9-bd98-419f-a0dd-fd4d7fce0e9c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:19:25.721656 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99976be-13eb-43f2-8f2f-177bced2e75d None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:19:25.721756 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c529e9-bd98-419f-a0dd-fd4d7fce0e9c None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:19:25.723394 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 29/55] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 11:19:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:19:25.729035 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99976be-13eb-43f2-8f2f-177bced2e75d None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:25.730070 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 27/56] 10.222.0.27 () {56 vars in 1322 bytes} [Wed Aug 24 11:19:25 2022] GET /identity/v3/role_assignments?user.id=1e2e9ab325dc4dbf92dd6b59db4a0945&scope.domain.id=default&role.id=30bb1e97257f4ca5b90c88545777317b => generated 530 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:19:25.822226 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:25.847619 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99976be-13eb-43f2-8f2f-177bced2e75d None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:25.882955 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d26df24-545d-4575-b590-20abe13d9de1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:25.883570 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d26df24-545d-4575-b590-20abe13d9de1 None admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:25.883835 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d26df24-545d-4575-b590-20abe13d9de1 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:25.884109 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d26df24-545d-4575-b590-20abe13d9de1 None admin] PATH_INFO: `/v3/projects` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:25.884764 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d26df24-545d-4575-b590-20abe13d9de1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:19:25.886237 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d26df24-545d-4575-b590-20abe13d9de1 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:19:25.915920 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 30/57] 10.222.0.27 () {60 vars in 1140 bytes} [Wed Aug 24 11:19:25 2022] POST /identity/v3/projects => generated 298 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 11:19:27.807058 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293e1817-9260-41bd-813a-c544ae31d8b7 None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:27.807655 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293e1817-9260-41bd-813a-c544ae31d8b7 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:27.807655 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293e1817-9260-41bd-813a-c544ae31d8b7 None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:27.808957 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 28/58] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:19:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:19:27.815491 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6289e4-5304-4f87-8182-aab606ad2e40 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:27.816198 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6289e4-5304-4f87-8182-aab606ad2e40 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:27.816282 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6289e4-5304-4f87-8182-aab606ad2e40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:27.852674 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-db6289e4-5304-4f87-8182-aab606ad2e40 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:19:27.854069 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-db6289e4-5304-4f87-8182-aab606ad2e40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:19:27.933442 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 31/59] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:19:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 11:19:28.197808 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293e1817-9260-41bd-813a-c544ae31d8b7 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:28.311031 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293e1817-9260-41bd-813a-c544ae31d8b7 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:28.346167 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a235ee0-7588-4cb1-9587-4220e0d0b8fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:28.346819 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a235ee0-7588-4cb1-9587-4220e0d0b8fa None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:28.347120 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a235ee0-7588-4cb1-9587-4220e0d0b8fa None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:28.347394 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a235ee0-7588-4cb1-9587-4220e0d0b8fa None admin] PATH_INFO: `/v3/domains/default` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:28.348648 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a235ee0-7588-4cb1-9587-4220e0d0b8fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:19:28.350138 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a235ee0-7588-4cb1-9587-4220e0d0b8fa None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:19:28.351713 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 29/60] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 11:19:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:19:28.357615 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6289e4-5304-4f87-8182-aab606ad2e40 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:28.418828 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:28.460631 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6289e4-5304-4f87-8182-aab606ad2e40 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:28.496230 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaaea4d-1b5f-4466-b20e-1d6ef992a261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:28.496855 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaaea4d-1b5f-4466-b20e-1d6ef992a261 None admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:28.497132 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaaea4d-1b5f-4466-b20e-1d6ef992a261 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:28.497403 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaaea4d-1b5f-4466-b20e-1d6ef992a261 None admin] PATH_INFO: `/v3/users` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:28.498058 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaaea4d-1b5f-4466-b20e-1d6ef992a261 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:19:28.499557 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaaea4d-1b5f-4466-b20e-1d6ef992a261 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:19:28.530193 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 32/61] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Aug 24 11:19:28 2022] POST /identity/v3/users => generated 275 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:19:31.556436 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a661b6-6a5f-4c9b-9211-080e0e73ae5a None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:31.557497 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a661b6-6a5f-4c9b-9211-080e0e73ae5a None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:31.557989 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a661b6-6a5f-4c9b-9211-080e0e73ae5a None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:31.559641 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 30/62] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:19:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:19:31.565217 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3bbbc0-eb5b-44af-8f2b-205751412dd1 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:31.566124 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3bbbc0-eb5b-44af-8f2b-205751412dd1 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:31.566656 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3bbbc0-eb5b-44af-8f2b-205751412dd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:31.595445 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-2b3bbbc0-eb5b-44af-8f2b-205751412dd1 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:19:31.597262 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-2b3bbbc0-eb5b-44af-8f2b-205751412dd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:19:31.663940 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bb37e1-350e-4109-bafc-1d9012c7e388 None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:31.664229 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bb37e1-350e-4109-bafc-1d9012c7e388 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:31.664905 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bb37e1-350e-4109-bafc-1d9012c7e388 None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:31.666449 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 31/63] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:19:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:19:31.678369 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7a83f5-14d8-4ac9-b09d-c9797b2076fe None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:31.678942 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7a83f5-14d8-4ac9-b09d-c9797b2076fe None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:31.679579 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7a83f5-14d8-4ac9-b09d-c9797b2076fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:31.696984 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 33/64] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:19:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 11:19:31.698685 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9edae85-d257-4e3c-ac43-0600a7fa547b None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:31.699108 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9edae85-d257-4e3c-ac43-0600a7fa547b None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:31.699575 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9edae85-d257-4e3c-ac43-0600a7fa547b None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:31.700945 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 34/65] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:19:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:19:31.704891 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-dc7a83f5-14d8-4ac9-b09d-c9797b2076fe None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:19:31.704891 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-dc7a83f5-14d8-4ac9-b09d-c9797b2076fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:19:31.706618 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95583365-f032-4dbd-9b90-8d87e8358786 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:31.706977 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95583365-f032-4dbd-9b90-8d87e8358786 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:31.707254 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95583365-f032-4dbd-9b90-8d87e8358786 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:31.725837 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-95583365-f032-4dbd-9b90-8d87e8358786 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:19:31.727361 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-95583365-f032-4dbd-9b90-8d87e8358786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:19:31.773476 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:31.783659 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:31.796975 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 32/66] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:19:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 11:19:31.834822 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 35/67] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:19:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 11:19:32.126304 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7a83f5-14d8-4ac9-b09d-c9797b2076fe None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:32.144692 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95583365-f032-4dbd-9b90-8d87e8358786 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:32.244265 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7a83f5-14d8-4ac9-b09d-c9797b2076fe None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:32.261171 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95583365-f032-4dbd-9b90-8d87e8358786 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:32.285184 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a762815-9801-4d4b-8188-174f404e82fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:32.285826 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a762815-9801-4d4b-8188-174f404e82fd None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:32.286104 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a762815-9801-4d4b-8188-174f404e82fd None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:32.286395 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a762815-9801-4d4b-8188-174f404e82fd None admin] PATH_INFO: `/v3/roles/member` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:32.296809 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a762815-9801-4d4b-8188-174f404e82fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:19:32.297852 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95509024-b075-4fbc-bfb4-1c7056f6a732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:32.298523 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95509024-b075-4fbc-bfb4-1c7056f6a732 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:32.298806 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95509024-b075-4fbc-bfb4-1c7056f6a732 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:32.299083 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95509024-b075-4fbc-bfb4-1c7056f6a732 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:32.301533 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-9a762815-9801-4d4b-8188-174f404e82fd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 11:19:32.301533 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:19:32.301533 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:19:32.301533 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:19:32.301533 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:19:32.301533 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:19:32.301533 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:19:32.301533 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:19:32.301533 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:19:32.301533 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:19:32.301533 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:19:32.301533 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:19:32.301533 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:19:32.301533 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:19:32.301533 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:19:32.301533 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:19:32.302626 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:19:32.302626 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:19:32.302626 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:19:32.302626 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:19:32.302626 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:19:32.302626 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:19:32.302626 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:19:32.302626 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:19:32.302626 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:19:32.302626 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:19:32.302626 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:19:32.302626 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Aug 24 11:19:32.302626 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:19:32.302626 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:19:32.302626 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:19:32.302626 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:19:32.303424 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:19:32.303424 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:19:32.303424 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:19:32.303424 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:19:32.303424 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:19:32.303424 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:19:32.303424 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:19:32.303424 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:19:32.303424 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:19:32.303424 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:19:32.303424 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 11:19:32.303424 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Aug 24 11:19:32.303424 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 33/68] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 24 11:19:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:19:32.304708 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb7829a-f70d-44b7-ab9a-c07c03fa2de3 None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:32.304988 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb7829a-f70d-44b7-ab9a-c07c03fa2de3 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:32.305259 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb7829a-f70d-44b7-ab9a-c07c03fa2de3 None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:32.306553 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 34/69] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:19:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:19:32.307536 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9dd025-55a8-4c7b-a379-171156b8e949 None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:32.307812 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9dd025-55a8-4c7b-a379-171156b8e949 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:32.308081 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9dd025-55a8-4c7b-a379-171156b8e949 None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:32.309276 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 35/70] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:19:32 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:19:32.309939 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9dd025-55a8-4c7b-a379-171156b8e949 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:32.318489 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95509024-b075-4fbc-bfb4-1c7056f6a732 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:19:32.323419 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-95509024-b075-4fbc-bfb4-1c7056f6a732 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 11:19:32.323419 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:19:32.323419 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:19:32.323419 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:19:32.323419 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:19:32.323419 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:19:32.323419 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:19:32.323419 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:19:32.323419 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:19:32.323419 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:19:32.323419 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:19:32.323419 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:19:32.323419 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:19:32.323419 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:19:32.323419 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:19:32.323419 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:19:32.324318 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:19:32.324318 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:19:32.324318 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:19:32.324318 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:19:32.324318 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:19:32.324318 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:19:32.324318 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:19:32.324318 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:19:32.324318 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:19:32.324318 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:19:32.324318 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:19:32.324318 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Aug 24 11:19:32.324318 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:19:32.324318 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:19:32.324318 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:19:32.324318 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:19:32.325071 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:19:32.325071 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:19:32.325071 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:19:32.325071 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:19:32.325071 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:19:32.325071 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:19:32.325071 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:19:32.325071 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:19:32.325071 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:19:32.325071 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:19:32.325071 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 11:19:32.325071 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:19:32.325071 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 36/71] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Aug 24 11:19:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:19:32.326562 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3334ed-a88d-4b32-b2d0-b4fa6ab6516d None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:32.326666 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3334ed-a88d-4b32-b2d0-b4fa6ab6516d None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:32.326947 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3334ed-a88d-4b32-b2d0-b4fa6ab6516d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:32.345652 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-ec3334ed-a88d-4b32-b2d0-b4fa6ab6516d None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:19:32.347208 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-ec3334ed-a88d-4b32-b2d0-b4fa6ab6516d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:19:32.371704 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:32.382758 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:32.417344 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9dd025-55a8-4c7b-a379-171156b8e949 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:32.423760 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 37/72] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:19:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 11:19:32.424393 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3334ed-a88d-4b32-b2d0-b4fa6ab6516d None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:32.452266 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44b3f46-92e8-4b2f-845d-eea4efffc42e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:32.452905 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44b3f46-92e8-4b2f-845d-eea4efffc42e None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:32.453183 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44b3f46-92e8-4b2f-845d-eea4efffc42e None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:32.453440 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44b3f46-92e8-4b2f-845d-eea4efffc42e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:32.464523 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44b3f46-92e8-4b2f-845d-eea4efffc42e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:19:32.469259 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-a44b3f46-92e8-4b2f-845d-eea4efffc42e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 11:19:32.469259 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:19:32.469259 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:19:32.469259 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:19:32.469259 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:19:32.469259 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:19:32.469259 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:19:32.469259 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:19:32.469259 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:19:32.469259 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:19:32.469259 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:19:32.469259 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:19:32.469259 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:19:32.469259 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:19:32.469259 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:19:32.469259 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:19:32.470104 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:19:32.470104 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:19:32.470104 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:19:32.470104 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:19:32.470104 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:19:32.470104 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:19:32.470104 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:19:32.470104 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:19:32.470104 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:19:32.470104 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:19:32.470104 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:19:32.470104 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Aug 24 11:19:32.470104 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:19:32.470104 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:19:32.470104 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:19:32.470104 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:19:32.472343 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:19:32.472343 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:19:32.472343 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:19:32.472343 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:19:32.472343 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:19:32.472343 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:19:32.472343 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:19:32.472343 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:19:32.472343 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:19:32.472343 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:19:32.472343 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 11:19:32.472343 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Aug 24 11:19:32.472343 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 36/73] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Aug 24 11:19:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:19:32.472343 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd711c63-5a86-4493-bf77-79adf1fdc218 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:32.473068 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd711c63-5a86-4493-bf77-79adf1fdc218 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:32.473068 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd711c63-5a86-4493-bf77-79adf1fdc218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:32.490059 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-dd711c63-5a86-4493-bf77-79adf1fdc218 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:19:32.491325 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-dd711c63-5a86-4493-bf77-79adf1fdc218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:19:32.543827 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3334ed-a88d-4b32-b2d0-b4fa6ab6516d None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:32.562541 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 37/74] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:19:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 11:19:32.563984 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd711c63-5a86-4493-bf77-79adf1fdc218 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:32.599047 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edafd075-57b3-48ad-885a-862c0ce44921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:32.600398 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edafd075-57b3-48ad-885a-862c0ce44921 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:32.600875 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edafd075-57b3-48ad-885a-862c0ce44921 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:32.601425 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edafd075-57b3-48ad-885a-862c0ce44921 None admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:32.602412 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edafd075-57b3-48ad-885a-862c0ce44921 None admin] RBAC: Adding query filter params (name=member) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:19:32.602931 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edafd075-57b3-48ad-885a-862c0ce44921 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:19:32.605052 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edafd075-57b3-48ad-885a-862c0ce44921 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:19:32.615931 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 38/75] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Aug 24 11:19:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:19:32.621767 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edafd075-57b3-48ad-885a-862c0ce44921 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:32.624704 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:32.661655 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:32.696052 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd711c63-5a86-4493-bf77-79adf1fdc218 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:32.730622 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9371a656-abc9-4c1d-9620-32c1c55e751d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:32.731255 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9371a656-abc9-4c1d-9620-32c1c55e751d None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:32.731534 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9371a656-abc9-4c1d-9620-32c1c55e751d None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:32.731805 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9371a656-abc9-4c1d-9620-32c1c55e751d None admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:32.732489 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9371a656-abc9-4c1d-9620-32c1c55e751d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:19:32.732788 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9371a656-abc9-4c1d-9620-32c1c55e751d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:19:32.734226 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9371a656-abc9-4c1d-9620-32c1c55e751d None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:19:32.740960 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edafd075-57b3-48ad-885a-862c0ce44921 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:32.742454 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 38/76] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Aug 24 11:19:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:19:32.743278 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9371a656-abc9-4c1d-9620-32c1c55e751d None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:32.783718 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979bd682-f67b-4a85-a38e-5522732f73a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:32.784341 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979bd682-f67b-4a85-a38e-5522732f73a4 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:32.784654 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979bd682-f67b-4a85-a38e-5522732f73a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:32.784928 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979bd682-f67b-4a85-a38e-5522732f73a4 None admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:32.785605 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979bd682-f67b-4a85-a38e-5522732f73a4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:19:32.785911 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979bd682-f67b-4a85-a38e-5522732f73a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:19:32.787366 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979bd682-f67b-4a85-a38e-5522732f73a4 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:19:32.800535 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 39/77] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 24 11:19:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:19:32.800535 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979bd682-f67b-4a85-a38e-5522732f73a4 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:32.852804 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9371a656-abc9-4c1d-9620-32c1c55e751d None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:32.859739 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:32.886111 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:32.887770 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82a6b4c-d997-458a-b508-3288eb440525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:32.888599 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82a6b4c-d997-458a-b508-3288eb440525 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:32.888854 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82a6b4c-d997-458a-b508-3288eb440525 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:32.889083 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82a6b4c-d997-458a-b508-3288eb440525 None admin] PATH_INFO: `/v3/users/46203446b8ea4ef7b7610bda424e8775` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:32.898010 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979bd682-f67b-4a85-a38e-5522732f73a4 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:32.905776 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82a6b4c-d997-458a-b508-3288eb440525 None admin] RBAC: Authorizing `identity:get_user(user_id=46203446b8ea4ef7b7610bda424e8775)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:19:32.907331 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82a6b4c-d997-458a-b508-3288eb440525 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:19:32.909033 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 39/78] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Aug 24 11:19:32 2022] GET /identity/v3/users/46203446b8ea4ef7b7610bda424e8775 => generated 275 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:19:32.913937 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82a6b4c-d997-458a-b508-3288eb440525 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:32.931836 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4ca311-8989-4f6f-a3ae-1cc32155015e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:32.932504 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4ca311-8989-4f6f-a3ae-1cc32155015e None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:32.932786 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4ca311-8989-4f6f-a3ae-1cc32155015e None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:32.933059 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4ca311-8989-4f6f-a3ae-1cc32155015e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:32.943392 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4ca311-8989-4f6f-a3ae-1cc32155015e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:19:32.948715 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-5d4ca311-8989-4f6f-a3ae-1cc32155015e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 11:19:32.948715 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:19:32.948715 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:19:32.948715 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:19:32.948715 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:19:32.948715 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:19:32.948715 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:19:32.948715 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:19:32.948715 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:19:32.948715 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:19:32.948715 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:19:32.948715 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:19:32.948715 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:19:32.948715 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:19:32.948715 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:19:32.948715 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:19:32.949567 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:19:32.949567 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:19:32.949567 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:19:32.949567 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:19:32.949567 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:19:32.949567 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:19:32.949567 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:19:32.949567 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:19:32.949567 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:19:32.949567 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:19:32.949567 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:19:32.949567 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Aug 24 11:19:32.949567 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:19:32.949567 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:19:32.949567 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:19:32.949567 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:19:32.950678 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:19:32.950678 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:19:32.950678 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:19:32.950678 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:19:32.950678 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:19:32.950678 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:19:32.950678 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:19:32.950678 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:19:32.950678 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:19:32.950678 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:19:32.950678 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 11:19:32.950678 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:19:32.950678 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 40/79] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 24 11:19:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:19:32.950678 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4ca311-8989-4f6f-a3ae-1cc32155015e None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:33.013207 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82a6b4c-d997-458a-b508-3288eb440525 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:33.046190 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593f64f2-82d1-4c5b-8adb-9253b72675f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:33.046861 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593f64f2-82d1-4c5b-8adb-9253b72675f8 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:33.047147 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593f64f2-82d1-4c5b-8adb-9253b72675f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:33.047416 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593f64f2-82d1-4c5b-8adb-9253b72675f8 None admin] PATH_INFO: `/v3/users/46203446b8ea4ef7b7610bda424e8775` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:33.048564 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593f64f2-82d1-4c5b-8adb-9253b72675f8 None admin] RBAC: Authorizing `identity:get_user(user_id=46203446b8ea4ef7b7610bda424e8775)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:19:33.049178 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4ca311-8989-4f6f-a3ae-1cc32155015e None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:33.050043 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593f64f2-82d1-4c5b-8adb-9253b72675f8 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:19:33.051723 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 40/80] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Aug 24 11:19:32 2022] GET /identity/v3/users/46203446b8ea4ef7b7610bda424e8775 => generated 275 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:19:33.052483 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593f64f2-82d1-4c5b-8adb-9253b72675f8 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:33.083072 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:33.084247 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9d9d1c-a663-4ac6-9b3d-f0d64bd1ec01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:33.084892 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9d9d1c-a663-4ac6-9b3d-f0d64bd1ec01 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:33.085173 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9d9d1c-a663-4ac6-9b3d-f0d64bd1ec01 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:33.085457 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9d9d1c-a663-4ac6-9b3d-f0d64bd1ec01 None admin] PATH_INFO: `/v3/users/1e2e9ab325dc4dbf92dd6b59db4a0945` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:33.086670 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9d9d1c-a663-4ac6-9b3d-f0d64bd1ec01 None admin] RBAC: Authorizing `identity:get_user(user_id=1e2e9ab325dc4dbf92dd6b59db4a0945)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:19:33.088234 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9d9d1c-a663-4ac6-9b3d-f0d64bd1ec01 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:19:33.089858 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 41/81] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Aug 24 11:19:32 2022] GET /identity/v3/users/1e2e9ab325dc4dbf92dd6b59db4a0945 => generated 247 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:19:33.090723 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9d9d1c-a663-4ac6-9b3d-f0d64bd1ec01 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:33.110687 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:33.154511 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593f64f2-82d1-4c5b-8adb-9253b72675f8 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:33.188009 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678b974f-59cc-4b91-adb2-f013ed82b972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:33.188638 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678b974f-59cc-4b91-adb2-f013ed82b972 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:33.188915 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678b974f-59cc-4b91-adb2-f013ed82b972 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:33.189183 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678b974f-59cc-4b91-adb2-f013ed82b972 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:33.190334 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678b974f-59cc-4b91-adb2-f013ed82b972 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:19:33.191930 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678b974f-59cc-4b91-adb2-f013ed82b972 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:19:33.192840 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9d9d1c-a663-4ac6-9b3d-f0d64bd1ec01 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:33.193498 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 41/82] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 11:19:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:19:33.194331 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678b974f-59cc-4b91-adb2-f013ed82b972 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:33.229183 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7bcbfa-e65f-42f4-8001-2be42f22e2a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:33.229806 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7bcbfa-e65f-42f4-8001-2be42f22e2a3 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:33.230089 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7bcbfa-e65f-42f4-8001-2be42f22e2a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:33.230396 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7bcbfa-e65f-42f4-8001-2be42f22e2a3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:33.294878 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:33.296852 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7bcbfa-e65f-42f4-8001-2be42f22e2a3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:19:33.297871 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678b974f-59cc-4b91-adb2-f013ed82b972 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:33.298393 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7bcbfa-e65f-42f4-8001-2be42f22e2a3 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:19:33.315357 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:33.332160 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4809a8f3-81d7-4148-a2f4-f2e734d538ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:33.332812 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4809a8f3-81d7-4148-a2f4-f2e734d538ed None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:33.333093 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4809a8f3-81d7-4148-a2f4-f2e734d538ed None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:33.333369 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4809a8f3-81d7-4148-a2f4-f2e734d538ed None admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:33.334045 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4809a8f3-81d7-4148-a2f4-f2e734d538ed None admin] RBAC: Adding query filter params (name=member) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:19:33.334372 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4809a8f3-81d7-4148-a2f4-f2e734d538ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:19:33.335819 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4809a8f3-81d7-4148-a2f4-f2e734d538ed None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:19:33.343927 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 42/83] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Aug 24 11:19:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:19:33.344751 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4809a8f3-81d7-4148-a2f4-f2e734d538ed None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:33.396899 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 42/84] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 24 11:19:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 11:19:33.397854 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7bcbfa-e65f-42f4-8001-2be42f22e2a3 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:33.445513 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4809a8f3-81d7-4148-a2f4-f2e734d538ed None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:33.478628 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f7cb93-bad0-4c19-a29e-f3b98ffa1a7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:33.479263 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f7cb93-bad0-4c19-a29e-f3b98ffa1a7b None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:33.479528 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f7cb93-bad0-4c19-a29e-f3b98ffa1a7b None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:33.479815 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f7cb93-bad0-4c19-a29e-f3b98ffa1a7b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:33.494892 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7bcbfa-e65f-42f4-8001-2be42f22e2a3 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:33.509480 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:33.511100 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:33.528781 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef19cfa-9915-4376-b8ce-debaa9174b1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:33.529391 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef19cfa-9915-4376-b8ce-debaa9174b1f None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:33.529668 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef19cfa-9915-4376-b8ce-debaa9174b1f None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:33.529941 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef19cfa-9915-4376-b8ce-debaa9174b1f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:33.547337 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f7cb93-bad0-4c19-a29e-f3b98ffa1a7b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:19:33.548832 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f7cb93-bad0-4c19-a29e-f3b98ffa1a7b None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:19:33.595804 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef19cfa-9915-4376-b8ce-debaa9174b1f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:19:33.597328 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef19cfa-9915-4376-b8ce-debaa9174b1f None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:19:33.646155 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 43/85] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 24 11:19:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 11:19:33.646996 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f7cb93-bad0-4c19-a29e-f3b98ffa1a7b None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:33.693651 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 43/86] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 24 11:19:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 11:19:33.694559 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef19cfa-9915-4376-b8ce-debaa9174b1f None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:33.709248 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:33.713930 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:33.749928 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f7cb93-bad0-4c19-a29e-f3b98ffa1a7b None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:33.783067 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee88b90e-ad98-47e1-8270-6e6de37c4b06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:33.783679 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee88b90e-ad98-47e1-8270-6e6de37c4b06 None admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:33.783961 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee88b90e-ad98-47e1-8270-6e6de37c4b06 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:33.784231 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee88b90e-ad98-47e1-8270-6e6de37c4b06 None admin] PATH_INFO: `/v3/users` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:33.784990 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee88b90e-ad98-47e1-8270-6e6de37c4b06 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:19:33.786506 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee88b90e-ad98-47e1-8270-6e6de37c4b06 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:19:33.794342 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef19cfa-9915-4376-b8ce-debaa9174b1f None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:33.814337 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 44/87] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Aug 24 11:19:33 2022] POST /identity/v3/users => generated 289 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:19:33.815202 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee88b90e-ad98-47e1-8270-6e6de37c4b06 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:33.830479 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f998b4f1-ad20-4048-a665-0423d2d1dbea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:33.831139 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f998b4f1-ad20-4048-a665-0423d2d1dbea None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:33.831465 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f998b4f1-ad20-4048-a665-0423d2d1dbea None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:33.831736 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f998b4f1-ad20-4048-a665-0423d2d1dbea None admin] PATH_INFO: `/v3/users/46203446b8ea4ef7b7610bda424e8775` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:33.833019 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f998b4f1-ad20-4048-a665-0423d2d1dbea None admin] RBAC: Authorizing `identity:get_user(user_id=46203446b8ea4ef7b7610bda424e8775)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:19:33.834605 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f998b4f1-ad20-4048-a665-0423d2d1dbea None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:19:33.841543 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 44/88] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Aug 24 11:19:33 2022] GET /identity/v3/users/46203446b8ea4ef7b7610bda424e8775 => generated 275 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:19:33.841543 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f998b4f1-ad20-4048-a665-0423d2d1dbea None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:33.945947 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee88b90e-ad98-47e1-8270-6e6de37c4b06 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:33.946721 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:33.966286 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:33.969004 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f998b4f1-ad20-4048-a665-0423d2d1dbea None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:33.989404 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5659cab9-0bdb-4681-90fb-a24c42773c83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:33.990342 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5659cab9-0bdb-4681-90fb-a24c42773c83 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:33.990654 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5659cab9-0bdb-4681-90fb-a24c42773c83 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:33.990926 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5659cab9-0bdb-4681-90fb-a24c42773c83 None admin] PATH_INFO: `/v3/projects/71e3821279484b7087ded02a637ad206` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:33.992105 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5659cab9-0bdb-4681-90fb-a24c42773c83 None admin] RBAC: Authorizing `identity:get_project(project_id=71e3821279484b7087ded02a637ad206)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:19:33.994409 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5659cab9-0bdb-4681-90fb-a24c42773c83 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:19:33.995310 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 45/89] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Aug 24 11:19:33 2022] GET /identity/v3/projects/71e3821279484b7087ded02a637ad206 => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:19:33.996080 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5659cab9-0bdb-4681-90fb-a24c42773c83 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:34.012827 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112325dd-d1f1-40de-bb63-f6ef5a41f6ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:34.013510 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112325dd-d1f1-40de-bb63-f6ef5a41f6ca None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:34.013795 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112325dd-d1f1-40de-bb63-f6ef5a41f6ca None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:34.014073 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112325dd-d1f1-40de-bb63-f6ef5a41f6ca None admin] PATH_INFO: `/v3/projects/71e3821279484b7087ded02a637ad206` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:34.015761 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112325dd-d1f1-40de-bb63-f6ef5a41f6ca None admin] RBAC: Authorizing `identity:get_project(project_id=71e3821279484b7087ded02a637ad206)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:19:34.017308 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112325dd-d1f1-40de-bb63-f6ef5a41f6ca None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:19:34.019067 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 45/90] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Aug 24 11:19:33 2022] GET /identity/v3/projects/71e3821279484b7087ded02a637ad206 => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:19:34.019846 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112325dd-d1f1-40de-bb63-f6ef5a41f6ca None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:34.129710 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5659cab9-0bdb-4681-90fb-a24c42773c83 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:34.147480 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112325dd-d1f1-40de-bb63-f6ef5a41f6ca None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:34.176346 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2c36af-46eb-4932-9a75-5c423165ee56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:34.177571 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2c36af-46eb-4932-9a75-5c423165ee56 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:34.178265 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2c36af-46eb-4932-9a75-5c423165ee56 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:34.178768 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2c36af-46eb-4932-9a75-5c423165ee56 None admin] PATH_INFO: `/v3/projects/71e3821279484b7087ded02a637ad206` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:34.180604 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2c36af-46eb-4932-9a75-5c423165ee56 None admin] RBAC: Authorizing `identity:get_project(project_id=71e3821279484b7087ded02a637ad206)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:19:34.182733 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2c36af-46eb-4932-9a75-5c423165ee56 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:19:34.185447 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 46/91] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Aug 24 11:19:33 2022] GET /identity/v3/projects/71e3821279484b7087ded02a637ad206 => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:19:34.186599 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2c36af-46eb-4932-9a75-5c423165ee56 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:34.188928 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075c3c4a-402c-4367-9299-5c121c4b9603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:34.189662 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075c3c4a-402c-4367-9299-5c121c4b9603 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:34.190058 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075c3c4a-402c-4367-9299-5c121c4b9603 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:34.190527 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075c3c4a-402c-4367-9299-5c121c4b9603 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:34.217700 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:34.268238 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:34.274931 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075c3c4a-402c-4367-9299-5c121c4b9603 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:19:34.277968 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075c3c4a-402c-4367-9299-5c121c4b9603 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:19:34.327890 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2c36af-46eb-4932-9a75-5c423165ee56 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:34.373810 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8230ec18-949c-499e-ba49-dd7c14b14ae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:34.374920 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8230ec18-949c-499e-ba49-dd7c14b14ae3 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:34.375368 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8230ec18-949c-499e-ba49-dd7c14b14ae3 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:34.376006 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8230ec18-949c-499e-ba49-dd7c14b14ae3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:34.377286 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8230ec18-949c-499e-ba49-dd7c14b14ae3 None admin] RBAC: Adding query filter params (role.id=27e3e65e24df4b86b0d3d18d3212101d, scope.project.id=71e3821279484b7087ded02a637ad206, user.id=46203446b8ea4ef7b7610bda424e8775) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:19:34.377994 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8230ec18-949c-499e-ba49-dd7c14b14ae3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:19:34.380266 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8230ec18-949c-499e-ba49-dd7c14b14ae3 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:19:34.383447 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 46/92] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 24 11:19:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 11:19:34.384391 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075c3c4a-402c-4367-9299-5c121c4b9603 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:34.387074 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 47/93] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Aug 24 11:19:34 2022] GET /identity/v3/role_assignments?user.id=46203446b8ea4ef7b7610bda424e8775&scope.project.id=71e3821279484b7087ded02a637ad206&role.id=27e3e65e24df4b86b0d3d18d3212101d => generated 259 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:19:34.389024 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8230ec18-949c-499e-ba49-dd7c14b14ae3 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:34.460037 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:34.510017 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8230ec18-949c-499e-ba49-dd7c14b14ae3 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:34.526101 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075c3c4a-402c-4367-9299-5c121c4b9603 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:34.533333 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:34.558210 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684bc79c-942b-449c-8fd3-8d90af53de40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:34.559541 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684bc79c-942b-449c-8fd3-8d90af53de40 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:34.559965 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684bc79c-942b-449c-8fd3-8d90af53de40 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:34.560504 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684bc79c-942b-449c-8fd3-8d90af53de40 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:34.561383 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684bc79c-942b-449c-8fd3-8d90af53de40 None admin] RBAC: Adding query filter params (role.id=30bb1e97257f4ca5b90c88545777317b, scope.project.id=71e3821279484b7087ded02a637ad206, user.id=1e2e9ab325dc4dbf92dd6b59db4a0945) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:19:34.561819 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684bc79c-942b-449c-8fd3-8d90af53de40 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:19:34.563556 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684bc79c-942b-449c-8fd3-8d90af53de40 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:19:34.570558 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 48/94] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Aug 24 11:19:34 2022] GET /identity/v3/role_assignments?user.id=1e2e9ab325dc4dbf92dd6b59db4a0945&scope.project.id=71e3821279484b7087ded02a637ad206&role.id=30bb1e97257f4ca5b90c88545777317b => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:19:34.572299 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684bc79c-942b-449c-8fd3-8d90af53de40 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:34.579236 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae56cf8a-6a7b-4ec7-ab50-619347b0339b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:34.580096 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae56cf8a-6a7b-4ec7-ab50-619347b0339b None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:34.580478 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae56cf8a-6a7b-4ec7-ab50-619347b0339b None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:34.580851 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae56cf8a-6a7b-4ec7-ab50-619347b0339b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:34.581898 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae56cf8a-6a7b-4ec7-ab50-619347b0339b None admin] RBAC: Adding query filter params (role.id=96f07e9110194606acccfbd8467649a7, scope.project.id=71e3821279484b7087ded02a637ad206, user.id=46203446b8ea4ef7b7610bda424e8775) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:19:34.582371 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae56cf8a-6a7b-4ec7-ab50-619347b0339b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:19:34.584008 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae56cf8a-6a7b-4ec7-ab50-619347b0339b None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:19:34.601766 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 47/95] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Aug 24 11:19:34 2022] GET /identity/v3/role_assignments?user.id=46203446b8ea4ef7b7610bda424e8775&scope.project.id=71e3821279484b7087ded02a637ad206&role.id=96f07e9110194606acccfbd8467649a7 => generated 259 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:19:34.695360 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684bc79c-942b-449c-8fd3-8d90af53de40 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:34.736355 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2181b6-25dc-4732-a999-905893979e4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:34.737275 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2181b6-25dc-4732-a999-905893979e4b None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:34.737746 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2181b6-25dc-4732-a999-905893979e4b None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:34.738186 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2181b6-25dc-4732-a999-905893979e4b None admin] PATH_INFO: `/v3/projects/e41389802363424fa838e3fd74da8717` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:34.739577 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2181b6-25dc-4732-a999-905893979e4b None admin] RBAC: Authorizing `identity:get_project(project_id=e41389802363424fa838e3fd74da8717)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:19:34.741282 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2181b6-25dc-4732-a999-905893979e4b None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:19:34.743279 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 49/96] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Aug 24 11:19:34 2022] GET /identity/v3/projects/e41389802363424fa838e3fd74da8717 => generated 312 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:19:34.754565 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae56cf8a-6a7b-4ec7-ab50-619347b0339b None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:34.887721 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae56cf8a-6a7b-4ec7-ab50-619347b0339b None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:34.915609 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:34.935112 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6168798f-db20-4851-85bd-9763a5d8953e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:34.935976 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6168798f-db20-4851-85bd-9763a5d8953e None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:34.936396 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6168798f-db20-4851-85bd-9763a5d8953e None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:34.936835 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6168798f-db20-4851-85bd-9763a5d8953e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:34.937719 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6168798f-db20-4851-85bd-9763a5d8953e None admin] RBAC: Adding query filter params (role.id=27e3e65e24df4b86b0d3d18d3212101d, scope.project.id=e41389802363424fa838e3fd74da8717, user.id=46203446b8ea4ef7b7610bda424e8775) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:19:34.938165 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6168798f-db20-4851-85bd-9763a5d8953e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:19:34.939830 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6168798f-db20-4851-85bd-9763a5d8953e None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:19:34.946055 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 48/97] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Aug 24 11:19:34 2022] GET /identity/v3/role_assignments?user.id=46203446b8ea4ef7b7610bda424e8775&scope.project.id=e41389802363424fa838e3fd74da8717&role.id=27e3e65e24df4b86b0d3d18d3212101d => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:19:36.171222 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208ac0a1-3a7f-408a-9224-854e26b1b5ed None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:36.172204 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208ac0a1-3a7f-408a-9224-854e26b1b5ed None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:36.172672 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208ac0a1-3a7f-408a-9224-854e26b1b5ed None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:36.174348 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 50/98] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:19:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:19:36.180463 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9288f5-d532-4877-b560-ab012101a4d8 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:36.181340 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9288f5-d532-4877-b560-ab012101a4d8 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:36.181806 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9288f5-d532-4877-b560-ab012101a4d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:36.206882 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-4b9288f5-d532-4877-b560-ab012101a4d8 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:19:36.208561 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-4b9288f5-d532-4877-b560-ab012101a4d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:19:36.290212 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 49/99] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:19:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 11:19:36.738565 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208ac0a1-3a7f-408a-9224-854e26b1b5ed None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:36.807175 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:36.871118 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208ac0a1-3a7f-408a-9224-854e26b1b5ed None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:36.908733 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c115ab-798a-47e3-94b3-bffdc0937921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:36.909860 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c115ab-798a-47e3-94b3-bffdc0937921 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:36.910331 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c115ab-798a-47e3-94b3-bffdc0937921 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:36.910815 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c115ab-798a-47e3-94b3-bffdc0937921 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:36.921523 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c115ab-798a-47e3-94b3-bffdc0937921 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:19:36.926594 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-a1c115ab-798a-47e3-94b3-bffdc0937921 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 11:19:36.926594 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:19:36.926594 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:19:36.926594 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:19:36.926594 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:19:36.926594 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:19:36.926594 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:19:36.926594 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:19:36.926594 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:19:36.926594 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:19:36.926594 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:19:36.926594 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:19:36.926594 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:19:36.926594 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:19:36.926594 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:19:36.926594 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:19:36.927441 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:19:36.927441 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:19:36.927441 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:19:36.927441 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:19:36.927441 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:19:36.927441 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:19:36.927441 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:19:36.927441 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:19:36.927441 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:19:36.927441 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:19:36.927441 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:19:36.927441 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Aug 24 11:19:36.927441 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:19:36.927441 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:19:36.927441 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:19:36.927441 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:19:36.928228 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:19:36.928228 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:19:36.928228 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:19:36.928228 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:19:36.928228 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:19:36.928228 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:19:36.928228 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:19:36.928228 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:19:36.928228 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:19:36.928228 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:19:36.928228 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 11:19:36.928228 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Aug 24 11:19:36.930556 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 51/100] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 24 11:19:36 2022] GET /identity/v3/roles/reader => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:19:36.936435 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9288f5-d532-4877-b560-ab012101a4d8 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:37.055712 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9288f5-d532-4877-b560-ab012101a4d8 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:37.082738 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:37.104792 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7059254-a564-49ca-95d2-007f71182f1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:37.105433 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7059254-a564-49ca-95d2-007f71182f1f None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:37.105715 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7059254-a564-49ca-95d2-007f71182f1f None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:37.105984 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7059254-a564-49ca-95d2-007f71182f1f None admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:37.113471 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7059254-a564-49ca-95d2-007f71182f1f None admin] RBAC: Adding query filter params (name=reader) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:19:37.113471 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7059254-a564-49ca-95d2-007f71182f1f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:19:37.113471 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7059254-a564-49ca-95d2-007f71182f1f None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:19:37.121884 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 50/101] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Aug 24 11:19:36 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:19:37.127722 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c115ab-798a-47e3-94b3-bffdc0937921 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:37.230706 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d442123-f0ba-4b27-8191-f8c8fc6ec9a8 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:37.232026 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d442123-f0ba-4b27-8191-f8c8fc6ec9a8 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:37.232500 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d442123-f0ba-4b27-8191-f8c8fc6ec9a8 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:37.234119 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 51/102] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:19:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:19:37.238303 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c115ab-798a-47e3-94b3-bffdc0937921 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:37.240184 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017875b0-df40-4625-b443-079cafc56782 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:37.240698 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017875b0-df40-4625-b443-079cafc56782 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:37.241169 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017875b0-df40-4625-b443-079cafc56782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:37.247352 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:37.263840 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-017875b0-df40-4625-b443-079cafc56782 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:19:37.265471 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-017875b0-df40-4625-b443-079cafc56782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:19:37.282726 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9af6ce4-21ff-462f-ac59-aac081341fc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:37.283673 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9af6ce4-21ff-462f-ac59-aac081341fc6 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:37.283963 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9af6ce4-21ff-462f-ac59-aac081341fc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:37.284239 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9af6ce4-21ff-462f-ac59-aac081341fc6 None admin] PATH_INFO: `/v3/users/2552ab86c1ab42ae815425f049c872c5` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:37.302095 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9af6ce4-21ff-462f-ac59-aac081341fc6 None admin] RBAC: Authorizing `identity:get_user(user_id=2552ab86c1ab42ae815425f049c872c5)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:19:37.303715 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9af6ce4-21ff-462f-ac59-aac081341fc6 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:19:37.305583 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 52/103] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Aug 24 11:19:37 2022] GET /identity/v3/users/2552ab86c1ab42ae815425f049c872c5 => generated 289 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:19:37.307726 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57538887-f11a-4a80-8c44-6e151afa6858 None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:37.307955 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57538887-f11a-4a80-8c44-6e151afa6858 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:37.308234 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57538887-f11a-4a80-8c44-6e151afa6858 None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:37.309549 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 53/104] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:19:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:19:37.315230 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9a0325-dc86-4429-b776-f2e7590de948 None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:37.315526 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9a0325-dc86-4429-b776-f2e7590de948 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:37.315839 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9a0325-dc86-4429-b776-f2e7590de948 None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:37.317209 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 54/105] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:19:37 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:19:37.318008 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9a0325-dc86-4429-b776-f2e7590de948 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:37.349368 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 52/106] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:19:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 11:19:37.357732 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e848e2-ad98-4fd1-85d0-f3152b94a19c None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:37.358262 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e848e2-ad98-4fd1-85d0-f3152b94a19c None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:37.358784 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e848e2-ad98-4fd1-85d0-f3152b94a19c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:37.385282 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-a7e848e2-ad98-4fd1-85d0-f3152b94a19c None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:19:37.386923 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-a7e848e2-ad98-4fd1-85d0-f3152b94a19c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:19:37.435756 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9a0325-dc86-4429-b776-f2e7590de948 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:37.457432 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 53/107] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:19:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 11:19:37.459049 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4addf928-2e65-467f-a0b5-e426996254d7 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:37.459333 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4addf928-2e65-467f-a0b5-e426996254d7 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:37.459698 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4addf928-2e65-467f-a0b5-e426996254d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:37.470400 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39294f7f-1fc1-4d9e-ac1f-406abbf64ef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:37.471032 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39294f7f-1fc1-4d9e-ac1f-406abbf64ef2 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:37.471383 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39294f7f-1fc1-4d9e-ac1f-406abbf64ef2 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:37.471661 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39294f7f-1fc1-4d9e-ac1f-406abbf64ef2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:37.477961 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-4addf928-2e65-467f-a0b5-e426996254d7 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:19:37.479163 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-4addf928-2e65-467f-a0b5-e426996254d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:19:37.506605 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:37.507819 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:37.570322 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39294f7f-1fc1-4d9e-ac1f-406abbf64ef2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:19:37.573187 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39294f7f-1fc1-4d9e-ac1f-406abbf64ef2 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:19:37.586178 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 54/108] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:19:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 11:19:37.587518 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597f5bdb-2d96-4f0f-80b1-5f39ca1c941c None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:37.587849 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597f5bdb-2d96-4f0f-80b1-5f39ca1c941c None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:37.588308 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597f5bdb-2d96-4f0f-80b1-5f39ca1c941c None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:37.589544 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 55/109] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:19:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:19:37.596169 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8302723d-09b4-4cd9-8b64-52952a4c8fbe None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:37.596446 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8302723d-09b4-4cd9-8b64-52952a4c8fbe None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:37.596718 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8302723d-09b4-4cd9-8b64-52952a4c8fbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:37.625675 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-8302723d-09b4-4cd9-8b64-52952a4c8fbe None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:19:37.629143 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-8302723d-09b4-4cd9-8b64-52952a4c8fbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:19:37.735941 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 56/110] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:19:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 11:19:37.736636 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8302723d-09b4-4cd9-8b64-52952a4c8fbe None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:37.805316 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 55/111] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 24 11:19:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 487 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 11:19:37.806069 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39294f7f-1fc1-4d9e-ac1f-406abbf64ef2 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:37.902830 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:37.928030 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:37.942102 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39294f7f-1fc1-4d9e-ac1f-406abbf64ef2 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:37.942913 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8302723d-09b4-4cd9-8b64-52952a4c8fbe None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:37.984104 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1edb3d2-f51e-48f9-af13-d37176235181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:37.985156 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1edb3d2-f51e-48f9-af13-d37176235181 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:37.985630 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1edb3d2-f51e-48f9-af13-d37176235181 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:37.986160 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1edb3d2-f51e-48f9-af13-d37176235181 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:37.986690 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0098b4d-b6cb-4cc3-b282-ee4a83a735d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:37.987431 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0098b4d-b6cb-4cc3-b282-ee4a83a735d3 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:37.987783 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1edb3d2-f51e-48f9-af13-d37176235181 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:19:37.987913 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0098b4d-b6cb-4cc3-b282-ee4a83a735d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:37.988291 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0098b4d-b6cb-4cc3-b282-ee4a83a735d3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:37.989856 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1edb3d2-f51e-48f9-af13-d37176235181 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:19:37.992052 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 56/112] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 11:19:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:19:37.993047 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1edb3d2-f51e-48f9-af13-d37176235181 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:38.003229 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0098b4d-b6cb-4cc3-b282-ee4a83a735d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:19:38.009757 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-f0098b4d-b6cb-4cc3-b282-ee4a83a735d3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 11:19:38.009757 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:19:38.009757 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:19:38.009757 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:19:38.009757 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:19:38.009757 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:19:38.009757 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:19:38.009757 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:19:38.009757 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:19:38.009757 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:19:38.009757 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:19:38.009757 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:19:38.009757 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:19:38.009757 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:19:38.009757 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:19:38.009757 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:19:38.010615 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:19:38.010615 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:19:38.010615 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:19:38.010615 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:19:38.010615 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:19:38.010615 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:19:38.010615 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:19:38.010615 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:19:38.010615 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:19:38.010615 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:19:38.010615 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:19:38.010615 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Aug 24 11:19:38.010615 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:19:38.010615 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:19:38.010615 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:19:38.010615 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:19:38.011390 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:19:38.011390 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:19:38.011390 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:19:38.011390 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:19:38.011390 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:19:38.011390 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:19:38.011390 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:19:38.011390 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:19:38.011390 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:19:38.011390 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:19:38.011390 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 11:19:38.011390 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:19:38.011390 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 57/113] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Aug 24 11:19:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:19:38.012006 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0098b4d-b6cb-4cc3-b282-ee4a83a735d3 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:38.110633 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1edb3d2-f51e-48f9-af13-d37176235181 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:38.146062 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0098b4d-b6cb-4cc3-b282-ee4a83a735d3 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:38.163641 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef3d4c0-2ed8-4088-9104-7608964a501a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:38.164206 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef3d4c0-2ed8-4088-9104-7608964a501a None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:38.164486 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef3d4c0-2ed8-4088-9104-7608964a501a None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:38.164763 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef3d4c0-2ed8-4088-9104-7608964a501a None admin] PATH_INFO: `/v3/projects/71e3821279484b7087ded02a637ad206` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:38.165900 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef3d4c0-2ed8-4088-9104-7608964a501a None admin] RBAC: Authorizing `identity:get_project(project_id=71e3821279484b7087ded02a637ad206)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:19:38.167396 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef3d4c0-2ed8-4088-9104-7608964a501a None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:19:38.169117 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 57/114] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Aug 24 11:19:37 2022] GET /identity/v3/projects/71e3821279484b7087ded02a637ad206 => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:19:38.169860 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef3d4c0-2ed8-4088-9104-7608964a501a None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:38.174316 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:38.183524 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0b5b8a-ba18-438b-be0e-7f5adcfa98fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:38.184167 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0b5b8a-ba18-438b-be0e-7f5adcfa98fd None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:38.184447 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0b5b8a-ba18-438b-be0e-7f5adcfa98fd None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:38.184722 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0b5b8a-ba18-438b-be0e-7f5adcfa98fd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:38.194857 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0b5b8a-ba18-438b-be0e-7f5adcfa98fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:19:38.200069 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-ff0b5b8a-ba18-438b-be0e-7f5adcfa98fd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 11:19:38.200069 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:19:38.200069 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:19:38.200069 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:19:38.200069 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:19:38.200069 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:19:38.200069 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:19:38.200069 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:19:38.200069 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:19:38.200069 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:19:38.200069 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:19:38.200069 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:19:38.200069 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:19:38.200069 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:19:38.200069 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:19:38.200069 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:19:38.200897 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:19:38.200897 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:19:38.200897 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:19:38.200897 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:19:38.200897 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:19:38.200897 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:19:38.200897 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:19:38.200897 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:19:38.200897 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:19:38.200897 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:19:38.200897 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:19:38.200897 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Aug 24 11:19:38.200897 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:19:38.200897 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:19:38.200897 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:19:38.200897 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:19:38.201667 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:19:38.201667 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:19:38.201667 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:19:38.201667 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:19:38.201667 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:19:38.201667 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:19:38.201667 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:19:38.201667 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:19:38.201667 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:19:38.201667 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:19:38.201667 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 11:19:38.201667 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:19:38.205869 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 58/115] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Aug 24 11:19:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:19:38.207011 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0b5b8a-ba18-438b-be0e-7f5adcfa98fd None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:38.221375 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:38.268381 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef3d4c0-2ed8-4088-9104-7608964a501a None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:38.301184 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7bc43b-9be9-45da-a1ad-6bbf278c98b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:38.301798 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7bc43b-9be9-45da-a1ad-6bbf278c98b3 None admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:38.302127 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7bc43b-9be9-45da-a1ad-6bbf278c98b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:38.302438 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7bc43b-9be9-45da-a1ad-6bbf278c98b3 None admin] PATH_INFO: `/v3/projects` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:38.303086 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7bc43b-9be9-45da-a1ad-6bbf278c98b3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:19:38.304544 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7bc43b-9be9-45da-a1ad-6bbf278c98b3 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:19:38.305299 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0b5b8a-ba18-438b-be0e-7f5adcfa98fd None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:38.333443 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 58/116] 10.222.0.27 () {60 vars in 1141 bytes} [Wed Aug 24 11:19:38 2022] POST /identity/v3/projects => generated 302 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:19:38.334521 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7bc43b-9be9-45da-a1ad-6bbf278c98b3 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:38.354541 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7ca131-4cea-42a9-9921-924cabe373f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:38.355198 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7ca131-4cea-42a9-9921-924cabe373f8 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:38.355484 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7ca131-4cea-42a9-9921-924cabe373f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:38.355761 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7ca131-4cea-42a9-9921-924cabe373f8 None admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:38.356463 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7ca131-4cea-42a9-9921-924cabe373f8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:19:38.356772 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7ca131-4cea-42a9-9921-924cabe373f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:19:38.358280 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7ca131-4cea-42a9-9921-924cabe373f8 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:19:38.368095 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 59/117] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Aug 24 11:19:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:19:38.369269 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fd1f56-5cf8-420c-8d52-f71d4658943f None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:38.369563 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fd1f56-5cf8-420c-8d52-f71d4658943f None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:38.369839 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fd1f56-5cf8-420c-8d52-f71d4658943f None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:38.374806 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 60/118] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:19:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:19:38.374806 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fd1f56-5cf8-420c-8d52-f71d4658943f None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:38.399509 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:38.457832 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7bc43b-9be9-45da-a1ad-6bbf278c98b3 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:38.467536 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:38.497647 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fd1f56-5cf8-420c-8d52-f71d4658943f None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:38.499071 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ae8e16-5d68-421b-8066-0ca78ef648f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:38.499755 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ae8e16-5d68-421b-8066-0ca78ef648f6 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:38.500040 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ae8e16-5d68-421b-8066-0ca78ef648f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:38.500321 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ae8e16-5d68-421b-8066-0ca78ef648f6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:38.513595 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ae8e16-5d68-421b-8066-0ca78ef648f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:19:38.518597 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-93ae8e16-5d68-421b-8066-0ca78ef648f6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 11:19:38.518597 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:19:38.518597 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:19:38.518597 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:19:38.518597 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:19:38.518597 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:19:38.518597 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:19:38.518597 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:19:38.518597 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:19:38.518597 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:19:38.518597 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:19:38.518597 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:19:38.518597 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:19:38.518597 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:19:38.518597 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:19:38.518597 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:19:38.519523 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:19:38.519523 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:19:38.519523 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:19:38.519523 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:19:38.519523 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:19:38.519523 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:19:38.519523 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:19:38.519523 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:19:38.519523 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:19:38.519523 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:19:38.519523 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:19:38.519523 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Aug 24 11:19:38.519523 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:19:38.519523 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:19:38.519523 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:19:38.519523 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:19:38.520296 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:19:38.520296 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:19:38.520296 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:19:38.520296 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:19:38.520296 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:19:38.520296 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:19:38.520296 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:19:38.520296 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:19:38.520296 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:19:38.520296 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:19:38.520296 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 11:19:38.520296 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Aug 24 11:19:38.520296 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 59/119] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 24 11:19:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:19:38.520930 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ae8e16-5d68-421b-8066-0ca78ef648f6 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:38.543581 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b389c5-6d5e-42f1-99ce-0fde9e554028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:38.544201 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b389c5-6d5e-42f1-99ce-0fde9e554028 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:38.544477 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b389c5-6d5e-42f1-99ce-0fde9e554028 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:38.544752 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b389c5-6d5e-42f1-99ce-0fde9e554028 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:38.545496 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b389c5-6d5e-42f1-99ce-0fde9e554028 None admin] RBAC: Adding query filter params (role.id=7b4c8894d4a2493b97242eb334dc9014, scope.project.id=71e3821279484b7087ded02a637ad206, user.id=2552ab86c1ab42ae815425f049c872c5) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:19:38.545802 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b389c5-6d5e-42f1-99ce-0fde9e554028 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:19:38.547308 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b389c5-6d5e-42f1-99ce-0fde9e554028 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:19:38.553959 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 61/120] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Aug 24 11:19:38 2022] GET /identity/v3/role_assignments?user.id=2552ab86c1ab42ae815425f049c872c5&scope.project.id=71e3821279484b7087ded02a637ad206&role.id=7b4c8894d4a2493b97242eb334dc9014 => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:19:38.563479 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b389c5-6d5e-42f1-99ce-0fde9e554028 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:38.661136 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ae8e16-5d68-421b-8066-0ca78ef648f6 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:38.684159 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:38.706739 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b389c5-6d5e-42f1-99ce-0fde9e554028 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:38.708874 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301d3a89-a6b2-41ad-9800-b0bd6a11dc1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:38.709447 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301d3a89-a6b2-41ad-9800-b0bd6a11dc1e None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:38.709732 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301d3a89-a6b2-41ad-9800-b0bd6a11dc1e None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:38.710014 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301d3a89-a6b2-41ad-9800-b0bd6a11dc1e None admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:38.711526 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301d3a89-a6b2-41ad-9800-b0bd6a11dc1e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:19:38.711836 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301d3a89-a6b2-41ad-9800-b0bd6a11dc1e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:19:38.713360 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301d3a89-a6b2-41ad-9800-b0bd6a11dc1e None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:19:38.724923 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 60/121] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 24 11:19:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:19:38.726989 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198701c5-e31f-4e42-9901-43c9657f246b None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:38.727273 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198701c5-e31f-4e42-9901-43c9657f246b None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:38.727542 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198701c5-e31f-4e42-9901-43c9657f246b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:38.748965 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a240055b-1f14-457b-8747-6318850df7ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:38.749588 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-198701c5-e31f-4e42-9901-43c9657f246b None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:19:38.750164 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a240055b-1f14-457b-8747-6318850df7ab None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:38.750669 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a240055b-1f14-457b-8747-6318850df7ab None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:38.750876 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-198701c5-e31f-4e42-9901-43c9657f246b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:19:38.751315 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a240055b-1f14-457b-8747-6318850df7ab None admin] PATH_INFO: `/v3/users/46203446b8ea4ef7b7610bda424e8775` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:38.752958 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a240055b-1f14-457b-8747-6318850df7ab None admin] RBAC: Authorizing `identity:get_user(user_id=46203446b8ea4ef7b7610bda424e8775)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:19:38.760036 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a240055b-1f14-457b-8747-6318850df7ab None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:19:38.762934 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 62/122] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Aug 24 11:19:38 2022] GET /identity/v3/users/46203446b8ea4ef7b7610bda424e8775 => generated 275 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:19:38.764266 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a240055b-1f14-457b-8747-6318850df7ab None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:38.780059 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:38.834453 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 61/123] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:19:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 11:19:38.835649 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198701c5-e31f-4e42-9901-43c9657f246b None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:38.929960 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a240055b-1f14-457b-8747-6318850df7ab None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:38.980177 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198701c5-e31f-4e42-9901-43c9657f246b None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:38.996584 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3776f748-29d9-490d-9378-e9cb158ba030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:38.997436 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3776f748-29d9-490d-9378-e9cb158ba030 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:38.997877 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3776f748-29d9-490d-9378-e9cb158ba030 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:38.998285 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3776f748-29d9-490d-9378-e9cb158ba030 None admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:38.999131 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3776f748-29d9-490d-9378-e9cb158ba030 None admin] RBAC: Adding query filter params (name=member) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:19:38.999586 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3776f748-29d9-490d-9378-e9cb158ba030 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:19:39.001131 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3776f748-29d9-490d-9378-e9cb158ba030 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:19:39.005225 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:39.016807 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 63/124] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Aug 24 11:19:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:19:39.017838 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3776f748-29d9-490d-9378-e9cb158ba030 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:39.054370 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d145728-bf32-4b36-93f9-da6b96211cbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:39.055027 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d145728-bf32-4b36-93f9-da6b96211cbd None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:39.055313 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d145728-bf32-4b36-93f9-da6b96211cbd None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:39.055583 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d145728-bf32-4b36-93f9-da6b96211cbd None admin] PATH_INFO: `/v3/users/1e2e9ab325dc4dbf92dd6b59db4a0945` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:39.056897 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d145728-bf32-4b36-93f9-da6b96211cbd None admin] RBAC: Authorizing `identity:get_user(user_id=1e2e9ab325dc4dbf92dd6b59db4a0945)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:19:39.058390 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d145728-bf32-4b36-93f9-da6b96211cbd None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:19:39.059999 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 62/125] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Aug 24 11:19:38 2022] GET /identity/v3/users/1e2e9ab325dc4dbf92dd6b59db4a0945 => generated 247 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:19:39.060765 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d145728-bf32-4b36-93f9-da6b96211cbd None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:39.134701 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:39.198592 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3776f748-29d9-490d-9378-e9cb158ba030 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:39.233438 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73048d6f-bcaa-45af-9d42-1df375a909d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:39.233619 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d145728-bf32-4b36-93f9-da6b96211cbd None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:39.233995 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73048d6f-bcaa-45af-9d42-1df375a909d2 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:39.234280 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73048d6f-bcaa-45af-9d42-1df375a909d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:39.234581 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73048d6f-bcaa-45af-9d42-1df375a909d2 None admin] PATH_INFO: `/v3/projects/71e3821279484b7087ded02a637ad206` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:39.235727 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73048d6f-bcaa-45af-9d42-1df375a909d2 None admin] RBAC: Authorizing `identity:get_project(project_id=71e3821279484b7087ded02a637ad206)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:19:39.237223 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73048d6f-bcaa-45af-9d42-1df375a909d2 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:19:39.239131 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 64/126] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Aug 24 11:19:39 2022] GET /identity/v3/projects/71e3821279484b7087ded02a637ad206 => generated 298 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:19:39.239733 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73048d6f-bcaa-45af-9d42-1df375a909d2 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:39.269653 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081e7d9d-9a80-4605-b54b-80ba794e4edf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:39.270530 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081e7d9d-9a80-4605-b54b-80ba794e4edf None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:39.270898 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081e7d9d-9a80-4605-b54b-80ba794e4edf None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:39.271257 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081e7d9d-9a80-4605-b54b-80ba794e4edf None admin] PATH_INFO: `/v3/users/46203446b8ea4ef7b7610bda424e8775` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:39.273269 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081e7d9d-9a80-4605-b54b-80ba794e4edf None admin] RBAC: Authorizing `identity:get_user(user_id=46203446b8ea4ef7b7610bda424e8775)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:19:39.274960 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081e7d9d-9a80-4605-b54b-80ba794e4edf None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:19:39.277085 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 63/127] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Aug 24 11:19:39 2022] GET /identity/v3/users/46203446b8ea4ef7b7610bda424e8775 => generated 275 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:19:39.279111 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081e7d9d-9a80-4605-b54b-80ba794e4edf None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:39.329214 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:39.343296 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73048d6f-bcaa-45af-9d42-1df375a909d2 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:39.380306 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9d3d5d-fafc-4297-96d6-fdda448b1db4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:39.380958 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9d3d5d-fafc-4297-96d6-fdda448b1db4 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:39.381240 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9d3d5d-fafc-4297-96d6-fdda448b1db4 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:39.381619 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9d3d5d-fafc-4297-96d6-fdda448b1db4 None admin] PATH_INFO: `/v3/projects/71e3821279484b7087ded02a637ad206` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:39.382885 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9d3d5d-fafc-4297-96d6-fdda448b1db4 None admin] RBAC: Authorizing `identity:get_project(project_id=71e3821279484b7087ded02a637ad206)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:19:39.384408 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9d3d5d-fafc-4297-96d6-fdda448b1db4 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:19:39.385442 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081e7d9d-9a80-4605-b54b-80ba794e4edf None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:39.386055 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 65/128] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Aug 24 11:19:39 2022] GET /identity/v3/projects/71e3821279484b7087ded02a637ad206 => generated 298 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:19:39.391634 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9d3d5d-fafc-4297-96d6-fdda448b1db4 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:39.395610 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:39.422139 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202b36ae-c8cf-464a-853f-455074a3d445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:39.422884 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202b36ae-c8cf-464a-853f-455074a3d445 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:39.423159 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202b36ae-c8cf-464a-853f-455074a3d445 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:39.423424 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202b36ae-c8cf-464a-853f-455074a3d445 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:39.434648 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202b36ae-c8cf-464a-853f-455074a3d445 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:19:39.440096 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-202b36ae-c8cf-464a-853f-455074a3d445 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 11:19:39.440096 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:19:39.440096 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:19:39.440096 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:19:39.440096 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:19:39.440096 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:19:39.440096 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:19:39.440096 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:19:39.440096 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:19:39.440096 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:19:39.440096 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:19:39.440096 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:19:39.440096 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:19:39.440096 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:19:39.440096 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:19:39.440096 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:19:39.441014 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:19:39.441014 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:19:39.441014 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:19:39.441014 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:19:39.441014 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:19:39.441014 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:19:39.441014 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:19:39.441014 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:19:39.441014 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:19:39.441014 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:19:39.441014 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:19:39.441014 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Aug 24 11:19:39.441014 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:19:39.441014 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:19:39.441014 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:19:39.441014 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:19:39.441776 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:19:39.441776 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:19:39.441776 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:19:39.441776 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:19:39.441776 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:19:39.441776 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:19:39.441776 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:19:39.441776 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:19:39.441776 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:19:39.441776 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:19:39.441776 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 11:19:39.441776 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Aug 24 11:19:39.446152 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 64/129] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 24 11:19:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:19:39.447068 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202b36ae-c8cf-464a-853f-455074a3d445 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:39.508900 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9d3d5d-fafc-4297-96d6-fdda448b1db4 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:39.546316 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce1d9af-c1bf-4dc3-a8a2-fe447d620d3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:39.547113 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce1d9af-c1bf-4dc3-a8a2-fe447d620d3d None admin] REQUEST_METHOD: `PUT` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:39.547399 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce1d9af-c1bf-4dc3-a8a2-fe447d620d3d None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:39.547679 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce1d9af-c1bf-4dc3-a8a2-fe447d620d3d None admin] PATH_INFO: `/v3/projects/71e3821279484b7087ded02a637ad206/users/46203446b8ea4ef7b7610bda424e8775/roles/96f07e9110194606acccfbd8467649a7` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:39.550045 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce1d9af-c1bf-4dc3-a8a2-fe447d620d3d None admin] RBAC: Authorizing `identity:create_grant(project_id=71e3821279484b7087ded02a637ad206, user_id=46203446b8ea4ef7b7610bda424e8775, role_id=96f07e9110194606acccfbd8467649a7)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:19:39.551637 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce1d9af-c1bf-4dc3-a8a2-fe447d620d3d None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:19:39.552344 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202b36ae-c8cf-464a-853f-455074a3d445 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:39.555026 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:39.570486 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 66/130] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Aug 24 11:19:39 2022] PUT /identity/v3/projects/71e3821279484b7087ded02a637ad206/users/46203446b8ea4ef7b7610bda424e8775/roles/96f07e9110194606acccfbd8467649a7 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:19:39.571219 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce1d9af-c1bf-4dc3-a8a2-fe447d620d3d None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:39.594574 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fe1757-73bd-4597-ab9d-08d0fd206f9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:39.595227 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fe1757-73bd-4597-ab9d-08d0fd206f9f None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:39.595505 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fe1757-73bd-4597-ab9d-08d0fd206f9f None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:39.595777 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fe1757-73bd-4597-ab9d-08d0fd206f9f None admin] PATH_INFO: `/v3/projects/71e3821279484b7087ded02a637ad206` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:39.597004 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fe1757-73bd-4597-ab9d-08d0fd206f9f None admin] RBAC: Authorizing `identity:get_project(project_id=71e3821279484b7087ded02a637ad206)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:19:39.599608 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fe1757-73bd-4597-ab9d-08d0fd206f9f None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:19:39.601602 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 65/131] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Aug 24 11:19:39 2022] GET /identity/v3/projects/71e3821279484b7087ded02a637ad206 => generated 298 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:19:39.603267 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fe1757-73bd-4597-ab9d-08d0fd206f9f None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:39.660652 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:39.708001 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce1d9af-c1bf-4dc3-a8a2-fe447d620d3d None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:39.755971 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88fd67c-4063-4c9e-a564-1b491519fdde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:39.756767 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88fd67c-4063-4c9e-a564-1b491519fdde None admin] REQUEST_METHOD: `PUT` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:39.757376 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88fd67c-4063-4c9e-a564-1b491519fdde None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:39.757658 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88fd67c-4063-4c9e-a564-1b491519fdde None admin] PATH_INFO: `/v3/projects/71e3821279484b7087ded02a637ad206/users/1e2e9ab325dc4dbf92dd6b59db4a0945/roles/30bb1e97257f4ca5b90c88545777317b` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:39.760901 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88fd67c-4063-4c9e-a564-1b491519fdde None admin] RBAC: Authorizing `identity:create_grant(project_id=71e3821279484b7087ded02a637ad206, user_id=1e2e9ab325dc4dbf92dd6b59db4a0945, role_id=30bb1e97257f4ca5b90c88545777317b)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:19:39.762686 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88fd67c-4063-4c9e-a564-1b491519fdde None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:19:39.786042 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 67/132] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Aug 24 11:19:39 2022] PUT /identity/v3/projects/71e3821279484b7087ded02a637ad206/users/1e2e9ab325dc4dbf92dd6b59db4a0945/roles/30bb1e97257f4ca5b90c88545777317b => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:19:39.789768 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88fd67c-4063-4c9e-a564-1b491519fdde None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:39.794048 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fe1757-73bd-4597-ab9d-08d0fd206f9f None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:39.833054 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea29f3c1-2a46-4fec-8151-3bacbf3063c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:39.833681 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea29f3c1-2a46-4fec-8151-3bacbf3063c3 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:39.833968 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea29f3c1-2a46-4fec-8151-3bacbf3063c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:39.834238 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea29f3c1-2a46-4fec-8151-3bacbf3063c3 None admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:39.835005 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea29f3c1-2a46-4fec-8151-3bacbf3063c3 None admin] RBAC: Adding query filter params (name=member) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:19:39.835309 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea29f3c1-2a46-4fec-8151-3bacbf3063c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:19:39.836737 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea29f3c1-2a46-4fec-8151-3bacbf3063c3 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:19:39.846403 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 66/133] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Aug 24 11:19:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:19:39.853029 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea29f3c1-2a46-4fec-8151-3bacbf3063c3 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:39.895329 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:39.969601 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea29f3c1-2a46-4fec-8151-3bacbf3063c3 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:40.004053 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88fd67c-4063-4c9e-a564-1b491519fdde None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:40.042769 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:40.062777 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377c9834-4279-46cd-98f7-515b86b4b0e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:40.063489 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377c9834-4279-46cd-98f7-515b86b4b0e1 None admin] REQUEST_METHOD: `PUT` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:40.063774 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377c9834-4279-46cd-98f7-515b86b4b0e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:40.064059 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377c9834-4279-46cd-98f7-515b86b4b0e1 None admin] PATH_INFO: `/v3/projects/71e3821279484b7087ded02a637ad206/users/46203446b8ea4ef7b7610bda424e8775/roles/27e3e65e24df4b86b0d3d18d3212101d` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:40.068024 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377c9834-4279-46cd-98f7-515b86b4b0e1 None admin] RBAC: Authorizing `identity:create_grant(project_id=71e3821279484b7087ded02a637ad206, user_id=46203446b8ea4ef7b7610bda424e8775, role_id=27e3e65e24df4b86b0d3d18d3212101d)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:19:40.070056 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377c9834-4279-46cd-98f7-515b86b4b0e1 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:19:40.095162 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 68/134] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Aug 24 11:19:39 2022] PUT /identity/v3/projects/71e3821279484b7087ded02a637ad206/users/46203446b8ea4ef7b7610bda424e8775/roles/27e3e65e24df4b86b0d3d18d3212101d => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:19:40.099141 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162868fa-8d78-420b-99f5-2447f052768e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:40.099821 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162868fa-8d78-420b-99f5-2447f052768e None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:40.100106 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162868fa-8d78-420b-99f5-2447f052768e None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:40.100382 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162868fa-8d78-420b-99f5-2447f052768e None admin] PATH_INFO: `/v3/users/46203446b8ea4ef7b7610bda424e8775` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:40.107441 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162868fa-8d78-420b-99f5-2447f052768e None admin] RBAC: Authorizing `identity:get_user(user_id=46203446b8ea4ef7b7610bda424e8775)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:19:40.109029 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162868fa-8d78-420b-99f5-2447f052768e None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:19:40.111324 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 67/135] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Aug 24 11:19:39 2022] GET /identity/v3/users/46203446b8ea4ef7b7610bda424e8775 => generated 275 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:19:40.118116 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377c9834-4279-46cd-98f7-515b86b4b0e1 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:40.279864 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377c9834-4279-46cd-98f7-515b86b4b0e1 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:40.319843 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9921869-93dd-4d1e-9245-548930addb9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:40.320808 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9921869-93dd-4d1e-9245-548930addb9d None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:40.321291 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9921869-93dd-4d1e-9245-548930addb9d None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:40.321750 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9921869-93dd-4d1e-9245-548930addb9d None admin] PATH_INFO: `/v3/projects/e41389802363424fa838e3fd74da8717` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:40.323095 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9921869-93dd-4d1e-9245-548930addb9d None admin] RBAC: Authorizing `identity:get_project(project_id=e41389802363424fa838e3fd74da8717)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:19:40.324768 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9921869-93dd-4d1e-9245-548930addb9d None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:19:40.326702 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 69/136] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Aug 24 11:19:40 2022] GET /identity/v3/projects/e41389802363424fa838e3fd74da8717 => generated 312 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:19:40.332782 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162868fa-8d78-420b-99f5-2447f052768e None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:40.482101 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162868fa-8d78-420b-99f5-2447f052768e None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:40.483727 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:40.528803 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5c5eca-2e9e-47ca-878c-b088b0daea34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:40.529483 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5c5eca-2e9e-47ca-878c-b088b0daea34 None admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:40.529765 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5c5eca-2e9e-47ca-878c-b088b0daea34 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:40.530040 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5c5eca-2e9e-47ca-878c-b088b0daea34 None admin] PATH_INFO: `/v3/projects/e41389802363424fa838e3fd74da8717/users/46203446b8ea4ef7b7610bda424e8775/roles/27e3e65e24df4b86b0d3d18d3212101d` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:40.532043 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5c5eca-2e9e-47ca-878c-b088b0daea34 None admin] RBAC: Authorizing `identity:create_grant(project_id=e41389802363424fa838e3fd74da8717, user_id=46203446b8ea4ef7b7610bda424e8775, role_id=27e3e65e24df4b86b0d3d18d3212101d)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:19:40.533505 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5c5eca-2e9e-47ca-878c-b088b0daea34 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:19:40.556116 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 68/137] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Aug 24 11:19:40 2022] PUT /identity/v3/projects/e41389802363424fa838e3fd74da8717/users/46203446b8ea4ef7b7610bda424e8775/roles/27e3e65e24df4b86b0d3d18d3212101d => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:19:40.626736 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d543a33e-bf38-4c19-a07e-ad56ce3fbbe8 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:40.627749 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d543a33e-bf38-4c19-a07e-ad56ce3fbbe8 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:40.628213 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d543a33e-bf38-4c19-a07e-ad56ce3fbbe8 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:40.630268 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 70/138] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:19:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:19:40.639492 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957f9210-5356-4ac8-aade-46127c211485 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:40.639804 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957f9210-5356-4ac8-aade-46127c211485 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:40.640050 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957f9210-5356-4ac8-aade-46127c211485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:40.664701 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-957f9210-5356-4ac8-aade-46127c211485 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:19:40.665941 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-957f9210-5356-4ac8-aade-46127c211485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:19:40.759060 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 69/139] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:19:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 11:19:41.048970 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e305f1e4-3985-47ae-bd62-355230e7c4ae None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:41.049649 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e305f1e4-3985-47ae-bd62-355230e7c4ae None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:41.050120 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e305f1e4-3985-47ae-bd62-355230e7c4ae None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:41.051806 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 71/140] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:19:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:19:41.057071 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1558e359-09b5-49d1-88b9-8c9ca7f09ec2 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:41.057358 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1558e359-09b5-49d1-88b9-8c9ca7f09ec2 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:41.057632 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1558e359-09b5-49d1-88b9-8c9ca7f09ec2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:41.083348 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-1558e359-09b5-49d1-88b9-8c9ca7f09ec2 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:19:41.084544 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-1558e359-09b5-49d1-88b9-8c9ca7f09ec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:19:41.175623 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 70/141] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:19:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 11:19:41.259321 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e305f1e4-3985-47ae-bd62-355230e7c4ae None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:41.332836 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:41.392405 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e305f1e4-3985-47ae-bd62-355230e7c4ae None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:41.430258 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae6419f-2c13-44dd-ae80-bd01a7114a5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:41.431251 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae6419f-2c13-44dd-ae80-bd01a7114a5e None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:41.431757 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae6419f-2c13-44dd-ae80-bd01a7114a5e None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:41.432226 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae6419f-2c13-44dd-ae80-bd01a7114a5e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:41.433604 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae6419f-2c13-44dd-ae80-bd01a7114a5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:19:41.435369 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae6419f-2c13-44dd-ae80-bd01a7114a5e None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:19:41.437210 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 72/142] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 11:19:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:19:41.443454 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1558e359-09b5-49d1-88b9-8c9ca7f09ec2 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:41.493944 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:41.599985 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1558e359-09b5-49d1-88b9-8c9ca7f09ec2 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:41.607797 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae6419f-2c13-44dd-ae80-bd01a7114a5e None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:41.641004 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eba37b-83f6-4551-89be-d8a9172702e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:41.641841 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eba37b-83f6-4551-89be-d8a9172702e2 None admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:41.642036 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eba37b-83f6-4551-89be-d8a9172702e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:41.642256 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eba37b-83f6-4551-89be-d8a9172702e2 None admin] PATH_INFO: `/v3/users` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:41.642929 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44eba37b-83f6-4551-89be-d8a9172702e2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:19:41.644454 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44eba37b-83f6-4551-89be-d8a9172702e2 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:19:41.685618 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 71/143] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Aug 24 11:19:41 2022] POST /identity/v3/users => generated 283 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:19:41.767388 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae6419f-2c13-44dd-ae80-bd01a7114a5e None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:41.802807 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:41.821874 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc38589-d438-4410-924b-4f45a772cf0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:41.822995 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc38589-d438-4410-924b-4f45a772cf0b None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:41.823493 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc38589-d438-4410-924b-4f45a772cf0b None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:41.823991 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc38589-d438-4410-924b-4f45a772cf0b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:41.840614 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc38589-d438-4410-924b-4f45a772cf0b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:19:41.850684 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-3bc38589-d438-4410-924b-4f45a772cf0b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 11:19:41.850684 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:19:41.850684 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:19:41.850684 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:19:41.850684 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:19:41.850684 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:19:41.850684 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:19:41.850684 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:19:41.850684 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:19:41.850684 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:19:41.850684 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:19:41.850684 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:19:41.850684 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:19:41.850684 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:19:41.850684 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:19:41.850684 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:19:41.851599 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:19:41.851599 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:19:41.851599 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:19:41.851599 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:19:41.851599 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:19:41.851599 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:19:41.851599 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:19:41.851599 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:19:41.851599 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:19:41.851599 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:19:41.851599 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:19:41.851599 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Aug 24 11:19:41.851599 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:19:41.851599 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:19:41.851599 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:19:41.851599 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:19:41.852359 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:19:41.852359 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:19:41.852359 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:19:41.852359 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:19:41.852359 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:19:41.852359 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:19:41.852359 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:19:41.852359 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:19:41.852359 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:19:41.852359 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:19:41.852359 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 11:19:41.852359 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:19:41.854919 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 73/144] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 24 11:19:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 11:19:41.860870 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eba37b-83f6-4551-89be-d8a9172702e2 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:41.991356 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:42.019055 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eba37b-83f6-4551-89be-d8a9172702e2 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:42.059047 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7381c8-6029-47d2-9699-6e27c6f7fb99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:42.059662 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7381c8-6029-47d2-9699-6e27c6f7fb99 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:42.059930 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7381c8-6029-47d2-9699-6e27c6f7fb99 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:42.060198 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7381c8-6029-47d2-9699-6e27c6f7fb99 None admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:42.060878 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7381c8-6029-47d2-9699-6e27c6f7fb99 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:19:42.061173 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7381c8-6029-47d2-9699-6e27c6f7fb99 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:19:42.062637 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7381c8-6029-47d2-9699-6e27c6f7fb99 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:19:42.074118 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 72/145] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Aug 24 11:19:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:19:42.079397 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc38589-d438-4410-924b-4f45a772cf0b None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:42.230421 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc38589-d438-4410-924b-4f45a772cf0b None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:42.280380 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a9f050-00a2-4237-9397-f3aee5a54f19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:42.281258 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a9f050-00a2-4237-9397-f3aee5a54f19 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:42.281541 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a9f050-00a2-4237-9397-f3aee5a54f19 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:42.281815 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a9f050-00a2-4237-9397-f3aee5a54f19 None admin] PATH_INFO: `/v3/users/2552ab86c1ab42ae815425f049c872c5` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:42.283146 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a9f050-00a2-4237-9397-f3aee5a54f19 None admin] RBAC: Authorizing `identity:get_user(user_id=2552ab86c1ab42ae815425f049c872c5)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:19:42.284744 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a9f050-00a2-4237-9397-f3aee5a54f19 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:19:42.286650 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 74/146] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Aug 24 11:19:42 2022] GET /identity/v3/users/2552ab86c1ab42ae815425f049c872c5 => generated 289 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:19:42.292225 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7381c8-6029-47d2-9699-6e27c6f7fb99 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:42.359320 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8bcbc3-41e3-4798-8a26-270746829d89 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:42.359515 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8bcbc3-41e3-4798-8a26-270746829d89 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:42.360033 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8bcbc3-41e3-4798-8a26-270746829d89 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:42.361580 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 75/147] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:19:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:19:42.382216 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a653f3-4af7-4d46-a133-42526170d168 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:42.382832 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a653f3-4af7-4d46-a133-42526170d168 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:42.383294 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a653f3-4af7-4d46-a133-42526170d168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:42.416593 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-b1a653f3-4af7-4d46-a133-42526170d168 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:19:42.417790 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-b1a653f3-4af7-4d46-a133-42526170d168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:19:42.451332 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7381c8-6029-47d2-9699-6e27c6f7fb99 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:42.505972 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:42.520679 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c6dde4-c28f-4a55-8189-85578147b840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:42.521333 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c6dde4-c28f-4a55-8189-85578147b840 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:42.521610 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c6dde4-c28f-4a55-8189-85578147b840 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:42.521877 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c6dde4-c28f-4a55-8189-85578147b840 None admin] PATH_INFO: `/v3/projects/71e3821279484b7087ded02a637ad206` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:42.525775 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c6dde4-c28f-4a55-8189-85578147b840 None admin] RBAC: Authorizing `identity:get_project(project_id=71e3821279484b7087ded02a637ad206)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:19:42.528741 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c6dde4-c28f-4a55-8189-85578147b840 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:19:42.532274 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 73/148] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Aug 24 11:19:42 2022] GET /identity/v3/projects/71e3821279484b7087ded02a637ad206 => generated 298 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:19:42.536311 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c6dde4-c28f-4a55-8189-85578147b840 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:42.552928 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 76/149] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:19:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 11:19:42.557050 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:42.652504 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c6dde4-c28f-4a55-8189-85578147b840 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:42.688208 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317656b9-53d5-44e0-8d91-a622a2769484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:42.689269 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317656b9-53d5-44e0-8d91-a622a2769484 None admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:42.689709 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317656b9-53d5-44e0-8d91-a622a2769484 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:42.690122 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317656b9-53d5-44e0-8d91-a622a2769484 None admin] PATH_INFO: `/v3/projects/71e3821279484b7087ded02a637ad206/users/2552ab86c1ab42ae815425f049c872c5/roles/7b4c8894d4a2493b97242eb334dc9014` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:42.692352 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317656b9-53d5-44e0-8d91-a622a2769484 None admin] RBAC: Authorizing `identity:create_grant(project_id=71e3821279484b7087ded02a637ad206, user_id=2552ab86c1ab42ae815425f049c872c5, role_id=7b4c8894d4a2493b97242eb334dc9014)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:19:42.694035 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317656b9-53d5-44e0-8d91-a622a2769484 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:19:42.715239 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 74/150] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Aug 24 11:19:42 2022] PUT /identity/v3/projects/71e3821279484b7087ded02a637ad206/users/2552ab86c1ab42ae815425f049c872c5/roles/7b4c8894d4a2493b97242eb334dc9014 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 11:19:42.951545 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c852ee14-4817-496c-b240-7581f742d3e2 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:42.952555 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c852ee14-4817-496c-b240-7581f742d3e2 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:42.953029 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c852ee14-4817-496c-b240-7581f742d3e2 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:42.954719 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 77/151] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:19:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:19:42.962318 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5277d197-f2c0-49be-8bc7-d08164c9ea80 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:42.962954 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5277d197-f2c0-49be-8bc7-d08164c9ea80 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:42.963439 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5277d197-f2c0-49be-8bc7-d08164c9ea80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:42.982983 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-5277d197-f2c0-49be-8bc7-d08164c9ea80 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:19:42.984518 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-5277d197-f2c0-49be-8bc7-d08164c9ea80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:19:43.033490 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b95ecc-0a03-4e89-9590-c905b0e486e7 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:43.034137 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b95ecc-0a03-4e89-9590-c905b0e486e7 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:43.034765 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b95ecc-0a03-4e89-9590-c905b0e486e7 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:43.036394 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 78/152] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:19:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:19:43.041713 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7b74e8-8c0b-4424-b0f8-4f7a9db87fad None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:43.042248 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7b74e8-8c0b-4424-b0f8-4f7a9db87fad None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:43.042757 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7b74e8-8c0b-4424-b0f8-4f7a9db87fad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:43.067179 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-cf7b74e8-8c0b-4424-b0f8-4f7a9db87fad None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:19:43.070950 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-cf7b74e8-8c0b-4424-b0f8-4f7a9db87fad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:19:43.096293 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:43.110383 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 75/153] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:19:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 11:19:43.122974 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5277d197-f2c0-49be-8bc7-d08164c9ea80 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:43.227111 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 79/154] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:19:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 11:19:43.287043 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5277d197-f2c0-49be-8bc7-d08164c9ea80 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:43.334657 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0501062-ebbf-4e7c-a84b-d6084deb245c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:43.335341 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0501062-ebbf-4e7c-a84b-d6084deb245c None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:43.335658 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0501062-ebbf-4e7c-a84b-d6084deb245c None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:43.335928 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0501062-ebbf-4e7c-a84b-d6084deb245c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:43.347193 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0501062-ebbf-4e7c-a84b-d6084deb245c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:19:43.356291 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-a0501062-ebbf-4e7c-a84b-d6084deb245c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 11:19:43.356291 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:19:43.356291 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:19:43.356291 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:19:43.356291 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:19:43.356291 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:19:43.356291 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:19:43.356291 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:19:43.356291 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:19:43.356291 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:19:43.356291 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:19:43.356291 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:19:43.356291 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:19:43.356291 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:19:43.356291 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:19:43.356291 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:19:43.357157 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:19:43.357157 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:19:43.357157 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:19:43.357157 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:19:43.357157 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:19:43.357157 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:19:43.357157 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:19:43.357157 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:19:43.357157 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:19:43.357157 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:19:43.357157 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:19:43.357157 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Aug 24 11:19:43.357157 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:19:43.357157 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:19:43.357157 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:19:43.357157 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:19:43.357937 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:19:43.357937 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:19:43.357937 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:19:43.357937 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:19:43.357937 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:19:43.357937 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:19:43.357937 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:19:43.357937 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:19:43.357937 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:19:43.357937 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:19:43.357937 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 11:19:43.357937 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Aug 24 11:19:43.357937 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 76/155] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Aug 24 11:19:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 11:19:43.364999 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7b74e8-8c0b-4424-b0f8-4f7a9db87fad None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:43.464094 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4966ced3-7af6-4090-9d86-195cf2048096 None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:43.464623 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4966ced3-7af6-4090-9d86-195cf2048096 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:43.464623 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4966ced3-7af6-4090-9d86-195cf2048096 None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:43.466150 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 77/156] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:19:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 11:19:43.476889 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98005e4-bcf0-4888-9072-ad8e5889bac8 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:43.477251 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98005e4-bcf0-4888-9072-ad8e5889bac8 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:43.477440 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98005e4-bcf0-4888-9072-ad8e5889bac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:43.499792 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7b74e8-8c0b-4424-b0f8-4f7a9db87fad None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:43.511690 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-f98005e4-bcf0-4888-9072-ad8e5889bac8 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:19:43.513457 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-f98005e4-bcf0-4888-9072-ad8e5889bac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:19:43.516748 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:43.552057 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ad7ad5-65a8-4adf-918a-ee7acbb8e9dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:43.552687 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ad7ad5-65a8-4adf-918a-ee7acbb8e9dd None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:43.552959 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ad7ad5-65a8-4adf-918a-ee7acbb8e9dd None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:43.553260 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ad7ad5-65a8-4adf-918a-ee7acbb8e9dd None admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:43.553892 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ad7ad5-65a8-4adf-918a-ee7acbb8e9dd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:19:43.554187 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ad7ad5-65a8-4adf-918a-ee7acbb8e9dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:19:43.555635 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ad7ad5-65a8-4adf-918a-ee7acbb8e9dd None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:19:43.572839 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 80/157] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Aug 24 11:19:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:19:43.573644 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ad7ad5-65a8-4adf-918a-ee7acbb8e9dd None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:43.606969 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:43.628735 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 78/158] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:19:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 11:19:43.630547 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98005e4-bcf0-4888-9072-ad8e5889bac8 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:43.762243 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ad7ad5-65a8-4adf-918a-ee7acbb8e9dd None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:43.789192 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98005e4-bcf0-4888-9072-ad8e5889bac8 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:43.820469 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9029a2-856a-4523-8e3f-93de03751c4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:43.821116 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9029a2-856a-4523-8e3f-93de03751c4b None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:43.821384 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9029a2-856a-4523-8e3f-93de03751c4b None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:43.821716 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9029a2-856a-4523-8e3f-93de03751c4b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:43.842163 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9029a2-856a-4523-8e3f-93de03751c4b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:19:43.847531 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-2d9029a2-856a-4523-8e3f-93de03751c4b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 11:19:43.847531 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:19:43.847531 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:19:43.847531 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:19:43.847531 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:19:43.847531 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:19:43.847531 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:19:43.847531 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:19:43.847531 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:19:43.847531 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:19:43.847531 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:19:43.847531 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:19:43.847531 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:19:43.847531 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:19:43.847531 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:19:43.847531 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:19:43.848645 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:19:43.848645 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:19:43.848645 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:19:43.848645 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:19:43.848645 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:19:43.848645 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:19:43.848645 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:19:43.848645 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:19:43.848645 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:19:43.848645 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:19:43.848645 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:19:43.848645 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Aug 24 11:19:43.848645 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:19:43.848645 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:19:43.848645 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:19:43.848645 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:19:43.849517 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:19:43.849517 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:19:43.849517 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:19:43.849517 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:19:43.849517 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:19:43.849517 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:19:43.849517 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:19:43.849517 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:19:43.849517 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:19:43.849517 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:19:43.849517 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 11:19:43.849517 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:19:43.849517 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 81/159] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 24 11:19:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:19:43.852405 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9029a2-856a-4523-8e3f-93de03751c4b None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:43.856188 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f75351d-a286-414c-9ed2-7e96e97473ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:43.857089 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f75351d-a286-414c-9ed2-7e96e97473ca None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:43.857565 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f75351d-a286-414c-9ed2-7e96e97473ca None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:43.858040 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f75351d-a286-414c-9ed2-7e96e97473ca None admin] PATH_INFO: `/v3/users/46203446b8ea4ef7b7610bda424e8775` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:43.863788 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f75351d-a286-414c-9ed2-7e96e97473ca None admin] RBAC: Authorizing `identity:get_user(user_id=46203446b8ea4ef7b7610bda424e8775)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:19:43.865536 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f75351d-a286-414c-9ed2-7e96e97473ca None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:19:43.867708 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 79/160] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Aug 24 11:19:43 2022] GET /identity/v3/users/46203446b8ea4ef7b7610bda424e8775 => generated 275 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:19:43.868791 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f75351d-a286-414c-9ed2-7e96e97473ca None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:43.897935 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:43.989256 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9029a2-856a-4523-8e3f-93de03751c4b None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:43.994721 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:44.046583 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c65ad50-f5dc-4730-92a5-fc24e411d981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:44.047144 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c65ad50-f5dc-4730-92a5-fc24e411d981 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:44.047420 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c65ad50-f5dc-4730-92a5-fc24e411d981 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:44.047688 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c65ad50-f5dc-4730-92a5-fc24e411d981 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:44.062257 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f75351d-a286-414c-9ed2-7e96e97473ca None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:44.065202 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c65ad50-f5dc-4730-92a5-fc24e411d981 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:19:44.070551 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-2c65ad50-f5dc-4730-92a5-fc24e411d981 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 11:19:44.070551 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:19:44.070551 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:19:44.070551 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:19:44.070551 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:19:44.070551 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:19:44.070551 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:19:44.070551 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:19:44.070551 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:19:44.070551 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:19:44.070551 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:19:44.070551 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:19:44.070551 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:19:44.070551 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:19:44.070551 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:19:44.070551 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:19:44.071503 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:19:44.071503 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:19:44.071503 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:19:44.071503 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:19:44.071503 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:19:44.071503 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:19:44.071503 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:19:44.071503 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:19:44.071503 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:19:44.071503 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:19:44.071503 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:19:44.071503 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Aug 24 11:19:44.071503 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:19:44.071503 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:19:44.071503 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:19:44.071503 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:19:44.072315 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:19:44.072315 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:19:44.072315 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:19:44.072315 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:19:44.072315 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:19:44.072315 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:19:44.072315 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:19:44.072315 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:19:44.072315 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:19:44.072315 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:19:44.072315 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 11:19:44.072315 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:19:44.072315 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 82/161] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Aug 24 11:19:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 11:19:44.072962 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c65ad50-f5dc-4730-92a5-fc24e411d981 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:44.137105 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b83c28-6efd-48c6-a0c9-f0e116402d05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:44.138341 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b83c28-6efd-48c6-a0c9-f0e116402d05 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:44.138646 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b83c28-6efd-48c6-a0c9-f0e116402d05 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:44.139079 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b83c28-6efd-48c6-a0c9-f0e116402d05 None admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:44.139780 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b83c28-6efd-48c6-a0c9-f0e116402d05 None admin] RBAC: Adding query filter params (name=member) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:19:44.140132 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b83c28-6efd-48c6-a0c9-f0e116402d05 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:19:44.141604 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b83c28-6efd-48c6-a0c9-f0e116402d05 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:19:44.155041 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 80/162] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Aug 24 11:19:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:19:44.156153 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b83c28-6efd-48c6-a0c9-f0e116402d05 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:44.293894 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b83c28-6efd-48c6-a0c9-f0e116402d05 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:44.334751 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:44.346714 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:44.359588 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c65ad50-f5dc-4730-92a5-fc24e411d981 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:44.381679 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31f8126-8a9c-4d7d-8070-34403d09a7d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:44.382321 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31f8126-8a9c-4d7d-8070-34403d09a7d3 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:44.382619 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31f8126-8a9c-4d7d-8070-34403d09a7d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:44.382884 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31f8126-8a9c-4d7d-8070-34403d09a7d3 None admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:44.383641 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31f8126-8a9c-4d7d-8070-34403d09a7d3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:19:44.383940 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31f8126-8a9c-4d7d-8070-34403d09a7d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:19:44.385340 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31f8126-8a9c-4d7d-8070-34403d09a7d3 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:19:44.408762 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 81/163] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 24 11:19:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:19:44.411766 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31f8126-8a9c-4d7d-8070-34403d09a7d3 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:44.450214 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259d3396-3e79-475b-a931-00012c952b82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:44.450856 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259d3396-3e79-475b-a931-00012c952b82 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:44.451137 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259d3396-3e79-475b-a931-00012c952b82 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:44.451400 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259d3396-3e79-475b-a931-00012c952b82 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:44.615492 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259d3396-3e79-475b-a931-00012c952b82 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:19:44.616920 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259d3396-3e79-475b-a931-00012c952b82 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:19:44.665814 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31f8126-8a9c-4d7d-8070-34403d09a7d3 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:44.760027 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cad646-57ef-41e2-b2b1-3000dddca79d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:44.760675 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cad646-57ef-41e2-b2b1-3000dddca79d None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:44.760945 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cad646-57ef-41e2-b2b1-3000dddca79d None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:44.761207 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cad646-57ef-41e2-b2b1-3000dddca79d None admin] PATH_INFO: `/v3/users/46203446b8ea4ef7b7610bda424e8775` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:44.763449 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cad646-57ef-41e2-b2b1-3000dddca79d None admin] RBAC: Authorizing `identity:get_user(user_id=46203446b8ea4ef7b7610bda424e8775)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:19:44.765745 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cad646-57ef-41e2-b2b1-3000dddca79d None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:19:44.770075 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 82/164] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Aug 24 11:19:44 2022] GET /identity/v3/users/46203446b8ea4ef7b7610bda424e8775 => generated 275 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:19:44.777610 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cad646-57ef-41e2-b2b1-3000dddca79d None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:44.842662 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:44.867291 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 83/165] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 24 11:19:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 795 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 11:19:44.875231 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259d3396-3e79-475b-a931-00012c952b82 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:44.903383 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:45.007580 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cad646-57ef-41e2-b2b1-3000dddca79d None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:45.053101 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259d3396-3e79-475b-a931-00012c952b82 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:45.076537 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b16f9d-1e75-49c9-8f90-d0037b01a62f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:45.077177 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b16f9d-1e75-49c9-8f90-d0037b01a62f None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:45.077449 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b16f9d-1e75-49c9-8f90-d0037b01a62f None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:45.077715 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b16f9d-1e75-49c9-8f90-d0037b01a62f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:45.099604 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b16f9d-1e75-49c9-8f90-d0037b01a62f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:19:45.105142 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-16b16f9d-1e75-49c9-8f90-d0037b01a62f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 11:19:45.105142 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:19:45.105142 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:19:45.105142 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:19:45.105142 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:19:45.105142 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:19:45.105142 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:19:45.105142 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:19:45.105142 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:19:45.105142 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:19:45.105142 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:19:45.105142 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:19:45.105142 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:19:45.105142 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:19:45.105142 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:19:45.105142 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:19:45.106011 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:19:45.106011 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:19:45.106011 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:19:45.106011 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:19:45.106011 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:19:45.106011 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:19:45.106011 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:19:45.106011 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:19:45.106011 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:19:45.106011 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:19:45.106011 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:19:45.106011 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Aug 24 11:19:45.106011 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:19:45.106011 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:19:45.106011 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:19:45.106011 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:19:45.106886 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:19:45.106886 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:19:45.106886 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:19:45.106886 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:19:45.106886 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:19:45.106886 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:19:45.106886 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:19:45.106886 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:19:45.106886 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:19:45.106886 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:19:45.106886 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 11:19:45.106886 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Aug 24 11:19:45.117771 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 83/166] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 24 11:19:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 338 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:19:45.117771 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b16f9d-1e75-49c9-8f90-d0037b01a62f None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:45.140602 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56e7f98-0bc8-4986-a076-0e044b075a18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:45.141260 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56e7f98-0bc8-4986-a076-0e044b075a18 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:45.141528 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56e7f98-0bc8-4986-a076-0e044b075a18 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:45.141789 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56e7f98-0bc8-4986-a076-0e044b075a18 None admin] PATH_INFO: `/v3/users/1e2e9ab325dc4dbf92dd6b59db4a0945` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:45.144723 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56e7f98-0bc8-4986-a076-0e044b075a18 None admin] RBAC: Authorizing `identity:get_user(user_id=1e2e9ab325dc4dbf92dd6b59db4a0945)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:19:45.146374 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56e7f98-0bc8-4986-a076-0e044b075a18 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:19:45.148024 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 84/167] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Aug 24 11:19:44 2022] GET /identity/v3/users/1e2e9ab325dc4dbf92dd6b59db4a0945 => generated 247 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:19:45.148870 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56e7f98-0bc8-4986-a076-0e044b075a18 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:45.270642 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:45.337664 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b16f9d-1e75-49c9-8f90-d0037b01a62f None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:45.349730 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56e7f98-0bc8-4986-a076-0e044b075a18 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:45.353035 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:45.402768 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62516b91-41d6-4640-8ebc-66333b9054f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:45.403347 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62516b91-41d6-4640-8ebc-66333b9054f9 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:45.403616 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62516b91-41d6-4640-8ebc-66333b9054f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:45.403874 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62516b91-41d6-4640-8ebc-66333b9054f9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:45.418067 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9c256e-2ba9-4bb2-8556-b6a38f2824a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:45.418730 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9c256e-2ba9-4bb2-8556-b6a38f2824a6 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:45.419002 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9c256e-2ba9-4bb2-8556-b6a38f2824a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:45.419267 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9c256e-2ba9-4bb2-8556-b6a38f2824a6 None admin] PATH_INFO: `/v3/projects/71e3821279484b7087ded02a637ad206` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:45.420417 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9c256e-2ba9-4bb2-8556-b6a38f2824a6 None admin] RBAC: Authorizing `identity:get_project(project_id=71e3821279484b7087ded02a637ad206)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:19:45.421885 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9c256e-2ba9-4bb2-8556-b6a38f2824a6 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:19:45.423553 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 85/168] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Aug 24 11:19:45 2022] GET /identity/v3/projects/71e3821279484b7087ded02a637ad206 => generated 298 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:19:45.426486 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9c256e-2ba9-4bb2-8556-b6a38f2824a6 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:45.544017 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9c256e-2ba9-4bb2-8556-b6a38f2824a6 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:45.566038 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62516b91-41d6-4640-8ebc-66333b9054f9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:19:45.571791 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62516b91-41d6-4640-8ebc-66333b9054f9 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:19:45.606714 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:45.621779 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa2cd23-aab0-4561-b7a1-5148b961596e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:45.622473 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa2cd23-aab0-4561-b7a1-5148b961596e None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:45.622750 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa2cd23-aab0-4561-b7a1-5148b961596e None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:45.623017 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa2cd23-aab0-4561-b7a1-5148b961596e None admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:45.625615 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa2cd23-aab0-4561-b7a1-5148b961596e None admin] RBAC: Adding query filter params (name=member) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:19:45.625922 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa2cd23-aab0-4561-b7a1-5148b961596e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:19:45.627415 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa2cd23-aab0-4561-b7a1-5148b961596e None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:19:45.645428 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 86/169] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Aug 24 11:19:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:19:45.647151 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa2cd23-aab0-4561-b7a1-5148b961596e None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:45.761074 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 84/170] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 24 11:19:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 652 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 11:19:45.761838 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62516b91-41d6-4640-8ebc-66333b9054f9 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:45.782719 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:45.825414 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa2cd23-aab0-4561-b7a1-5148b961596e None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:45.868358 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb43dce-d32f-478f-a1ed-2b8e3ce93f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:45.869228 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb43dce-d32f-478f-a1ed-2b8e3ce93f65 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:45.869500 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb43dce-d32f-478f-a1ed-2b8e3ce93f65 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:45.869798 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb43dce-d32f-478f-a1ed-2b8e3ce93f65 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:45.891878 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62516b91-41d6-4640-8ebc-66333b9054f9 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:45.933030 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f297e10a-70d0-493a-8e49-e53f4f967a7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:45.933816 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f297e10a-70d0-493a-8e49-e53f4f967a7e None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:45.934086 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f297e10a-70d0-493a-8e49-e53f4f967a7e None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:45.934667 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f297e10a-70d0-493a-8e49-e53f4f967a7e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:45.935420 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f297e10a-70d0-493a-8e49-e53f4f967a7e None admin] RBAC: Adding query filter params (role.id=96f07e9110194606acccfbd8467649a7, scope.project.id=71e3821279484b7087ded02a637ad206, user.id=46203446b8ea4ef7b7610bda424e8775) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:19:45.935720 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f297e10a-70d0-493a-8e49-e53f4f967a7e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:19:45.937194 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f297e10a-70d0-493a-8e49-e53f4f967a7e None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:19:45.941116 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:45.945511 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 85/171] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Aug 24 11:19:45 2022] GET /identity/v3/role_assignments?user.id=46203446b8ea4ef7b7610bda424e8775&scope.project.id=71e3821279484b7087ded02a637ad206&role.id=96f07e9110194606acccfbd8467649a7 => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:19:45.947466 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146b2609-18e8-46c3-bc2b-24afc37f3344 None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:45.947790 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146b2609-18e8-46c3-bc2b-24afc37f3344 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:45.948058 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146b2609-18e8-46c3-bc2b-24afc37f3344 None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:45.949603 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 86/172] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:19:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:19:45.950682 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146b2609-18e8-46c3-bc2b-24afc37f3344 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:45.963317 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb43dce-d32f-478f-a1ed-2b8e3ce93f65 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:19:45.964916 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb43dce-d32f-478f-a1ed-2b8e3ce93f65 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:19:46.049155 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:46.081150 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 87/173] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 24 11:19:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 11:19:46.082211 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb43dce-d32f-478f-a1ed-2b8e3ce93f65 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:46.098842 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146b2609-18e8-46c3-bc2b-24afc37f3344 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:46.138706 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31342157-20c9-46c2-a8e2-41b80e9d998f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:46.139064 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31342157-20c9-46c2-a8e2-41b80e9d998f None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:46.139281 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31342157-20c9-46c2-a8e2-41b80e9d998f None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:46.139539 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31342157-20c9-46c2-a8e2-41b80e9d998f None admin] PATH_INFO: `/v3/users/46203446b8ea4ef7b7610bda424e8775` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:46.140711 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31342157-20c9-46c2-a8e2-41b80e9d998f None admin] RBAC: Authorizing `identity:get_user(user_id=46203446b8ea4ef7b7610bda424e8775)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:19:46.142181 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31342157-20c9-46c2-a8e2-41b80e9d998f None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:19:46.143798 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 87/174] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Aug 24 11:19:45 2022] GET /identity/v3/users/46203446b8ea4ef7b7610bda424e8775 => generated 275 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:19:46.145197 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a4402e-b5a2-4b8b-bd56-7e2fc7040a5e None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:46.145474 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a4402e-b5a2-4b8b-bd56-7e2fc7040a5e None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:46.145739 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a4402e-b5a2-4b8b-bd56-7e2fc7040a5e None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:46.146943 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 88/175] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:19:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:19:46.152542 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92eac50-aebc-49cf-b7db-cd879524ee3f None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:46.152819 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92eac50-aebc-49cf-b7db-cd879524ee3f None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:46.153082 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92eac50-aebc-49cf-b7db-cd879524ee3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:46.172016 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-b92eac50-aebc-49cf-b7db-cd879524ee3f None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:19:46.173336 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-b92eac50-aebc-49cf-b7db-cd879524ee3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:19:46.192836 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:46.209281 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb43dce-d32f-478f-a1ed-2b8e3ce93f65 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:46.247442 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1aa9aed-8e98-4b79-b8cc-dcacf1110ff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:46.248081 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aa9aed-8e98-4b79-b8cc-dcacf1110ff1 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:46.248358 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aa9aed-8e98-4b79-b8cc-dcacf1110ff1 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:46.248627 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aa9aed-8e98-4b79-b8cc-dcacf1110ff1 None admin] PATH_INFO: `/v3/projects/71e3821279484b7087ded02a637ad206` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:46.249743 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1aa9aed-8e98-4b79-b8cc-dcacf1110ff1 None admin] RBAC: Authorizing `identity:get_project(project_id=71e3821279484b7087ded02a637ad206)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:19:46.251265 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1aa9aed-8e98-4b79-b8cc-dcacf1110ff1 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:19:46.251362 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 89/176] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:19:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 11:19:46.252733 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cc068d-9edf-4d9a-b23b-e716706a8ffe None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:46.252898 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 88/177] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Aug 24 11:19:46 2022] GET /identity/v3/projects/71e3821279484b7087ded02a637ad206 => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:19:46.253287 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cc068d-9edf-4d9a-b23b-e716706a8ffe None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:46.253594 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cc068d-9edf-4d9a-b23b-e716706a8ffe None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:46.258571 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 90/178] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:19:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:19:46.258571 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cc068d-9edf-4d9a-b23b-e716706a8ffe None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:46.258845 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1aa9aed-8e98-4b79-b8cc-dcacf1110ff1 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:46.340061 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:46.360765 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1aa9aed-8e98-4b79-b8cc-dcacf1110ff1 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:46.378202 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cc068d-9edf-4d9a-b23b-e716706a8ffe None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:46.397585 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92687bf9-0e54-45f6-b038-ac4e90e63f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:46.398221 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92687bf9-0e54-45f6-b038-ac4e90e63f80 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:46.398535 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92687bf9-0e54-45f6-b038-ac4e90e63f80 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:46.398804 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92687bf9-0e54-45f6-b038-ac4e90e63f80 None admin] PATH_INFO: `/v3/projects/71e3821279484b7087ded02a637ad206` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:46.399956 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92687bf9-0e54-45f6-b038-ac4e90e63f80 None admin] RBAC: Authorizing `identity:get_project(project_id=71e3821279484b7087ded02a637ad206)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:19:46.401453 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92687bf9-0e54-45f6-b038-ac4e90e63f80 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:19:46.403459 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 89/179] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Aug 24 11:19:46 2022] GET /identity/v3/projects/71e3821279484b7087ded02a637ad206 => generated 298 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:19:46.404574 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef8e16f-0469-4546-9f93-cb09fe96955c None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:46.404853 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef8e16f-0469-4546-9f93-cb09fe96955c None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:46.405121 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef8e16f-0469-4546-9f93-cb09fe96955c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:46.420252 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3e506a-c9a7-4332-8ca5-56d42e9d2faf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:46.420861 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3e506a-c9a7-4332-8ca5-56d42e9d2faf None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:46.421132 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3e506a-c9a7-4332-8ca5-56d42e9d2faf None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:46.421405 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3e506a-c9a7-4332-8ca5-56d42e9d2faf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:46.423098 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-cef8e16f-0469-4546-9f93-cb09fe96955c None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:19:46.424469 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-cef8e16f-0469-4546-9f93-cb09fe96955c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:19:46.444558 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:46.490884 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3e506a-c9a7-4332-8ca5-56d42e9d2faf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:19:46.492465 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3e506a-c9a7-4332-8ca5-56d42e9d2faf None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:19:46.498087 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 90/180] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:19:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 11:19:46.499602 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe2e946-b48b-4f7c-b4a9-a0c88e498d7c None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:46.500188 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe2e946-b48b-4f7c-b4a9-a0c88e498d7c None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:46.500456 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe2e946-b48b-4f7c-b4a9-a0c88e498d7c None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:46.501701 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 91/181] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:19:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:19:46.502586 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe2e946-b48b-4f7c-b4a9-a0c88e498d7c None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:46.573908 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:46.607927 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe2e946-b48b-4f7c-b4a9-a0c88e498d7c None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:46.608796 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 91/182] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 24 11:19:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 11:19:46.613687 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccfe94c-efc4-4948-a5e4-889b21d5ad78 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:46.613687 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccfe94c-efc4-4948-a5e4-889b21d5ad78 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:46.613687 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccfe94c-efc4-4948-a5e4-889b21d5ad78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:46.627735 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-7ccfe94c-efc4-4948-a5e4-889b21d5ad78 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:19:46.629012 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-7ccfe94c-efc4-4948-a5e4-889b21d5ad78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:19:46.647738 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ea5d4c-0d15-4387-a71e-e83627829b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:46.648346 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ea5d4c-0d15-4387-a71e-e83627829b42 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:46.648723 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ea5d4c-0d15-4387-a71e-e83627829b42 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:46.649147 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ea5d4c-0d15-4387-a71e-e83627829b42 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:46.650122 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ea5d4c-0d15-4387-a71e-e83627829b42 None admin] RBAC: Adding query filter params (role.id=27e3e65e24df4b86b0d3d18d3212101d, scope.project.id=71e3821279484b7087ded02a637ad206, user.id=46203446b8ea4ef7b7610bda424e8775) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:19:46.650613 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ea5d4c-0d15-4387-a71e-e83627829b42 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:19:46.652712 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ea5d4c-0d15-4387-a71e-e83627829b42 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:19:46.659051 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 92/183] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Aug 24 11:19:46 2022] GET /identity/v3/role_assignments?user.id=46203446b8ea4ef7b7610bda424e8775&scope.project.id=71e3821279484b7087ded02a637ad206&role.id=27e3e65e24df4b86b0d3d18d3212101d => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:19:46.660030 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ea5d4c-0d15-4387-a71e-e83627829b42 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:46.684207 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:46.729675 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 92/184] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:19:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 11:19:46.732123 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56557890-ff99-4ad7-a7e8-15da6a9ba128 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:46.732404 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56557890-ff99-4ad7-a7e8-15da6a9ba128 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:46.732675 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56557890-ff99-4ad7-a7e8-15da6a9ba128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:46.758024 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-56557890-ff99-4ad7-a7e8-15da6a9ba128 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:19:46.759589 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-56557890-ff99-4ad7-a7e8-15da6a9ba128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:19:46.783464 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ea5d4c-0d15-4387-a71e-e83627829b42 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:46.826108 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffd6657-be80-449d-bb05-5d625ab63cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:46.826998 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffd6657-be80-449d-bb05-5d625ab63cda None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:46.827277 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffd6657-be80-449d-bb05-5d625ab63cda None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:46.827540 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffd6657-be80-449d-bb05-5d625ab63cda None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:46.828288 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffd6657-be80-449d-bb05-5d625ab63cda None admin] RBAC: Adding query filter params (role.id=30bb1e97257f4ca5b90c88545777317b, scope.project.id=71e3821279484b7087ded02a637ad206, user.id=1e2e9ab325dc4dbf92dd6b59db4a0945) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:19:46.828591 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffd6657-be80-449d-bb05-5d625ab63cda None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:19:46.830078 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffd6657-be80-449d-bb05-5d625ab63cda None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:19:46.836393 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 93/185] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Aug 24 11:19:46 2022] GET /identity/v3/role_assignments?user.id=1e2e9ab325dc4dbf92dd6b59db4a0945&scope.project.id=71e3821279484b7087ded02a637ad206&role.id=30bb1e97257f4ca5b90c88545777317b => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:19:46.837181 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffd6657-be80-449d-bb05-5d625ab63cda None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:46.852781 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 93/186] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:19:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 11:19:46.853593 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56557890-ff99-4ad7-a7e8-15da6a9ba128 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:46.897025 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:46.945355 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:46.965282 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffd6657-be80-449d-bb05-5d625ab63cda None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:46.976418 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56557890-ff99-4ad7-a7e8-15da6a9ba128 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:47.006752 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3099ca70-aae6-49ea-938a-96be4a3ee931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:47.007408 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3099ca70-aae6-49ea-938a-96be4a3ee931 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:47.007682 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3099ca70-aae6-49ea-938a-96be4a3ee931 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:47.007950 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3099ca70-aae6-49ea-938a-96be4a3ee931 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:47.022079 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146ca874-df64-4e69-8160-426148183179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:47.022808 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146ca874-df64-4e69-8160-426148183179 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:47.023083 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146ca874-df64-4e69-8160-426148183179 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:47.023351 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146ca874-df64-4e69-8160-426148183179 None admin] PATH_INFO: `/v3/projects/e41389802363424fa838e3fd74da8717` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:47.025774 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146ca874-df64-4e69-8160-426148183179 None admin] RBAC: Authorizing `identity:get_project(project_id=e41389802363424fa838e3fd74da8717)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:19:47.030170 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146ca874-df64-4e69-8160-426148183179 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:19:47.032813 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 94/187] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Aug 24 11:19:46 2022] GET /identity/v3/projects/e41389802363424fa838e3fd74da8717 => generated 312 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:19:47.033616 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146ca874-df64-4e69-8160-426148183179 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:47.035217 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3099ca70-aae6-49ea-938a-96be4a3ee931 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:19:47.049207 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-3099ca70-aae6-49ea-938a-96be4a3ee931 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 11:19:47.049207 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:19:47.049207 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:19:47.049207 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:19:47.049207 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:19:47.049207 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:19:47.049207 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:19:47.049207 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:19:47.049207 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:19:47.049207 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:19:47.049207 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:19:47.049207 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:19:47.049207 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:19:47.049207 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:19:47.049207 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:19:47.049207 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:19:47.050168 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:19:47.050168 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:19:47.050168 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:19:47.050168 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:19:47.050168 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:19:47.050168 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:19:47.050168 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:19:47.050168 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:19:47.050168 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:19:47.050168 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:19:47.050168 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:19:47.050168 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Aug 24 11:19:47.050168 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:19:47.050168 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:19:47.050168 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:19:47.050168 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:19:47.051083 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:19:47.051083 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:19:47.051083 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:19:47.051083 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:19:47.051083 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:19:47.051083 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:19:47.051083 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:19:47.051083 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:19:47.051083 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:19:47.051083 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:19:47.051083 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 11:19:47.051083 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:19:47.051083 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 94/188] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Aug 24 11:19:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:19:47.051746 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3099ca70-aae6-49ea-938a-96be4a3ee931 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:47.195061 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3099ca70-aae6-49ea-938a-96be4a3ee931 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:47.204651 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:47.209928 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146ca874-df64-4e69-8160-426148183179 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:47.235382 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfc76d5-ba44-4378-8dca-514ca0d3328a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:47.236005 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfc76d5-ba44-4378-8dca-514ca0d3328a None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:47.236288 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfc76d5-ba44-4378-8dca-514ca0d3328a None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:47.236555 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfc76d5-ba44-4378-8dca-514ca0d3328a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:47.237309 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfc76d5-ba44-4378-8dca-514ca0d3328a None admin] RBAC: Adding query filter params (role.id=27e3e65e24df4b86b0d3d18d3212101d, scope.project.id=e41389802363424fa838e3fd74da8717, user.id=46203446b8ea4ef7b7610bda424e8775) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:19:47.237627 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfc76d5-ba44-4378-8dca-514ca0d3328a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:19:47.239322 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfc76d5-ba44-4378-8dca-514ca0d3328a None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:19:47.245337 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 95/189] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Aug 24 11:19:47 2022] GET /identity/v3/role_assignments?user.id=46203446b8ea4ef7b7610bda424e8775&scope.project.id=e41389802363424fa838e3fd74da8717&role.id=27e3e65e24df4b86b0d3d18d3212101d => generated 608 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:19:47.245946 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfc76d5-ba44-4378-8dca-514ca0d3328a None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:47.253056 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0256ce-3b85-4686-87d8-8110786cefa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:47.253900 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0256ce-3b85-4686-87d8-8110786cefa5 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:47.254176 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0256ce-3b85-4686-87d8-8110786cefa5 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:47.254479 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0256ce-3b85-4686-87d8-8110786cefa5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:47.260329 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:47.267379 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0256ce-3b85-4686-87d8-8110786cefa5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:19:47.273625 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-db0256ce-3b85-4686-87d8-8110786cefa5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 11:19:47.273625 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:19:47.273625 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:19:47.273625 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:19:47.273625 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:19:47.273625 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:19:47.273625 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:19:47.273625 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:19:47.273625 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:19:47.273625 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:19:47.273625 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:19:47.273625 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:19:47.273625 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:19:47.273625 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:19:47.273625 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:19:47.273625 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:19:47.274644 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:19:47.274644 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:19:47.274644 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:19:47.274644 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:19:47.274644 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:19:47.274644 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:19:47.274644 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:19:47.274644 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:19:47.274644 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:19:47.274644 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:19:47.274644 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:19:47.274644 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Aug 24 11:19:47.274644 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:19:47.274644 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:19:47.274644 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:19:47.274644 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:19:47.275430 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:19:47.275430 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:19:47.275430 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:19:47.275430 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:19:47.275430 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:19:47.275430 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:19:47.275430 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:19:47.275430 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:19:47.275430 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:19:47.275430 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:19:47.275430 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 11:19:47.275430 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Aug 24 11:19:47.275430 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 95/190] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 24 11:19:47 2022] GET /identity/v3/roles/reader => generated 84 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:19:47.276122 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0256ce-3b85-4686-87d8-8110786cefa5 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:47.370675 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfc76d5-ba44-4378-8dca-514ca0d3328a None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:47.392321 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0256ce-3b85-4686-87d8-8110786cefa5 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:47.413643 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab98be7-011f-4084-b66b-34250a75ebab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:47.414275 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab98be7-011f-4084-b66b-34250a75ebab None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:47.415603 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab98be7-011f-4084-b66b-34250a75ebab None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:47.415603 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab98be7-011f-4084-b66b-34250a75ebab None admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:47.415603 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab98be7-011f-4084-b66b-34250a75ebab None admin] RBAC: Adding query filter params (name=admin) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:19:47.415825 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab98be7-011f-4084-b66b-34250a75ebab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:19:47.417997 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab98be7-011f-4084-b66b-34250a75ebab None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:19:47.428713 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 96/191] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 24 11:19:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:19:47.429844 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab98be7-011f-4084-b66b-34250a75ebab None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:47.436666 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e0adaf-a002-44f0-82b5-11986c6ead01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:47.437308 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e0adaf-a002-44f0-82b5-11986c6ead01 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:47.437587 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e0adaf-a002-44f0-82b5-11986c6ead01 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:47.437853 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e0adaf-a002-44f0-82b5-11986c6ead01 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:47.439095 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e0adaf-a002-44f0-82b5-11986c6ead01 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:19:47.441196 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e0adaf-a002-44f0-82b5-11986c6ead01 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:19:47.443191 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 96/192] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 11:19:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:19:47.444281 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e0adaf-a002-44f0-82b5-11986c6ead01 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:47.480164 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:47.507885 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:47.542412 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab98be7-011f-4084-b66b-34250a75ebab None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:47.554027 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e0adaf-a002-44f0-82b5-11986c6ead01 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:47.575605 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f07be62-5025-4d17-8d51-2017ec50eaf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:47.576236 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f07be62-5025-4d17-8d51-2017ec50eaf2 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:47.576509 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f07be62-5025-4d17-8d51-2017ec50eaf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:47.576784 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f07be62-5025-4d17-8d51-2017ec50eaf2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:47.586671 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f07be62-5025-4d17-8d51-2017ec50eaf2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:19:47.587131 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acf2e8b-e066-4cde-9a38-689614f7ca0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:47.587728 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acf2e8b-e066-4cde-9a38-689614f7ca0e None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:47.588002 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acf2e8b-e066-4cde-9a38-689614f7ca0e None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:47.588266 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acf2e8b-e066-4cde-9a38-689614f7ca0e None admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:47.588923 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acf2e8b-e066-4cde-9a38-689614f7ca0e None admin] RBAC: Adding query filter params (name=reader) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:19:47.589215 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acf2e8b-e066-4cde-9a38-689614f7ca0e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:19:47.590620 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acf2e8b-e066-4cde-9a38-689614f7ca0e None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:19:47.591813 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-8f07be62-5025-4d17-8d51-2017ec50eaf2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 11:19:47.591813 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:19:47.591813 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:19:47.591813 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:19:47.591813 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:19:47.591813 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:19:47.591813 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:19:47.591813 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:19:47.591813 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:19:47.591813 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:19:47.591813 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:19:47.591813 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:19:47.591813 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:19:47.591813 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:19:47.591813 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:19:47.591813 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:19:47.592667 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:19:47.592667 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:19:47.592667 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:19:47.592667 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:19:47.592667 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:19:47.592667 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:19:47.592667 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:19:47.592667 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:19:47.592667 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:19:47.592667 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:19:47.592667 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:19:47.592667 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Aug 24 11:19:47.592667 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:19:47.592667 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:19:47.592667 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:19:47.592667 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:19:47.593462 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:19:47.593462 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:19:47.593462 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:19:47.593462 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:19:47.593462 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:19:47.593462 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:19:47.593462 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:19:47.593462 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:19:47.593462 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:19:47.593462 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:19:47.593462 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 11:19:47.593462 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:19:47.593462 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 97/193] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Aug 24 11:19:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:19:47.594117 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f07be62-5025-4d17-8d51-2017ec50eaf2 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:47.601677 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 97/194] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Aug 24 11:19:47 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:19:47.603150 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acf2e8b-e066-4cde-9a38-689614f7ca0e None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:47.690673 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:47.703000 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acf2e8b-e066-4cde-9a38-689614f7ca0e None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:47.705221 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f07be62-5025-4d17-8d51-2017ec50eaf2 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:47.730250 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:47.736549 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a32ba9f-39f9-40a1-9768-4b7076ebdc01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:47.737183 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a32ba9f-39f9-40a1-9768-4b7076ebdc01 None admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:47.737465 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a32ba9f-39f9-40a1-9768-4b7076ebdc01 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:47.737737 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a32ba9f-39f9-40a1-9768-4b7076ebdc01 None admin] PATH_INFO: `/v3/users` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:47.738067 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2e2edc-b0de-4ccc-8e2c-d3779e34f6f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:47.738537 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a32ba9f-39f9-40a1-9768-4b7076ebdc01 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:19:47.738723 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2e2edc-b0de-4ccc-8e2c-d3779e34f6f5 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:47.738999 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2e2edc-b0de-4ccc-8e2c-d3779e34f6f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:47.739268 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2e2edc-b0de-4ccc-8e2c-d3779e34f6f5 None admin] PATH_INFO: `/v3/users/dcf7b72d01a048f18cdbf939d000fad2` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:47.740286 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a32ba9f-39f9-40a1-9768-4b7076ebdc01 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:19:47.752672 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2e2edc-b0de-4ccc-8e2c-d3779e34f6f5 None admin] RBAC: Authorizing `identity:get_user(user_id=dcf7b72d01a048f18cdbf939d000fad2)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:19:47.754126 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2e2edc-b0de-4ccc-8e2c-d3779e34f6f5 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:19:47.755803 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 98/195] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Aug 24 11:19:47 2022] GET /identity/v3/users/dcf7b72d01a048f18cdbf939d000fad2 => generated 283 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:19:47.756566 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2e2edc-b0de-4ccc-8e2c-d3779e34f6f5 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:47.764513 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 98/196] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Aug 24 11:19:47 2022] POST /identity/v3/users => generated 297 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:19:47.765730 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a32ba9f-39f9-40a1-9768-4b7076ebdc01 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:47.869463 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2e2edc-b0de-4ccc-8e2c-d3779e34f6f5 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:47.886406 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a32ba9f-39f9-40a1-9768-4b7076ebdc01 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:47.906693 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2f7670-e710-4a68-827f-f7455d12a9c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:47.907308 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2f7670-e710-4a68-827f-f7455d12a9c1 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:47.907650 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2f7670-e710-4a68-827f-f7455d12a9c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:47.907831 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2f7670-e710-4a68-827f-f7455d12a9c1 None admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:47.908502 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2f7670-e710-4a68-827f-f7455d12a9c1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:19:47.908796 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2f7670-e710-4a68-827f-f7455d12a9c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:19:47.910264 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2f7670-e710-4a68-827f-f7455d12a9c1 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:19:47.920307 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 99/197] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Aug 24 11:19:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:19:47.921037 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2f7670-e710-4a68-827f-f7455d12a9c1 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:47.924412 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169eb4da-fe77-486d-8a33-c9a73aad0d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:47.925240 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169eb4da-fe77-486d-8a33-c9a73aad0d5f None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:47.925390 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169eb4da-fe77-486d-8a33-c9a73aad0d5f None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:47.925701 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169eb4da-fe77-486d-8a33-c9a73aad0d5f None admin] PATH_INFO: `/v3/users/2552ab86c1ab42ae815425f049c872c5` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:47.926872 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169eb4da-fe77-486d-8a33-c9a73aad0d5f None admin] RBAC: Authorizing `identity:get_user(user_id=2552ab86c1ab42ae815425f049c872c5)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:19:47.928329 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169eb4da-fe77-486d-8a33-c9a73aad0d5f None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:19:47.929925 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 99/198] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Aug 24 11:19:47 2022] GET /identity/v3/users/2552ab86c1ab42ae815425f049c872c5 => generated 289 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:19:47.934433 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169eb4da-fe77-486d-8a33-c9a73aad0d5f None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:47.948013 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:47.982810 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:48.054371 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2f7670-e710-4a68-827f-f7455d12a9c1 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:48.087076 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169eb4da-fe77-486d-8a33-c9a73aad0d5f None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:48.111285 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7f42ec-8ac2-439c-8e1b-4f3f543e8f67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:48.112267 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7f42ec-8ac2-439c-8e1b-4f3f543e8f67 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:48.112717 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7f42ec-8ac2-439c-8e1b-4f3f543e8f67 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:48.113219 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7f42ec-8ac2-439c-8e1b-4f3f543e8f67 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:48.153673 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b6c9c0-bf9f-4255-88b2-19b48ffbc2d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:48.154313 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b6c9c0-bf9f-4255-88b2-19b48ffbc2d0 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:48.154750 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b6c9c0-bf9f-4255-88b2-19b48ffbc2d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:48.155042 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b6c9c0-bf9f-4255-88b2-19b48ffbc2d0 None admin] PATH_INFO: `/v3/users/dcf7b72d01a048f18cdbf939d000fad2` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:48.156366 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b6c9c0-bf9f-4255-88b2-19b48ffbc2d0 None admin] RBAC: Authorizing `identity:get_user(user_id=dcf7b72d01a048f18cdbf939d000fad2)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:19:48.158079 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b6c9c0-bf9f-4255-88b2-19b48ffbc2d0 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:19:48.160573 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 100/199] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Aug 24 11:19:47 2022] GET /identity/v3/users/dcf7b72d01a048f18cdbf939d000fad2 => generated 283 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:19:48.161348 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b6c9c0-bf9f-4255-88b2-19b48ffbc2d0 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:48.216057 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7f42ec-8ac2-439c-8e1b-4f3f543e8f67 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:19:48.217837 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7f42ec-8ac2-439c-8e1b-4f3f543e8f67 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:19:48.273442 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:48.303331 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:48.338326 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b6c9c0-bf9f-4255-88b2-19b48ffbc2d0 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:48.342096 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 100/200] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 24 11:19:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 11:19:48.343090 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7f42ec-8ac2-439c-8e1b-4f3f543e8f67 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:48.397984 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fa1c10-1128-4384-b7c7-5dcbbc0e949b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:48.399424 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fa1c10-1128-4384-b7c7-5dcbbc0e949b None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:48.400085 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fa1c10-1128-4384-b7c7-5dcbbc0e949b None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:48.400906 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fa1c10-1128-4384-b7c7-5dcbbc0e949b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:48.459991 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7f42ec-8ac2-439c-8e1b-4f3f543e8f67 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:48.501149 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fa1c10-1128-4384-b7c7-5dcbbc0e949b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:19:48.503166 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fa1c10-1128-4384-b7c7-5dcbbc0e949b None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:19:48.517098 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d53e1c-6139-4e84-b345-3deefd589450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:48.518125 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d53e1c-6139-4e84-b345-3deefd589450 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:48.518646 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d53e1c-6139-4e84-b345-3deefd589450 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:48.519306 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d53e1c-6139-4e84-b345-3deefd589450 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:48.550861 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:48.592723 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:48.614342 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 101/201] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 24 11:19:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 11:19:48.619323 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fa1c10-1128-4384-b7c7-5dcbbc0e949b None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:48.621269 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d53e1c-6139-4e84-b345-3deefd589450 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:19:48.623153 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d53e1c-6139-4e84-b345-3deefd589450 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:19:48.723284 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fa1c10-1128-4384-b7c7-5dcbbc0e949b None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:48.749019 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 101/202] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 24 11:19:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 11:19:48.754956 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d53e1c-6139-4e84-b345-3deefd589450 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:48.768079 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce072979-30e4-4579-bfec-aea060dde700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:48.769185 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce072979-30e4-4579-bfec-aea060dde700 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:48.769466 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce072979-30e4-4579-bfec-aea060dde700 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:48.770020 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce072979-30e4-4579-bfec-aea060dde700 None admin] PATH_INFO: `/v3/projects/d865cccda5444ed685650f098a696d95` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:48.771237 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce072979-30e4-4579-bfec-aea060dde700 None admin] RBAC: Authorizing `identity:get_project(project_id=d865cccda5444ed685650f098a696d95)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:19:48.773477 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce072979-30e4-4579-bfec-aea060dde700 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:19:48.775748 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 102/203] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Aug 24 11:19:48 2022] GET /identity/v3/projects/d865cccda5444ed685650f098a696d95 => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:19:48.776595 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce072979-30e4-4579-bfec-aea060dde700 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:48.816043 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:48.846122 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:48.871729 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d53e1c-6139-4e84-b345-3deefd589450 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:48.911031 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59311d4-a3f6-49df-8c20-08b3c3398f0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:48.911678 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59311d4-a3f6-49df-8c20-08b3c3398f0e None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:48.911956 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59311d4-a3f6-49df-8c20-08b3c3398f0e None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:48.912229 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59311d4-a3f6-49df-8c20-08b3c3398f0e None admin] PATH_INFO: `/v3/projects/71e3821279484b7087ded02a637ad206` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:48.913367 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59311d4-a3f6-49df-8c20-08b3c3398f0e None admin] RBAC: Authorizing `identity:get_project(project_id=71e3821279484b7087ded02a637ad206)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:19:48.914895 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59311d4-a3f6-49df-8c20-08b3c3398f0e None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:19:48.921464 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 102/204] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Aug 24 11:19:48 2022] GET /identity/v3/projects/71e3821279484b7087ded02a637ad206 => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:19:48.921464 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59311d4-a3f6-49df-8c20-08b3c3398f0e None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:48.924089 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce072979-30e4-4579-bfec-aea060dde700 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:48.965752 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f883986e-fa7d-4b45-8de3-dfbbd578569d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:48.966659 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f883986e-fa7d-4b45-8de3-dfbbd578569d None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:48.967152 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f883986e-fa7d-4b45-8de3-dfbbd578569d None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:48.967595 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f883986e-fa7d-4b45-8de3-dfbbd578569d None admin] PATH_INFO: `/v3/projects/d865cccda5444ed685650f098a696d95` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:48.970168 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f883986e-fa7d-4b45-8de3-dfbbd578569d None admin] RBAC: Authorizing `identity:get_project(project_id=d865cccda5444ed685650f098a696d95)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:19:48.971927 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f883986e-fa7d-4b45-8de3-dfbbd578569d None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:19:48.973912 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 103/205] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Aug 24 11:19:48 2022] GET /identity/v3/projects/d865cccda5444ed685650f098a696d95 => generated 302 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:19:48.975102 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f883986e-fa7d-4b45-8de3-dfbbd578569d None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:49.030632 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59311d4-a3f6-49df-8c20-08b3c3398f0e None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:49.066238 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:49.071056 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ebc227-aa2f-462e-91b8-f1cce063cac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:49.071626 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ebc227-aa2f-462e-91b8-f1cce063cac8 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:49.071934 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ebc227-aa2f-462e-91b8-f1cce063cac8 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:49.072341 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ebc227-aa2f-462e-91b8-f1cce063cac8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:49.073090 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ebc227-aa2f-462e-91b8-f1cce063cac8 None admin] RBAC: Adding query filter params (role.id=30bb1e97257f4ca5b90c88545777317b, scope.project.id=d865cccda5444ed685650f098a696d95, user.id=dcf7b72d01a048f18cdbf939d000fad2) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:19:49.073402 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ebc227-aa2f-462e-91b8-f1cce063cac8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:19:49.075815 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ebc227-aa2f-462e-91b8-f1cce063cac8 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:19:49.084517 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 103/206] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Aug 24 11:19:48 2022] GET /identity/v3/role_assignments?user.id=dcf7b72d01a048f18cdbf939d000fad2&scope.project.id=d865cccda5444ed685650f098a696d95&role.id=30bb1e97257f4ca5b90c88545777317b => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:19:49.085427 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ebc227-aa2f-462e-91b8-f1cce063cac8 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:49.086111 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f883986e-fa7d-4b45-8de3-dfbbd578569d None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:49.116707 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:49.139510 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e655958a-0560-492c-8b3a-55038176dc48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:49.140560 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e655958a-0560-492c-8b3a-55038176dc48 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:49.141033 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e655958a-0560-492c-8b3a-55038176dc48 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:49.141527 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e655958a-0560-492c-8b3a-55038176dc48 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:49.142546 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e655958a-0560-492c-8b3a-55038176dc48 None admin] RBAC: Adding query filter params (role.id=7b4c8894d4a2493b97242eb334dc9014, scope.project.id=71e3821279484b7087ded02a637ad206, user.id=2552ab86c1ab42ae815425f049c872c5) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:19:49.143066 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e655958a-0560-492c-8b3a-55038176dc48 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:19:49.145199 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e655958a-0560-492c-8b3a-55038176dc48 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:19:49.153868 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 104/207] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Aug 24 11:19:48 2022] GET /identity/v3/role_assignments?user.id=2552ab86c1ab42ae815425f049c872c5&scope.project.id=71e3821279484b7087ded02a637ad206&role.id=7b4c8894d4a2493b97242eb334dc9014 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:19:49.296036 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ebc227-aa2f-462e-91b8-f1cce063cac8 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:49.347444 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef813ed1-e92c-40eb-93be-018304c9e3cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:49.349268 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef813ed1-e92c-40eb-93be-018304c9e3cb None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:49.349268 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef813ed1-e92c-40eb-93be-018304c9e3cb None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:49.349268 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef813ed1-e92c-40eb-93be-018304c9e3cb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:49.349268 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef813ed1-e92c-40eb-93be-018304c9e3cb None admin] RBAC: Adding query filter params (role.id=96f07e9110194606acccfbd8467649a7, scope.project.id=d865cccda5444ed685650f098a696d95, user.id=dcf7b72d01a048f18cdbf939d000fad2) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:19:49.349565 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef813ed1-e92c-40eb-93be-018304c9e3cb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:19:49.351049 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef813ed1-e92c-40eb-93be-018304c9e3cb None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:19:49.363402 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 104/208] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Aug 24 11:19:49 2022] GET /identity/v3/role_assignments?user.id=dcf7b72d01a048f18cdbf939d000fad2&scope.project.id=d865cccda5444ed685650f098a696d95&role.id=96f07e9110194606acccfbd8467649a7 => generated 259 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:19:50.009463 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18750e96-75ff-4f89-8adc-68feae6bb64a None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:50.010028 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18750e96-75ff-4f89-8adc-68feae6bb64a None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:50.010028 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18750e96-75ff-4f89-8adc-68feae6bb64a None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:50.011391 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 105/209] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:19:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:19:50.016868 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64c4e89-8337-4ed8-94f0-a4ae4c6386a5 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:50.017154 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64c4e89-8337-4ed8-94f0-a4ae4c6386a5 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:50.017431 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64c4e89-8337-4ed8-94f0-a4ae4c6386a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:50.037974 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-a64c4e89-8337-4ed8-94f0-a4ae4c6386a5 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:19:50.039218 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-a64c4e89-8337-4ed8-94f0-a4ae4c6386a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:19:50.080916 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:50.109734 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 105/210] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:19:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 11:19:50.168830 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9e20a1-4334-4ec0-88db-344ece783178 None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:50.169484 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9e20a1-4334-4ec0-88db-344ece783178 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:50.169951 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9e20a1-4334-4ec0-88db-344ece783178 None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:50.171639 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 106/211] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:19:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:19:50.178099 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7c5879-53a4-4273-ae39-c2e923bf6f52 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:50.178761 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7c5879-53a4-4273-ae39-c2e923bf6f52 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:50.179231 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7c5879-53a4-4273-ae39-c2e923bf6f52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:50.198219 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-ab7c5879-53a4-4273-ae39-c2e923bf6f52 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:19:50.199732 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-ab7c5879-53a4-4273-ae39-c2e923bf6f52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:19:50.267460 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 106/212] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:19:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 11:19:50.396403 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9e20a1-4334-4ec0-88db-344ece783178 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:50.504928 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9e20a1-4334-4ec0-88db-344ece783178 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:50.542604 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd0d190-a952-4d6f-b0ea-2a218dc3a47c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:50.543236 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd0d190-a952-4d6f-b0ea-2a218dc3a47c None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:50.543518 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd0d190-a952-4d6f-b0ea-2a218dc3a47c None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:50.543789 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd0d190-a952-4d6f-b0ea-2a218dc3a47c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:50.555258 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd0d190-a952-4d6f-b0ea-2a218dc3a47c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:19:50.560227 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-3fd0d190-a952-4d6f-b0ea-2a218dc3a47c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 11:19:50.560227 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:19:50.560227 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:19:50.560227 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:19:50.560227 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:19:50.560227 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:19:50.560227 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:19:50.560227 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:19:50.560227 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:19:50.560227 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:19:50.560227 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:19:50.560227 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:19:50.560227 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:19:50.560227 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:19:50.560227 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:19:50.560227 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:19:50.561094 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:19:50.561094 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:19:50.561094 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:19:50.561094 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:19:50.561094 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:19:50.561094 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:19:50.561094 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:19:50.561094 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:19:50.561094 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:19:50.561094 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:19:50.561094 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:19:50.561094 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Aug 24 11:19:50.561094 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:19:50.561094 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:19:50.561094 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:19:50.561094 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:19:50.561879 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:19:50.561879 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:19:50.561879 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:19:50.561879 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:19:50.561879 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:19:50.561879 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:19:50.561879 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:19:50.561879 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:19:50.561879 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:19:50.561879 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:19:50.561879 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 11:19:50.561879 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Aug 24 11:19:50.561879 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 107/213] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 24 11:19:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:19:50.568706 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7c5879-53a4-4273-ae39-c2e923bf6f52 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:50.577447 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd0d190-a952-4d6f-b0ea-2a218dc3a47c None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:50.632819 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:50.685627 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7c5879-53a4-4273-ae39-c2e923bf6f52 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:50.688328 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:50.704220 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd0d190-a952-4d6f-b0ea-2a218dc3a47c None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:50.727086 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5f775a-b1e0-4b19-a1f7-da26c822c2e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:50.727941 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5f775a-b1e0-4b19-a1f7-da26c822c2e5 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:50.728361 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5f775a-b1e0-4b19-a1f7-da26c822c2e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:50.728790 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5f775a-b1e0-4b19-a1f7-da26c822c2e5 None admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:50.730286 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5f775a-b1e0-4b19-a1f7-da26c822c2e5 None admin] RBAC: Adding query filter params (name=member) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:19:50.731109 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5f775a-b1e0-4b19-a1f7-da26c822c2e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:19:50.733351 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5f775a-b1e0-4b19-a1f7-da26c822c2e5 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:19:50.745001 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 107/214] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Aug 24 11:19:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:19:50.745522 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bcd3f9-f62a-4d84-b42e-d26880ceb6ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:50.746242 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bcd3f9-f62a-4d84-b42e-d26880ceb6ff None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:50.746624 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bcd3f9-f62a-4d84-b42e-d26880ceb6ff None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:50.746959 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bcd3f9-f62a-4d84-b42e-d26880ceb6ff None admin] PATH_INFO: `/v3/domains/default` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:50.748156 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bcd3f9-f62a-4d84-b42e-d26880ceb6ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:19:50.749706 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bcd3f9-f62a-4d84-b42e-d26880ceb6ff None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:19:50.754432 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 108/215] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 11:19:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:19:50.755839 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5f775a-b1e0-4b19-a1f7-da26c822c2e5 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:50.759471 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bcd3f9-f62a-4d84-b42e-d26880ceb6ff None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:50.867778 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5f775a-b1e0-4b19-a1f7-da26c822c2e5 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:50.888486 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bcd3f9-f62a-4d84-b42e-d26880ceb6ff None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:50.900420 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:50.910035 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf42409-53e4-4a92-bdc7-659bc6acb68d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:50.910879 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf42409-53e4-4a92-bdc7-659bc6acb68d None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:50.911159 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf42409-53e4-4a92-bdc7-659bc6acb68d None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:50.911431 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf42409-53e4-4a92-bdc7-659bc6acb68d None admin] PATH_INFO: `/v3/users/5bd9a7bf105d4a6f9bf3a4e537136a19` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:50.925439 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf42409-53e4-4a92-bdc7-659bc6acb68d None admin] RBAC: Authorizing `identity:get_user(user_id=5bd9a7bf105d4a6f9bf3a4e537136a19)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:19:50.927191 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf42409-53e4-4a92-bdc7-659bc6acb68d None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:19:50.929490 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 108/216] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Aug 24 11:19:50 2022] GET /identity/v3/users/5bd9a7bf105d4a6f9bf3a4e537136a19 => generated 297 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:19:50.934672 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228a6fcf-56ae-4900-b97a-cc8b67d443eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:50.935046 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf42409-53e4-4a92-bdc7-659bc6acb68d None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:50.935774 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228a6fcf-56ae-4900-b97a-cc8b67d443eb None admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:50.936331 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228a6fcf-56ae-4900-b97a-cc8b67d443eb None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:50.936789 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228a6fcf-56ae-4900-b97a-cc8b67d443eb None admin] PATH_INFO: `/v3/users` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:50.937736 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228a6fcf-56ae-4900-b97a-cc8b67d443eb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:19:50.939506 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228a6fcf-56ae-4900-b97a-cc8b67d443eb None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:19:50.961110 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:50.966222 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 109/217] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Aug 24 11:19:50 2022] POST /identity/v3/users => generated 297 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:19:50.989296 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a84a31b-c29b-4bbc-9d11-a2e3850f68b2 None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:50.989943 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a84a31b-c29b-4bbc-9d11-a2e3850f68b2 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:50.990477 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a84a31b-c29b-4bbc-9d11-a2e3850f68b2 None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:50.992129 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 110/218] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:19:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 11:19:50.999076 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a61ec0-0ba7-49d3-9105-86d609df8280 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:50.999384 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a61ec0-0ba7-49d3-9105-86d609df8280 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:50.999841 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a61ec0-0ba7-49d3-9105-86d609df8280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:51.024681 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-14a61ec0-0ba7-49d3-9105-86d609df8280 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:19:51.026133 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-14a61ec0-0ba7-49d3-9105-86d609df8280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:19:51.062852 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf42409-53e4-4a92-bdc7-659bc6acb68d None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:51.110398 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74edf9b2-d472-42df-87f3-6bfccff565b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:51.110398 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74edf9b2-d472-42df-87f3-6bfccff565b7 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:51.110398 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74edf9b2-d472-42df-87f3-6bfccff565b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:51.110781 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74edf9b2-d472-42df-87f3-6bfccff565b7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:51.113938 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 111/219] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:19:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 11:19:51.185008 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74edf9b2-d472-42df-87f3-6bfccff565b7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:19:51.186450 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74edf9b2-d472-42df-87f3-6bfccff565b7 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:19:51.212070 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:51.291374 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 109/220] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 24 11:19:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 11:19:51.297041 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a61ec0-0ba7-49d3-9105-86d609df8280 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:51.381181 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74edf9b2-d472-42df-87f3-6bfccff565b7 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:51.418348 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:51.425474 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a61ec0-0ba7-49d3-9105-86d609df8280 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:51.461379 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbcb9e7-ac3f-45b7-8e5d-64ff6702623e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:51.461950 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbcb9e7-ac3f-45b7-8e5d-64ff6702623e None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:51.462225 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbcb9e7-ac3f-45b7-8e5d-64ff6702623e None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:51.462522 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbcb9e7-ac3f-45b7-8e5d-64ff6702623e None admin] PATH_INFO: `/v3/projects/d865cccda5444ed685650f098a696d95` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:51.463684 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbcb9e7-ac3f-45b7-8e5d-64ff6702623e None admin] RBAC: Authorizing `identity:get_project(project_id=d865cccda5444ed685650f098a696d95)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:19:51.465163 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbcb9e7-ac3f-45b7-8e5d-64ff6702623e None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:19:51.466888 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 112/221] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Aug 24 11:19:51 2022] GET /identity/v3/projects/d865cccda5444ed685650f098a696d95 => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:19:51.468044 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ffc5a5-9e2e-494a-9f15-d93bb4172064 None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:51.468353 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ffc5a5-9e2e-494a-9f15-d93bb4172064 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:51.468622 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ffc5a5-9e2e-494a-9f15-d93bb4172064 None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:51.469859 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 113/222] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:19:51 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:19:51.475653 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4c3d6b-95c4-4b22-825d-f399c2bb31a5 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:51.475944 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4c3d6b-95c4-4b22-825d-f399c2bb31a5 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:51.476201 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4c3d6b-95c4-4b22-825d-f399c2bb31a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:51.496208 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-2d4c3d6b-95c4-4b22-825d-f399c2bb31a5 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:19:51.497396 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-2d4c3d6b-95c4-4b22-825d-f399c2bb31a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:19:51.517813 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74edf9b2-d472-42df-87f3-6bfccff565b7 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:51.546849 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:51.559571 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb41532-2f14-403c-91ee-591dffa3c9ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:51.560223 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb41532-2f14-403c-91ee-591dffa3c9ea None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:51.560505 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb41532-2f14-403c-91ee-591dffa3c9ea None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:51.560779 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb41532-2f14-403c-91ee-591dffa3c9ea None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:51.572122 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb41532-2f14-403c-91ee-591dffa3c9ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:19:51.577281 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-acb41532-2f14-403c-91ee-591dffa3c9ea None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 11:19:51.577281 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:19:51.577281 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:19:51.577281 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:19:51.577281 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:19:51.577281 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:19:51.577281 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:19:51.577281 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:19:51.577281 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:19:51.577281 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:19:51.577281 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:19:51.577281 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:19:51.577281 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:19:51.577281 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:19:51.577281 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:19:51.577281 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:19:51.578153 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:19:51.578153 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:19:51.578153 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:19:51.578153 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:19:51.578153 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:19:51.578153 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:19:51.578153 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:19:51.578153 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:19:51.578153 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:19:51.578153 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:19:51.578153 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:19:51.578153 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Aug 24 11:19:51.578153 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:19:51.578153 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:19:51.578153 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:19:51.578153 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:19:51.578982 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:19:51.578982 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:19:51.578982 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:19:51.578982 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:19:51.578982 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:19:51.578982 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:19:51.578982 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:19:51.578982 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:19:51.578982 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:19:51.578982 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:19:51.578982 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 11:19:51.578982 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:19:51.578982 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 110/223] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Aug 24 11:19:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:19:51.579613 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb41532-2f14-403c-91ee-591dffa3c9ea None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:51.591429 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 114/224] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:19:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 11:19:51.593195 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4c3d6b-95c4-4b22-825d-f399c2bb31a5 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:51.707519 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:51.723856 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4c3d6b-95c4-4b22-825d-f399c2bb31a5 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:51.767103 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb41532-2f14-403c-91ee-591dffa3c9ea None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:51.793366 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d41f520-88c1-49d1-b93e-dc4b8364c9a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:51.793982 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d41f520-88c1-49d1-b93e-dc4b8364c9a9 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:51.794253 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d41f520-88c1-49d1-b93e-dc4b8364c9a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:51.794543 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d41f520-88c1-49d1-b93e-dc4b8364c9a9 None admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:51.795221 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d41f520-88c1-49d1-b93e-dc4b8364c9a9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:19:51.795512 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d41f520-88c1-49d1-b93e-dc4b8364c9a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:19:51.796889 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d41f520-88c1-49d1-b93e-dc4b8364c9a9 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:19:51.806684 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 115/225] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 24 11:19:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:19:51.814514 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d41f520-88c1-49d1-b93e-dc4b8364c9a9 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:51.843614 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d248e5b0-3444-4758-9845-b095df145d07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:51.844217 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d248e5b0-3444-4758-9845-b095df145d07 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:51.844489 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d248e5b0-3444-4758-9845-b095df145d07 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:51.844751 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d248e5b0-3444-4758-9845-b095df145d07 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:51.845482 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d248e5b0-3444-4758-9845-b095df145d07 None admin] RBAC: Adding query filter params (role.id=27e3e65e24df4b86b0d3d18d3212101d, scope.project.id=d865cccda5444ed685650f098a696d95, user.id=5bd9a7bf105d4a6f9bf3a4e537136a19) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:19:51.845780 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d248e5b0-3444-4758-9845-b095df145d07 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:19:51.847290 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d248e5b0-3444-4758-9845-b095df145d07 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:19:51.861414 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 111/226] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Aug 24 11:19:51 2022] GET /identity/v3/role_assignments?user.id=5bd9a7bf105d4a6f9bf3a4e537136a19&scope.project.id=d865cccda5444ed685650f098a696d95&role.id=27e3e65e24df4b86b0d3d18d3212101d => generated 259 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:19:51.955684 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d41f520-88c1-49d1-b93e-dc4b8364c9a9 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:51.971093 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d248e5b0-3444-4758-9845-b095df145d07 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:51.999095 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f4dc3e-56b0-4e90-9ab9-236ca357051b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:51.999910 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f4dc3e-56b0-4e90-9ab9-236ca357051b None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:52.000182 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f4dc3e-56b0-4e90-9ab9-236ca357051b None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:52.000855 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f4dc3e-56b0-4e90-9ab9-236ca357051b None admin] PATH_INFO: `/v3/users/dcf7b72d01a048f18cdbf939d000fad2` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:52.002274 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f4dc3e-56b0-4e90-9ab9-236ca357051b None admin] RBAC: Authorizing `identity:get_user(user_id=dcf7b72d01a048f18cdbf939d000fad2)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:19:52.004510 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f4dc3e-56b0-4e90-9ab9-236ca357051b None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:19:52.007417 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 116/227] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Aug 24 11:19:51 2022] GET /identity/v3/users/dcf7b72d01a048f18cdbf939d000fad2 => generated 283 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:19:52.013061 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f4dc3e-56b0-4e90-9ab9-236ca357051b None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:52.032054 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:52.074769 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:52.088574 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d248e5b0-3444-4758-9845-b095df145d07 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:52.124100 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f4dc3e-56b0-4e90-9ab9-236ca357051b None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:52.146209 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5d9b10-abcd-427f-9fae-8428056a1838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:52.146902 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5d9b10-abcd-427f-9fae-8428056a1838 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:52.147183 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5d9b10-abcd-427f-9fae-8428056a1838 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:52.147798 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5d9b10-abcd-427f-9fae-8428056a1838 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:52.161321 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5d9b10-abcd-427f-9fae-8428056a1838 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:19:52.164012 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b831af-45d1-4e46-95be-eb9a8a7d3a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:52.164799 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b831af-45d1-4e46-95be-eb9a8a7d3a2b None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:52.165209 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b831af-45d1-4e46-95be-eb9a8a7d3a2b None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:52.165606 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b831af-45d1-4e46-95be-eb9a8a7d3a2b None admin] PATH_INFO: `/v3/projects/d865cccda5444ed685650f098a696d95` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:52.166913 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b831af-45d1-4e46-95be-eb9a8a7d3a2b None admin] RBAC: Authorizing `identity:get_project(project_id=d865cccda5444ed685650f098a696d95)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:19:52.167410 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-df5d9b10-abcd-427f-9fae-8428056a1838 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 11:19:52.167410 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:19:52.167410 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:19:52.167410 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:19:52.167410 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:19:52.167410 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:19:52.167410 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:19:52.167410 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:19:52.167410 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:19:52.167410 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:19:52.167410 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:19:52.167410 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:19:52.167410 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:19:52.167410 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:19:52.167410 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:19:52.167410 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:19:52.168417 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:19:52.168417 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:19:52.168417 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:19:52.168417 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:19:52.168417 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:19:52.168417 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:19:52.168417 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:19:52.168417 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:19:52.168417 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:19:52.168417 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:19:52.168417 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:19:52.168417 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Aug 24 11:19:52.168417 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:19:52.168417 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:19:52.168417 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:19:52.168417 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:19:52.169258 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:19:52.169258 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:19:52.169258 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:19:52.169258 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:19:52.169258 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:19:52.169258 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:19:52.169258 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:19:52.169258 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:19:52.169258 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:19:52.169258 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:19:52.169258 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 11:19:52.169258 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:19:52.169258 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 112/228] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Aug 24 11:19:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 11:19:52.171175 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b831af-45d1-4e46-95be-eb9a8a7d3a2b None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:19:52.173214 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 117/229] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Aug 24 11:19:52 2022] GET /identity/v3/projects/d865cccda5444ed685650f098a696d95 => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:19:52.179005 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b831af-45d1-4e46-95be-eb9a8a7d3a2b None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:52.179129 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5d9b10-abcd-427f-9fae-8428056a1838 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:52.330923 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:52.340590 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b831af-45d1-4e46-95be-eb9a8a7d3a2b None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:52.370023 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5d9b10-abcd-427f-9fae-8428056a1838 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:52.389849 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:52.404897 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70593ae2-af4d-47af-b253-4faf8aa432a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:52.405650 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70593ae2-af4d-47af-b253-4faf8aa432a7 None admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:52.406006 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70593ae2-af4d-47af-b253-4faf8aa432a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:52.406350 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70593ae2-af4d-47af-b253-4faf8aa432a7 None admin] PATH_INFO: `/v3/projects/d865cccda5444ed685650f098a696d95/users/dcf7b72d01a048f18cdbf939d000fad2/roles/30bb1e97257f4ca5b90c88545777317b` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:52.408525 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70593ae2-af4d-47af-b253-4faf8aa432a7 None admin] RBAC: Authorizing `identity:create_grant(project_id=d865cccda5444ed685650f098a696d95, user_id=dcf7b72d01a048f18cdbf939d000fad2, role_id=30bb1e97257f4ca5b90c88545777317b)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:19:52.410298 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70593ae2-af4d-47af-b253-4faf8aa432a7 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:19:52.422108 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d00ec19-9837-4cf0-bf25-9a39a2c9521e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:52.423117 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d00ec19-9837-4cf0-bf25-9a39a2c9521e None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:52.423582 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d00ec19-9837-4cf0-bf25-9a39a2c9521e None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:52.424119 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d00ec19-9837-4cf0-bf25-9a39a2c9521e None admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:52.425097 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d00ec19-9837-4cf0-bf25-9a39a2c9521e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:19:52.425659 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d00ec19-9837-4cf0-bf25-9a39a2c9521e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:19:52.427401 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d00ec19-9837-4cf0-bf25-9a39a2c9521e None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:19:52.433359 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 118/230] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Aug 24 11:19:52 2022] PUT /identity/v3/projects/d865cccda5444ed685650f098a696d95/users/dcf7b72d01a048f18cdbf939d000fad2/roles/30bb1e97257f4ca5b90c88545777317b => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:19:52.440632 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 113/231] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Aug 24 11:19:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:19:52.446856 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70593ae2-af4d-47af-b253-4faf8aa432a7 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:52.598110 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70593ae2-af4d-47af-b253-4faf8aa432a7 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:52.643201 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1402a17b-1deb-4cab-affa-70ac1496f8dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:52.643888 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1402a17b-1deb-4cab-affa-70ac1496f8dd None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:52.644202 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1402a17b-1deb-4cab-affa-70ac1496f8dd None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:52.644472 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1402a17b-1deb-4cab-affa-70ac1496f8dd None admin] PATH_INFO: `/v3/users/dcf7b72d01a048f18cdbf939d000fad2` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:52.645602 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1402a17b-1deb-4cab-affa-70ac1496f8dd None admin] RBAC: Authorizing `identity:get_user(user_id=dcf7b72d01a048f18cdbf939d000fad2)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:19:52.647110 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1402a17b-1deb-4cab-affa-70ac1496f8dd None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:19:52.648690 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 119/232] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Aug 24 11:19:52 2022] GET /identity/v3/users/dcf7b72d01a048f18cdbf939d000fad2 => generated 283 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:19:52.654999 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d00ec19-9837-4cf0-bf25-9a39a2c9521e None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:52.767586 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d00ec19-9837-4cf0-bf25-9a39a2c9521e None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:52.815758 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab1957c-de81-40ae-9029-63af5621cf3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:52.816478 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab1957c-de81-40ae-9029-63af5621cf3e None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:52.816758 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab1957c-de81-40ae-9029-63af5621cf3e None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:52.817028 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab1957c-de81-40ae-9029-63af5621cf3e None admin] PATH_INFO: `/v3/projects/d865cccda5444ed685650f098a696d95` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:52.818167 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab1957c-de81-40ae-9029-63af5621cf3e None admin] RBAC: Authorizing `identity:get_project(project_id=d865cccda5444ed685650f098a696d95)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:19:52.819677 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab1957c-de81-40ae-9029-63af5621cf3e None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:19:52.821595 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 114/233] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Aug 24 11:19:52 2022] GET /identity/v3/projects/d865cccda5444ed685650f098a696d95 => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:19:52.827290 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1402a17b-1deb-4cab-affa-70ac1496f8dd None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:52.853140 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:52.954339 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1402a17b-1deb-4cab-affa-70ac1496f8dd None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:52.995686 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38906890-9353-43a8-abee-c2db265583b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:52.996460 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38906890-9353-43a8-abee-c2db265583b8 None admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:52.996737 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38906890-9353-43a8-abee-c2db265583b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:52.997004 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38906890-9353-43a8-abee-c2db265583b8 None admin] PATH_INFO: `/v3/projects/d865cccda5444ed685650f098a696d95/users/dcf7b72d01a048f18cdbf939d000fad2/roles/96f07e9110194606acccfbd8467649a7` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:52.999208 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38906890-9353-43a8-abee-c2db265583b8 None admin] RBAC: Authorizing `identity:create_grant(project_id=d865cccda5444ed685650f098a696d95, user_id=dcf7b72d01a048f18cdbf939d000fad2, role_id=96f07e9110194606acccfbd8467649a7)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:19:53.000678 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38906890-9353-43a8-abee-c2db265583b8 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:19:53.015996 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 120/234] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Aug 24 11:19:52 2022] PUT /identity/v3/projects/d865cccda5444ed685650f098a696d95/users/dcf7b72d01a048f18cdbf939d000fad2/roles/96f07e9110194606acccfbd8467649a7 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:19:53.368195 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b22c84c-7f6f-4bd0-8abb-bb9daa61cdd5 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:53.368938 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b22c84c-7f6f-4bd0-8abb-bb9daa61cdd5 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:53.369418 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b22c84c-7f6f-4bd0-8abb-bb9daa61cdd5 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:53.371565 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 115/235] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:19:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:19:53.377297 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60483f2-e952-41a6-8c3b-ea12318a97e3 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:53.378201 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60483f2-e952-41a6-8c3b-ea12318a97e3 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:53.381444 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60483f2-e952-41a6-8c3b-ea12318a97e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:53.402327 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-b60483f2-e952-41a6-8c3b-ea12318a97e3 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:19:53.403876 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-b60483f2-e952-41a6-8c3b-ea12318a97e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:19:53.476846 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 121/236] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:19:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 11:19:53.616057 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2228838c-7a8d-423f-9742-2c22e8225103 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:53.616698 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2228838c-7a8d-423f-9742-2c22e8225103 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:53.617161 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2228838c-7a8d-423f-9742-2c22e8225103 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:53.619075 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 116/237] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:19:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:19:53.624133 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a842127f-d596-43f7-a5b5-ad7a88d786dd None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:53.624660 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a842127f-d596-43f7-a5b5-ad7a88d786dd None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:53.625143 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a842127f-d596-43f7-a5b5-ad7a88d786dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:53.651303 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-a842127f-d596-43f7-a5b5-ad7a88d786dd None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:19:53.653279 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-a842127f-d596-43f7-a5b5-ad7a88d786dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:19:53.655571 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:53.742233 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 122/238] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:19:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 11:19:53.811156 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2228838c-7a8d-423f-9742-2c22e8225103 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:53.867240 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:53.948088 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2228838c-7a8d-423f-9742-2c22e8225103 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:53.991166 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0408721b-ab70-429e-ac00-84cc30a89d35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:53.991930 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0408721b-ab70-429e-ac00-84cc30a89d35 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:53.992205 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0408721b-ab70-429e-ac00-84cc30a89d35 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:53.992470 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0408721b-ab70-429e-ac00-84cc30a89d35 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:54.009365 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0408721b-ab70-429e-ac00-84cc30a89d35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:19:54.014818 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-0408721b-ab70-429e-ac00-84cc30a89d35 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 11:19:54.014818 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:19:54.014818 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:19:54.014818 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:19:54.014818 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:19:54.014818 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:19:54.014818 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:19:54.014818 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:19:54.014818 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:19:54.014818 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:19:54.014818 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:19:54.014818 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:19:54.014818 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:19:54.014818 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:19:54.014818 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:19:54.014818 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:19:54.015698 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:19:54.015698 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:19:54.015698 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:19:54.015698 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:19:54.015698 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:19:54.015698 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:19:54.015698 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:19:54.015698 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:19:54.015698 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:19:54.015698 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:19:54.015698 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:19:54.015698 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Aug 24 11:19:54.015698 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:19:54.015698 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:19:54.015698 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:19:54.015698 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:19:54.016497 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:19:54.016497 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:19:54.016497 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:19:54.016497 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:19:54.016497 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:19:54.016497 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:19:54.016497 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:19:54.016497 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:19:54.016497 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:19:54.016497 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:19:54.016497 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 11:19:54.016497 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:19:54.016497 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 117/239] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 24 11:19:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:19:54.027465 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a842127f-d596-43f7-a5b5-ad7a88d786dd None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:54.065691 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0408721b-ab70-429e-ac00-84cc30a89d35 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:54.219980 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a842127f-d596-43f7-a5b5-ad7a88d786dd None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:54.245393 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:54.253249 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0408721b-ab70-429e-ac00-84cc30a89d35 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:54.286661 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a57e274-92e3-4f89-94c8-4a54bc12170c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:54.288444 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a57e274-92e3-4f89-94c8-4a54bc12170c None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:54.290905 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a57e274-92e3-4f89-94c8-4a54bc12170c None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:54.291195 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a57e274-92e3-4f89-94c8-4a54bc12170c None admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:54.291900 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a57e274-92e3-4f89-94c8-4a54bc12170c None admin] RBAC: Adding query filter params (name=reader) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:19:54.292207 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a57e274-92e3-4f89-94c8-4a54bc12170c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:19:54.293612 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a57e274-92e3-4f89-94c8-4a54bc12170c None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:19:54.302525 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:54.309205 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a73784-b1d1-4c1b-9a55-30d11e98106b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:54.309961 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 123/240] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Aug 24 11:19:54 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:19:54.310344 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a73784-b1d1-4c1b-9a55-30d11e98106b None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:54.310849 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a73784-b1d1-4c1b-9a55-30d11e98106b None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:54.311309 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a73784-b1d1-4c1b-9a55-30d11e98106b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:54.312645 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a73784-b1d1-4c1b-9a55-30d11e98106b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:19:54.314325 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a73784-b1d1-4c1b-9a55-30d11e98106b None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:19:54.315497 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a57e274-92e3-4f89-94c8-4a54bc12170c None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:54.316708 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 118/241] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 11:19:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:19:54.322208 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a73784-b1d1-4c1b-9a55-30d11e98106b None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:54.451772 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a57e274-92e3-4f89-94c8-4a54bc12170c None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:54.452293 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a73784-b1d1-4c1b-9a55-30d11e98106b None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:54.492904 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9132361-847e-423a-98be-c25dbc23a2ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:54.493432 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9132361-847e-423a-98be-c25dbc23a2ab None admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:54.493704 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9132361-847e-423a-98be-c25dbc23a2ab None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:54.493972 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9132361-847e-423a-98be-c25dbc23a2ab None admin] PATH_INFO: `/v3/users` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:54.494661 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9132361-847e-423a-98be-c25dbc23a2ab None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:19:54.495902 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27284eea-13b6-4d14-93a0-062ee68180aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:54.496182 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9132361-847e-423a-98be-c25dbc23a2ab None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:19:54.496949 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27284eea-13b6-4d14-93a0-062ee68180aa None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:54.497419 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27284eea-13b6-4d14-93a0-062ee68180aa None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:54.497897 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27284eea-13b6-4d14-93a0-062ee68180aa None admin] PATH_INFO: `/v3/users/69da67b6f4da4d1e8aa845f048d5cf77` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:54.516821 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27284eea-13b6-4d14-93a0-062ee68180aa None admin] RBAC: Authorizing `identity:get_user(user_id=69da67b6f4da4d1e8aa845f048d5cf77)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:19:54.518774 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27284eea-13b6-4d14-93a0-062ee68180aa None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:19:54.520774 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 124/242] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Aug 24 11:19:54 2022] GET /identity/v3/users/69da67b6f4da4d1e8aa845f048d5cf77 => generated 297 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:19:54.526387 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 119/243] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Aug 24 11:19:54 2022] POST /identity/v3/users => generated 293 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 11:19:54.527014 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9132361-847e-423a-98be-c25dbc23a2ab None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:54.528228 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5600c4a5-506b-47f4-830a-a4b88c2d4171 None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:54.528762 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5600c4a5-506b-47f4-830a-a4b88c2d4171 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:54.529226 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5600c4a5-506b-47f4-830a-a4b88c2d4171 None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:54.531115 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 125/244] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:19:54 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:19:54.537004 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7694f22f-098b-4bc1-8d75-a16b45517061 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:54.537629 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7694f22f-098b-4bc1-8d75-a16b45517061 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:54.538097 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7694f22f-098b-4bc1-8d75-a16b45517061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:54.557954 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:54.576441 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-7694f22f-098b-4bc1-8d75-a16b45517061 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:19:54.578135 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-7694f22f-098b-4bc1-8d75-a16b45517061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:19:54.653040 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9132361-847e-423a-98be-c25dbc23a2ab None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:54.688631 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:54.695816 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217bdb2c-c012-4e91-aa08-ef15ede1e418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:54.696438 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217bdb2c-c012-4e91-aa08-ef15ede1e418 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:54.696711 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217bdb2c-c012-4e91-aa08-ef15ede1e418 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:54.696978 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217bdb2c-c012-4e91-aa08-ef15ede1e418 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:54.724685 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 126/245] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:19:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 11:19:54.773285 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217bdb2c-c012-4e91-aa08-ef15ede1e418 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:19:54.774749 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217bdb2c-c012-4e91-aa08-ef15ede1e418 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:19:54.800262 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:54.883354 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 120/246] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 24 11:19:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 11:19:54.891551 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7694f22f-098b-4bc1-8d75-a16b45517061 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:54.946203 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29db5d06-fd2b-4de0-8fbf-fcb914370473 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:54.946735 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29db5d06-fd2b-4de0-8fbf-fcb914370473 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:54.947179 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29db5d06-fd2b-4de0-8fbf-fcb914370473 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:54.948682 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 121/247] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:19:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:19:54.954093 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d996b6-f4de-4fe6-8815-d8fb36a29b09 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:54.954425 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d996b6-f4de-4fe6-8815-d8fb36a29b09 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:54.954696 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d996b6-f4de-4fe6-8815-d8fb36a29b09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:54.977337 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-38d996b6-f4de-4fe6-8815-d8fb36a29b09 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:19:54.978878 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-38d996b6-f4de-4fe6-8815-d8fb36a29b09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:19:55.020295 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7694f22f-098b-4bc1-8d75-a16b45517061 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:55.058930 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44775e8-6d87-4fca-89aa-9efb93e10d54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:55.060002 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44775e8-6d87-4fca-89aa-9efb93e10d54 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:55.060476 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44775e8-6d87-4fca-89aa-9efb93e10d54 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:55.060595 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 122/248] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:19:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 11:19:55.061213 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44775e8-6d87-4fca-89aa-9efb93e10d54 None admin] PATH_INFO: `/v3/projects/d865cccda5444ed685650f098a696d95` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:55.066378 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44775e8-6d87-4fca-89aa-9efb93e10d54 None admin] RBAC: Authorizing `identity:get_project(project_id=d865cccda5444ed685650f098a696d95)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:19:55.066378 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44775e8-6d87-4fca-89aa-9efb93e10d54 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:19:55.070667 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 127/249] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Aug 24 11:19:54 2022] GET /identity/v3/projects/d865cccda5444ed685650f098a696d95 => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:19:55.072852 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d996b6-f4de-4fe6-8815-d8fb36a29b09 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:55.107269 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44775e8-6d87-4fca-89aa-9efb93e10d54 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:55.128994 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:55.182722 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d996b6-f4de-4fe6-8815-d8fb36a29b09 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:55.186726 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:55.226818 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96146ae-21af-46c7-a930-7ceb1bc36a35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:55.227437 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96146ae-21af-46c7-a930-7ceb1bc36a35 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:55.227710 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96146ae-21af-46c7-a930-7ceb1bc36a35 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:55.227977 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96146ae-21af-46c7-a930-7ceb1bc36a35 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:55.228702 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96146ae-21af-46c7-a930-7ceb1bc36a35 None admin] RBAC: Adding query filter params (role.id=7b4c8894d4a2493b97242eb334dc9014, scope.project.id=d865cccda5444ed685650f098a696d95, user.id=69da67b6f4da4d1e8aa845f048d5cf77) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:19:55.229002 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96146ae-21af-46c7-a930-7ceb1bc36a35 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:19:55.230684 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96146ae-21af-46c7-a930-7ceb1bc36a35 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:19:55.239267 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 123/250] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Aug 24 11:19:55 2022] GET /identity/v3/role_assignments?user.id=69da67b6f4da4d1e8aa845f048d5cf77&scope.project.id=d865cccda5444ed685650f098a696d95&role.id=7b4c8894d4a2493b97242eb334dc9014 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:19:55.243239 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44775e8-6d87-4fca-89aa-9efb93e10d54 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:55.285995 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b21cd3a-75f4-4e24-8858-d236641e1b87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:55.286676 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b21cd3a-75f4-4e24-8858-d236641e1b87 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:55.286956 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b21cd3a-75f4-4e24-8858-d236641e1b87 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:55.287228 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b21cd3a-75f4-4e24-8858-d236641e1b87 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:55.303613 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b21cd3a-75f4-4e24-8858-d236641e1b87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:19:55.309043 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-9b21cd3a-75f4-4e24-8858-d236641e1b87 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 11:19:55.309043 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:19:55.309043 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:19:55.309043 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:19:55.309043 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:19:55.309043 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:19:55.309043 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:19:55.309043 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:19:55.309043 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:19:55.309043 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:19:55.309043 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:19:55.309043 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:19:55.309043 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:19:55.309043 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:19:55.309043 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:19:55.309043 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:19:55.309913 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:19:55.309913 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:19:55.309913 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:19:55.309913 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:19:55.309913 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:19:55.309913 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:19:55.309913 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:19:55.309913 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:19:55.309913 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:19:55.309913 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:19:55.309913 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:19:55.309913 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Aug 24 11:19:55.309913 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:19:55.309913 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:19:55.309913 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:19:55.309913 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:19:55.311090 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:19:55.311090 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:19:55.311090 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:19:55.311090 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:19:55.311090 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:19:55.311090 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:19:55.311090 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:19:55.311090 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:19:55.311090 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:19:55.311090 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:19:55.311090 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 11:19:55.311090 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Aug 24 11:19:55.311090 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 128/251] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 24 11:19:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 11:19:55.316251 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96146ae-21af-46c7-a930-7ceb1bc36a35 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:55.428619 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b21cd3a-75f4-4e24-8858-d236641e1b87 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:55.444817 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96146ae-21af-46c7-a930-7ceb1bc36a35 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:55.469975 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:55.491719 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9083fb-0b25-46f9-b510-3aefb907dce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:55.492356 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9083fb-0b25-46f9-b510-3aefb907dce3 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:55.492634 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9083fb-0b25-46f9-b510-3aefb907dce3 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:55.492908 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9083fb-0b25-46f9-b510-3aefb907dce3 None admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:55.493604 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9083fb-0b25-46f9-b510-3aefb907dce3 None admin] RBAC: Adding query filter params (name=member) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:19:55.493909 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9083fb-0b25-46f9-b510-3aefb907dce3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:19:55.495533 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9083fb-0b25-46f9-b510-3aefb907dce3 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:19:55.505893 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 124/252] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Aug 24 11:19:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:19:55.512542 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9083fb-0b25-46f9-b510-3aefb907dce3 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:55.624973 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9083fb-0b25-46f9-b510-3aefb907dce3 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:55.652824 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b21cd3a-75f4-4e24-8858-d236641e1b87 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:55.663230 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4327994-c16a-4458-86d4-72f2d87708bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:55.664123 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4327994-c16a-4458-86d4-72f2d87708bd None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:55.664577 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4327994-c16a-4458-86d4-72f2d87708bd None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:55.665017 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4327994-c16a-4458-86d4-72f2d87708bd None admin] PATH_INFO: `/v3/users/5bd9a7bf105d4a6f9bf3a4e537136a19` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:55.666456 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4327994-c16a-4458-86d4-72f2d87708bd None admin] RBAC: Authorizing `identity:get_user(user_id=5bd9a7bf105d4a6f9bf3a4e537136a19)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:19:55.668731 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4327994-c16a-4458-86d4-72f2d87708bd None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:19:55.670591 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 125/253] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Aug 24 11:19:55 2022] GET /identity/v3/users/5bd9a7bf105d4a6f9bf3a4e537136a19 => generated 297 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:19:55.672419 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837d4bba-6fb2-4884-8116-c9517384a8d1 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:55.677936 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837d4bba-6fb2-4884-8116-c9517384a8d1 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:55.678494 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837d4bba-6fb2-4884-8116-c9517384a8d1 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:55.680019 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 126/254] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:19:55 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:19:55.681099 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837d4bba-6fb2-4884-8116-c9517384a8d1 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:55.708084 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:55.735505 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:55.781461 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdb4140-a590-4260-8e33-af925342bdaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:55.783862 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdb4140-a590-4260-8e33-af925342bdaf None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:55.786507 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdb4140-a590-4260-8e33-af925342bdaf None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:55.787005 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdb4140-a590-4260-8e33-af925342bdaf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:55.809657 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdb4140-a590-4260-8e33-af925342bdaf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:19:55.817017 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837d4bba-6fb2-4884-8116-c9517384a8d1 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:55.821298 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-dfdb4140-a590-4260-8e33-af925342bdaf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 11:19:55.821298 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:19:55.821298 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:19:55.821298 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:19:55.821298 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:19:55.821298 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:19:55.821298 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:19:55.821298 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:19:55.821298 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:19:55.821298 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:19:55.821298 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:19:55.821298 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:19:55.821298 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:19:55.821298 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:19:55.821298 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:19:55.821298 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:19:55.822178 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:19:55.822178 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:19:55.822178 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:19:55.822178 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:19:55.822178 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:19:55.822178 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:19:55.822178 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:19:55.822178 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:19:55.822178 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:19:55.822178 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:19:55.822178 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:19:55.822178 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Aug 24 11:19:55.822178 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:19:55.822178 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:19:55.822178 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:19:55.822178 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:19:55.823062 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:19:55.823062 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:19:55.823062 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:19:55.823062 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:19:55.823062 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:19:55.823062 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:19:55.823062 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:19:55.823062 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:19:55.823062 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:19:55.823062 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:19:55.823062 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 11:19:55.823062 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Aug 24 11:19:55.829498 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 129/255] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Aug 24 11:19:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 401 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 11:19:55.831052 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14beba08-49bf-4265-ac70-28f415f68634 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:55.831547 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14beba08-49bf-4265-ac70-28f415f68634 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:55.833150 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14beba08-49bf-4265-ac70-28f415f68634 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:55.867644 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-14beba08-49bf-4265-ac70-28f415f68634 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:19:55.870634 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-14beba08-49bf-4265-ac70-28f415f68634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:19:55.893878 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca11902-3e88-4145-bc2f-f00a76f40c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:55.895492 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca11902-3e88-4145-bc2f-f00a76f40c2d None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:55.895995 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca11902-3e88-4145-bc2f-f00a76f40c2d None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:55.896519 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca11902-3e88-4145-bc2f-f00a76f40c2d None admin] PATH_INFO: `/v3/projects/d865cccda5444ed685650f098a696d95` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:55.898594 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca11902-3e88-4145-bc2f-f00a76f40c2d None admin] RBAC: Authorizing `identity:get_project(project_id=d865cccda5444ed685650f098a696d95)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:19:55.900835 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca11902-3e88-4145-bc2f-f00a76f40c2d None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:19:55.903994 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 127/256] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Aug 24 11:19:55 2022] GET /identity/v3/projects/d865cccda5444ed685650f098a696d95 => generated 302 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:19:55.910740 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca11902-3e88-4145-bc2f-f00a76f40c2d None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:56.024277 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 130/257] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:19:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 11:19:56.024277 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14beba08-49bf-4265-ac70-28f415f68634 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:56.137037 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca11902-3e88-4145-bc2f-f00a76f40c2d None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:56.168619 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:56.221005 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bae648-99db-43c6-9b3f-49a5db048596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:56.221617 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bae648-99db-43c6-9b3f-49a5db048596 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:56.221888 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bae648-99db-43c6-9b3f-49a5db048596 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:56.222155 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bae648-99db-43c6-9b3f-49a5db048596 None admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:56.225342 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bae648-99db-43c6-9b3f-49a5db048596 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:19:56.225647 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bae648-99db-43c6-9b3f-49a5db048596 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:19:56.231985 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bae648-99db-43c6-9b3f-49a5db048596 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:19:56.253926 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 128/258] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 24 11:19:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:19:56.261285 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bae648-99db-43c6-9b3f-49a5db048596 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:56.276263 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14beba08-49bf-4265-ac70-28f415f68634 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:56.285589 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:56.314451 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbab9de8-64a7-4862-82c8-b0d12f6658f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:56.315594 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbab9de8-64a7-4862-82c8-b0d12f6658f1 None admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:56.316136 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbab9de8-64a7-4862-82c8-b0d12f6658f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:56.316618 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbab9de8-64a7-4862-82c8-b0d12f6658f1 None admin] PATH_INFO: `/v3/projects/d865cccda5444ed685650f098a696d95/users/5bd9a7bf105d4a6f9bf3a4e537136a19/roles/27e3e65e24df4b86b0d3d18d3212101d` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:56.318885 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbab9de8-64a7-4862-82c8-b0d12f6658f1 None admin] RBAC: Authorizing `identity:create_grant(project_id=d865cccda5444ed685650f098a696d95, user_id=5bd9a7bf105d4a6f9bf3a4e537136a19, role_id=27e3e65e24df4b86b0d3d18d3212101d)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:19:56.320672 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbab9de8-64a7-4862-82c8-b0d12f6658f1 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:19:56.341356 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 131/259] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Aug 24 11:19:56 2022] PUT /identity/v3/projects/d865cccda5444ed685650f098a696d95/users/5bd9a7bf105d4a6f9bf3a4e537136a19/roles/27e3e65e24df4b86b0d3d18d3212101d => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:19:56.342531 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbab9de8-64a7-4862-82c8-b0d12f6658f1 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:56.483722 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bae648-99db-43c6-9b3f-49a5db048596 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:56.544557 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbab9de8-64a7-4862-82c8-b0d12f6658f1 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:56.559696 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff1b419-0f65-4619-a512-93a76b886a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:56.560372 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff1b419-0f65-4619-a512-93a76b886a60 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:56.560650 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff1b419-0f65-4619-a512-93a76b886a60 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:56.560924 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff1b419-0f65-4619-a512-93a76b886a60 None admin] PATH_INFO: `/v3/users/dcf7b72d01a048f18cdbf939d000fad2` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:56.567204 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff1b419-0f65-4619-a512-93a76b886a60 None admin] RBAC: Authorizing `identity:get_user(user_id=dcf7b72d01a048f18cdbf939d000fad2)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:19:56.568757 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff1b419-0f65-4619-a512-93a76b886a60 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:19:56.570496 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 129/260] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Aug 24 11:19:56 2022] GET /identity/v3/users/dcf7b72d01a048f18cdbf939d000fad2 => generated 283 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:19:56.577035 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff1b419-0f65-4619-a512-93a76b886a60 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:56.585759 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c518f81-35bf-4753-80bd-d1ac47a7d9df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:56.586890 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c518f81-35bf-4753-80bd-d1ac47a7d9df None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:56.587369 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c518f81-35bf-4753-80bd-d1ac47a7d9df None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:56.587832 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c518f81-35bf-4753-80bd-d1ac47a7d9df None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:56.600073 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c518f81-35bf-4753-80bd-d1ac47a7d9df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:19:56.605863 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-9c518f81-35bf-4753-80bd-d1ac47a7d9df None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 11:19:56.605863 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:19:56.605863 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:19:56.605863 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:19:56.605863 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:19:56.605863 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:19:56.605863 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:19:56.605863 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:19:56.605863 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:19:56.605863 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:19:56.605863 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:19:56.605863 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:19:56.605863 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:19:56.605863 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:19:56.605863 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:19:56.605863 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:19:56.607062 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:19:56.607062 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:19:56.607062 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:19:56.607062 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:19:56.607062 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:19:56.607062 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:19:56.607062 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:19:56.607062 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:19:56.607062 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:19:56.607062 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:19:56.607062 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:19:56.607062 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Aug 24 11:19:56.607062 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:19:56.607062 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:19:56.607062 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:19:56.607062 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:19:56.607876 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:19:56.607876 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:19:56.607876 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:19:56.607876 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:19:56.607876 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:19:56.607876 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:19:56.607876 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:19:56.607876 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:19:56.607876 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:19:56.607876 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:19:56.607876 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 11:19:56.607876 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Aug 24 11:19:56.610498 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 132/261] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Aug 24 11:19:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:19:56.617008 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c518f81-35bf-4753-80bd-d1ac47a7d9df None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:56.663572 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:56.694859 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:56.733129 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c518f81-35bf-4753-80bd-d1ac47a7d9df None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:56.749682 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff1b419-0f65-4619-a512-93a76b886a60 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:56.796516 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ec6f95-88a3-49e5-8c2c-3fb485fdc031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:56.797671 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ec6f95-88a3-49e5-8c2c-3fb485fdc031 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:56.798148 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ec6f95-88a3-49e5-8c2c-3fb485fdc031 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:56.798658 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ec6f95-88a3-49e5-8c2c-3fb485fdc031 None admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:56.799553 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ec6f95-88a3-49e5-8c2c-3fb485fdc031 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:19:56.800073 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ec6f95-88a3-49e5-8c2c-3fb485fdc031 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:19:56.801756 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ec6f95-88a3-49e5-8c2c-3fb485fdc031 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:19:56.823950 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 133/262] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Aug 24 11:19:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:19:56.829389 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ec6f95-88a3-49e5-8c2c-3fb485fdc031 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:56.829628 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498c7d0a-216a-4b10-9698-9353874d5cb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:56.830291 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498c7d0a-216a-4b10-9698-9353874d5cb5 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:56.830601 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498c7d0a-216a-4b10-9698-9353874d5cb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:56.830877 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498c7d0a-216a-4b10-9698-9353874d5cb5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:56.957760 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ec6f95-88a3-49e5-8c2c-3fb485fdc031 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:56.957959 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498c7d0a-216a-4b10-9698-9353874d5cb5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:19:56.959497 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498c7d0a-216a-4b10-9698-9353874d5cb5 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:19:56.962561 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:56.998719 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5cf437-a793-41be-a051-95472524b0c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:56.999815 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5cf437-a793-41be-a051-95472524b0c6 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:57.000314 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5cf437-a793-41be-a051-95472524b0c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:57.000778 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5cf437-a793-41be-a051-95472524b0c6 None admin] PATH_INFO: `/v3/users/dcf7b72d01a048f18cdbf939d000fad2` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:57.002406 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5cf437-a793-41be-a051-95472524b0c6 None admin] RBAC: Authorizing `identity:get_user(user_id=dcf7b72d01a048f18cdbf939d000fad2)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:19:57.004361 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5cf437-a793-41be-a051-95472524b0c6 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:19:57.006300 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 134/263] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Aug 24 11:19:56 2022] GET /identity/v3/users/dcf7b72d01a048f18cdbf939d000fad2 => generated 283 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:19:57.015642 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5cf437-a793-41be-a051-95472524b0c6 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:57.052285 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:57.153917 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5cf437-a793-41be-a051-95472524b0c6 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:57.178697 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 130/264] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 24 11:19:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 602 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 11:19:57.184741 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498c7d0a-216a-4b10-9698-9353874d5cb5 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:57.196729 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d76d63e-c3f0-4df8-a6ec-4821e2e6d862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:57.197656 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d76d63e-c3f0-4df8-a6ec-4821e2e6d862 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:57.198130 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d76d63e-c3f0-4df8-a6ec-4821e2e6d862 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:57.198625 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d76d63e-c3f0-4df8-a6ec-4821e2e6d862 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:57.226682 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:57.274085 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d76d63e-c3f0-4df8-a6ec-4821e2e6d862 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:19:57.276375 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d76d63e-c3f0-4df8-a6ec-4821e2e6d862 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:19:57.384221 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 135/265] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 24 11:19:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 11:19:57.390634 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d76d63e-c3f0-4df8-a6ec-4821e2e6d862 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:57.452400 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498c7d0a-216a-4b10-9698-9353874d5cb5 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:57.490154 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed857493-f2c8-4f61-8dfc-fa13c3dc69d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:57.491261 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed857493-f2c8-4f61-8dfc-fa13c3dc69d8 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:57.491738 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed857493-f2c8-4f61-8dfc-fa13c3dc69d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:57.492233 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed857493-f2c8-4f61-8dfc-fa13c3dc69d8 None admin] PATH_INFO: `/v3/projects/d865cccda5444ed685650f098a696d95` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:57.493568 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed857493-f2c8-4f61-8dfc-fa13c3dc69d8 None admin] RBAC: Authorizing `identity:get_project(project_id=d865cccda5444ed685650f098a696d95)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:19:57.496283 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed857493-f2c8-4f61-8dfc-fa13c3dc69d8 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:19:57.498753 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 131/266] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Aug 24 11:19:57 2022] GET /identity/v3/projects/d865cccda5444ed685650f098a696d95 => generated 302 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:19:57.506262 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed857493-f2c8-4f61-8dfc-fa13c3dc69d8 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:57.521398 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:57.538317 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:57.597492 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d76d63e-c3f0-4df8-a6ec-4821e2e6d862 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:57.656368 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065bee37-b456-4e57-94f5-bef67bd7b7ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:57.656907 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065bee37-b456-4e57-94f5-bef67bd7b7ee None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:57.657181 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065bee37-b456-4e57-94f5-bef67bd7b7ee None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:57.657445 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065bee37-b456-4e57-94f5-bef67bd7b7ee None admin] PATH_INFO: `/v3/projects/d865cccda5444ed685650f098a696d95` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:57.658591 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065bee37-b456-4e57-94f5-bef67bd7b7ee None admin] RBAC: Authorizing `identity:get_project(project_id=d865cccda5444ed685650f098a696d95)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:19:57.660118 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065bee37-b456-4e57-94f5-bef67bd7b7ee None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:19:57.660605 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed857493-f2c8-4f61-8dfc-fa13c3dc69d8 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:57.662031 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 136/267] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Aug 24 11:19:57 2022] GET /identity/v3/projects/d865cccda5444ed685650f098a696d95 => generated 302 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:19:57.668151 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60888f41-c536-4781-ad08-c94b027822ac None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:57.668444 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60888f41-c536-4781-ad08-c94b027822ac None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:57.668715 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60888f41-c536-4781-ad08-c94b027822ac None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:57.670326 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 137/268] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:19:57 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:19:57.671508 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1bff45-da95-4323-a76a-20f8416b3ebc None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:57.671783 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1bff45-da95-4323-a76a-20f8416b3ebc None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:57.672050 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1bff45-da95-4323-a76a-20f8416b3ebc None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:57.673588 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 138/269] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:19:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:19:57.678267 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1bff45-da95-4323-a76a-20f8416b3ebc None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:57.703892 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d14d8bb-3d92-41f1-92f0-ed38d236c019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:57.704532 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d14d8bb-3d92-41f1-92f0-ed38d236c019 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:57.704801 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d14d8bb-3d92-41f1-92f0-ed38d236c019 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:57.705115 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d14d8bb-3d92-41f1-92f0-ed38d236c019 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:57.705845 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d14d8bb-3d92-41f1-92f0-ed38d236c019 None admin] RBAC: Adding query filter params (role.id=30bb1e97257f4ca5b90c88545777317b, scope.project.id=d865cccda5444ed685650f098a696d95, user.id=dcf7b72d01a048f18cdbf939d000fad2) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:19:57.706189 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d14d8bb-3d92-41f1-92f0-ed38d236c019 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:19:57.707729 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d14d8bb-3d92-41f1-92f0-ed38d236c019 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:19:57.714275 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 132/270] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Aug 24 11:19:57 2022] GET /identity/v3/role_assignments?user.id=dcf7b72d01a048f18cdbf939d000fad2&scope.project.id=d865cccda5444ed685650f098a696d95&role.id=30bb1e97257f4ca5b90c88545777317b => generated 608 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:19:57.718907 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5ccc79-1da0-412b-83fd-9c64017c0543 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:57.719188 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5ccc79-1da0-412b-83fd-9c64017c0543 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:57.719456 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5ccc79-1da0-412b-83fd-9c64017c0543 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:57.765245 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-ed5ccc79-1da0-412b-83fd-9c64017c0543 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:19:57.768595 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-ed5ccc79-1da0-412b-83fd-9c64017c0543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:19:57.863643 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1bff45-da95-4323-a76a-20f8416b3ebc None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:57.907721 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:57.909358 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 133/271] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:19:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 11:19:57.910863 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed384fc-542e-4ce3-8996-cbe66d6261cc None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:57.911092 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed384fc-542e-4ce3-8996-cbe66d6261cc None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:57.911366 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed384fc-542e-4ce3-8996-cbe66d6261cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:57.924800 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:57.932890 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1047c5a6-e1cb-434e-8d20-9a7173d368bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:57.933513 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1047c5a6-e1cb-434e-8d20-9a7173d368bb None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:57.933789 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1047c5a6-e1cb-434e-8d20-9a7173d368bb None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:57.934055 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1047c5a6-e1cb-434e-8d20-9a7173d368bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:57.934840 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1047c5a6-e1cb-434e-8d20-9a7173d368bb None admin] RBAC: Adding query filter params (role.id=96f07e9110194606acccfbd8467649a7, scope.project.id=d865cccda5444ed685650f098a696d95, user.id=dcf7b72d01a048f18cdbf939d000fad2) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:19:57.935137 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1047c5a6-e1cb-434e-8d20-9a7173d368bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:19:57.936087 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-1ed384fc-542e-4ce3-8996-cbe66d6261cc None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:19:57.936590 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1047c5a6-e1cb-434e-8d20-9a7173d368bb None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:19:57.938565 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-1ed384fc-542e-4ce3-8996-cbe66d6261cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:19:57.951028 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 139/272] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Aug 24 11:19:57 2022] GET /identity/v3/role_assignments?user.id=dcf7b72d01a048f18cdbf939d000fad2&scope.project.id=d865cccda5444ed685650f098a696d95&role.id=96f07e9110194606acccfbd8467649a7 => generated 608 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:19:58.024777 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 134/273] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:19:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 11:19:58.155719 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeab135-579e-4180-9a4f-eeeee7fcaaf8 None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:58.156337 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeab135-579e-4180-9a4f-eeeee7fcaaf8 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:58.156814 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeab135-579e-4180-9a4f-eeeee7fcaaf8 None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:58.158669 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 140/274] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:19:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:19:58.163770 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bf6712-f5af-44d9-aa6a-212bc32a5532 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:58.164287 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bf6712-f5af-44d9-aa6a-212bc32a5532 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:58.164817 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bf6712-f5af-44d9-aa6a-212bc32a5532 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:58.185152 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-40bf6712-f5af-44d9-aa6a-212bc32a5532 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:19:58.186637 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-40bf6712-f5af-44d9-aa6a-212bc32a5532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:19:58.269996 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 135/275] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:19:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 11:19:58.310271 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeab135-579e-4180-9a4f-eeeee7fcaaf8 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:58.414135 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bf6712-f5af-44d9-aa6a-212bc32a5532 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:58.436091 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeab135-579e-4180-9a4f-eeeee7fcaaf8 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:58.487665 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd684d9-60c5-4701-83e3-0167f3267754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:58.488951 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd684d9-60c5-4701-83e3-0167f3267754 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:58.489416 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd684d9-60c5-4701-83e3-0167f3267754 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:58.490081 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd684d9-60c5-4701-83e3-0167f3267754 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:58.500708 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:58.504829 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd684d9-60c5-4701-83e3-0167f3267754 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:19:58.511872 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-cfd684d9-60c5-4701-83e3-0167f3267754 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 11:19:58.511872 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:19:58.511872 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:19:58.511872 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:19:58.511872 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:19:58.511872 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:19:58.511872 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:19:58.511872 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:19:58.511872 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:19:58.511872 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:19:58.511872 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:19:58.511872 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:19:58.511872 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:19:58.511872 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:19:58.511872 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:19:58.511872 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:19:58.512833 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:19:58.512833 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:19:58.512833 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:19:58.512833 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:19:58.512833 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:19:58.512833 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:19:58.512833 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:19:58.512833 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:19:58.512833 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:19:58.512833 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:19:58.512833 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:19:58.512833 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Aug 24 11:19:58.512833 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:19:58.512833 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:19:58.512833 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:19:58.512833 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:19:58.513666 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:19:58.513666 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:19:58.513666 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:19:58.513666 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:19:58.513666 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:19:58.513666 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:19:58.513666 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:19:58.513666 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:19:58.513666 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:19:58.513666 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:19:58.513666 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 11:19:58.513666 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Aug 24 11:19:58.516369 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 141/276] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 24 11:19:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:19:58.523250 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd684d9-60c5-4701-83e3-0167f3267754 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:58.552633 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bf6712-f5af-44d9-aa6a-212bc32a5532 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:58.585880 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:58.592967 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b55f0d-358b-4608-9dfe-8f416fbb37e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:58.593612 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b55f0d-358b-4608-9dfe-8f416fbb37e5 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:58.593902 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b55f0d-358b-4608-9dfe-8f416fbb37e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:58.594171 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b55f0d-358b-4608-9dfe-8f416fbb37e5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:58.595390 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b55f0d-358b-4608-9dfe-8f416fbb37e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:19:58.596896 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b55f0d-358b-4608-9dfe-8f416fbb37e5 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:19:58.598632 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 136/277] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 11:19:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:19:58.599422 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b55f0d-358b-4608-9dfe-8f416fbb37e5 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:58.642957 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd684d9-60c5-4701-83e3-0167f3267754 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:58.677729 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afd1c67-882e-4dff-9474-295a94576e28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:58.678324 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afd1c67-882e-4dff-9474-295a94576e28 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:58.678629 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afd1c67-882e-4dff-9474-295a94576e28 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:58.678901 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afd1c67-882e-4dff-9474-295a94576e28 None admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:58.679561 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afd1c67-882e-4dff-9474-295a94576e28 None admin] RBAC: Adding query filter params (name=member) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:19:58.679858 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afd1c67-882e-4dff-9474-295a94576e28 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:19:58.681249 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afd1c67-882e-4dff-9474-295a94576e28 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:19:58.695245 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 142/278] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Aug 24 11:19:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:19:58.695245 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afd1c67-882e-4dff-9474-295a94576e28 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:58.701772 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b55f0d-358b-4608-9dfe-8f416fbb37e5 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:58.735441 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c219969-6129-4b8e-8da0-ef0acbb7b1aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:58.736069 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c219969-6129-4b8e-8da0-ef0acbb7b1aa None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:58.736341 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c219969-6129-4b8e-8da0-ef0acbb7b1aa None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:58.736602 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c219969-6129-4b8e-8da0-ef0acbb7b1aa None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:58.738737 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:58.750568 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c219969-6129-4b8e-8da0-ef0acbb7b1aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:19:58.755350 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-1c219969-6129-4b8e-8da0-ef0acbb7b1aa None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 11:19:58.755350 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:19:58.755350 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:19:58.755350 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:19:58.755350 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:19:58.755350 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:19:58.755350 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:19:58.755350 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:19:58.755350 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:19:58.755350 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:19:58.755350 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:19:58.755350 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:19:58.755350 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:19:58.755350 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:19:58.755350 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:19:58.755350 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:19:58.756231 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:19:58.756231 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:19:58.756231 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:19:58.756231 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:19:58.756231 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:19:58.756231 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:19:58.756231 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:19:58.756231 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:19:58.756231 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:19:58.756231 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:19:58.756231 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:19:58.756231 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Aug 24 11:19:58.756231 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:19:58.756231 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:19:58.756231 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:19:58.756231 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:19:58.757018 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:19:58.757018 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:19:58.757018 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:19:58.757018 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:19:58.757018 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:19:58.757018 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:19:58.757018 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:19:58.757018 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:19:58.757018 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:19:58.757018 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:19:58.757018 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 11:19:58.757018 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:19:58.757018 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 137/279] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 24 11:19:58 2022] GET /identity/v3/roles/reader => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:19:58.757699 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c219969-6129-4b8e-8da0-ef0acbb7b1aa None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:58.810599 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afd1c67-882e-4dff-9474-295a94576e28 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:58.820943 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:58.845980 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212cfe45-cabd-4eac-a595-668969717278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:58.846642 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212cfe45-cabd-4eac-a595-668969717278 None admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:58.846918 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212cfe45-cabd-4eac-a595-668969717278 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:58.847198 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212cfe45-cabd-4eac-a595-668969717278 None admin] PATH_INFO: `/v3/users` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:58.847894 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212cfe45-cabd-4eac-a595-668969717278 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:19:58.849391 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212cfe45-cabd-4eac-a595-668969717278 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:19:58.867108 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c219969-6129-4b8e-8da0-ef0acbb7b1aa None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:58.872644 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 143/280] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Aug 24 11:19:58 2022] POST /identity/v3/users => generated 293 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:19:58.872644 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212cfe45-cabd-4eac-a595-668969717278 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:58.910804 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5c0675-f5d0-4b26-ba72-bdcdcf5f0087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:58.911461 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5c0675-f5d0-4b26-ba72-bdcdcf5f0087 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:58.911736 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5c0675-f5d0-4b26-ba72-bdcdcf5f0087 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:58.912011 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5c0675-f5d0-4b26-ba72-bdcdcf5f0087 None admin] PATH_INFO: `/v3/users/7104c363693c4e408034795ec47fd4b4` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:58.927564 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5c0675-f5d0-4b26-ba72-bdcdcf5f0087 None admin] RBAC: Authorizing `identity:get_user(user_id=7104c363693c4e408034795ec47fd4b4)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:19:58.929160 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5c0675-f5d0-4b26-ba72-bdcdcf5f0087 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:19:58.930906 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 138/281] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Aug 24 11:19:58 2022] GET /identity/v3/users/7104c363693c4e408034795ec47fd4b4 => generated 293 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:19:58.932154 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c345c76-a0c8-4931-bd29-89aef9c95cb5 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:58.932431 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c345c76-a0c8-4931-bd29-89aef9c95cb5 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:58.932698 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c345c76-a0c8-4931-bd29-89aef9c95cb5 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:58.934125 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 139/282] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:19:58 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:19:58.936916 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c345c76-a0c8-4931-bd29-89aef9c95cb5 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:58.995361 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212cfe45-cabd-4eac-a595-668969717278 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:58.999276 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:59.036869 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f79350f-a925-48c0-8036-719079e2774f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:59.037489 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f79350f-a925-48c0-8036-719079e2774f None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:59.037765 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f79350f-a925-48c0-8036-719079e2774f None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:59.038029 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f79350f-a925-48c0-8036-719079e2774f None admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:59.038744 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f79350f-a925-48c0-8036-719079e2774f None admin] RBAC: Adding query filter params (name=reader) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:19:59.039046 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f79350f-a925-48c0-8036-719079e2774f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:19:59.040451 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f79350f-a925-48c0-8036-719079e2774f None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:19:59.049697 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 144/283] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Aug 24 11:19:58 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:19:59.050820 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c62b3af-7f8e-47e9-9ac0-ecbd4d51659e None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:59.051157 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c62b3af-7f8e-47e9-9ac0-ecbd4d51659e None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:59.051436 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c62b3af-7f8e-47e9-9ac0-ecbd4d51659e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:59.051597 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c345c76-a0c8-4931-bd29-89aef9c95cb5 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:59.072872 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-0c62b3af-7f8e-47e9-9ac0-ecbd4d51659e None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:19:59.074076 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-0c62b3af-7f8e-47e9-9ac0-ecbd4d51659e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:19:59.095414 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca03cdec-0854-4476-a6f6-00512a993c8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:59.095729 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca03cdec-0854-4476-a6f6-00512a993c8f None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:59.095961 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca03cdec-0854-4476-a6f6-00512a993c8f None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:59.096958 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca03cdec-0854-4476-a6f6-00512a993c8f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:59.096958 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca03cdec-0854-4476-a6f6-00512a993c8f None admin] RBAC: Adding query filter params (role.id=27e3e65e24df4b86b0d3d18d3212101d, user.id=7104c363693c4e408034795ec47fd4b4, scope.system=all) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:19:59.097240 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca03cdec-0854-4476-a6f6-00512a993c8f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:19:59.100853 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca03cdec-0854-4476-a6f6-00512a993c8f None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:19:59.100996 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:59.105681 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 140/284] 10.222.0.27 () {56 vars in 1308 bytes} [Wed Aug 24 11:19:58 2022] GET /identity/v3/role_assignments?user.id=7104c363693c4e408034795ec47fd4b4&scope.system=all&role.id=27e3e65e24df4b86b0d3d18d3212101d => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:19:59.106676 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca03cdec-0854-4476-a6f6-00512a993c8f None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:59.178769 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 145/285] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:19:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 11:19:59.238277 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca03cdec-0854-4476-a6f6-00512a993c8f None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:59.260177 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:59.285803 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47783d6f-dd38-4453-bd4a-39ff443f164e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:59.286484 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47783d6f-dd38-4453-bd4a-39ff443f164e None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:59.286763 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47783d6f-dd38-4453-bd4a-39ff443f164e None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:59.287035 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47783d6f-dd38-4453-bd4a-39ff443f164e None admin] PATH_INFO: `/v3/users/69da67b6f4da4d1e8aa845f048d5cf77` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:59.288321 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47783d6f-dd38-4453-bd4a-39ff443f164e None admin] RBAC: Authorizing `identity:get_user(user_id=69da67b6f4da4d1e8aa845f048d5cf77)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:19:59.289836 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47783d6f-dd38-4453-bd4a-39ff443f164e None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:19:59.291685 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 141/286] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Aug 24 11:19:59 2022] GET /identity/v3/users/69da67b6f4da4d1e8aa845f048d5cf77 => generated 297 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:19:59.297304 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c62b3af-7f8e-47e9-9ac0-ecbd4d51659e None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:59.405254 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c62b3af-7f8e-47e9-9ac0-ecbd4d51659e None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:59.447936 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335b44e7-3181-4f10-a763-814e01c3cf33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:59.448578 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335b44e7-3181-4f10-a763-814e01c3cf33 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:59.448854 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335b44e7-3181-4f10-a763-814e01c3cf33 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:59.449123 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335b44e7-3181-4f10-a763-814e01c3cf33 None admin] PATH_INFO: `/v3/projects/d865cccda5444ed685650f098a696d95` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:59.455045 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335b44e7-3181-4f10-a763-814e01c3cf33 None admin] RBAC: Authorizing `identity:get_project(project_id=d865cccda5444ed685650f098a696d95)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:19:59.456513 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335b44e7-3181-4f10-a763-814e01c3cf33 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:19:59.458674 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 146/287] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Aug 24 11:19:59 2022] GET /identity/v3/projects/d865cccda5444ed685650f098a696d95 => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:19:59.464838 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47783d6f-dd38-4453-bd4a-39ff443f164e None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:59.469436 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335b44e7-3181-4f10-a763-814e01c3cf33 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:59.530231 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:59.602992 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47783d6f-dd38-4453-bd4a-39ff443f164e None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:59.649691 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d166c0-aac8-4f46-9d70-710e8880185a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:59.650755 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d166c0-aac8-4f46-9d70-710e8880185a None admin] REQUEST_METHOD: `PUT` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:59.651257 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d166c0-aac8-4f46-9d70-710e8880185a None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:59.652533 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d166c0-aac8-4f46-9d70-710e8880185a None admin] PATH_INFO: `/v3/projects/d865cccda5444ed685650f098a696d95/users/69da67b6f4da4d1e8aa845f048d5cf77/roles/7b4c8894d4a2493b97242eb334dc9014` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:59.654746 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d166c0-aac8-4f46-9d70-710e8880185a None admin] RBAC: Authorizing `identity:create_grant(project_id=d865cccda5444ed685650f098a696d95, user_id=69da67b6f4da4d1e8aa845f048d5cf77, role_id=7b4c8894d4a2493b97242eb334dc9014)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:19:59.656661 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d166c0-aac8-4f46-9d70-710e8880185a None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:19:59.674746 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335b44e7-3181-4f10-a763-814e01c3cf33 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:59.678066 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 142/288] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Aug 24 11:19:59 2022] PUT /identity/v3/projects/d865cccda5444ed685650f098a696d95/users/69da67b6f4da4d1e8aa845f048d5cf77/roles/7b4c8894d4a2493b97242eb334dc9014 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:19:59.725816 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3db62d-3346-4a6b-8207-2808fed6440d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:59.726908 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3db62d-3346-4a6b-8207-2808fed6440d None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:59.727393 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3db62d-3346-4a6b-8207-2808fed6440d None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:59.727845 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3db62d-3346-4a6b-8207-2808fed6440d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:59.744471 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3db62d-3346-4a6b-8207-2808fed6440d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:19:59.750013 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-3f3db62d-3346-4a6b-8207-2808fed6440d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 11:19:59.750013 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:19:59.750013 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:19:59.750013 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:19:59.750013 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:19:59.750013 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:19:59.750013 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:19:59.750013 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:19:59.750013 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:19:59.750013 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:19:59.750013 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:19:59.750013 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:19:59.750013 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:19:59.750013 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:19:59.750013 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:19:59.750013 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:19:59.750897 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:19:59.750897 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:19:59.750897 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:19:59.750897 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:19:59.750897 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:19:59.750897 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:19:59.750897 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:19:59.750897 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:19:59.750897 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:19:59.750897 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:19:59.750897 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:19:59.750897 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Aug 24 11:19:59.750897 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:19:59.750897 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:19:59.750897 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:19:59.750897 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:19:59.751750 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:19:59.751750 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:19:59.751750 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:19:59.751750 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:19:59.751750 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:19:59.751750 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:19:59.751750 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:19:59.751750 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:19:59.751750 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:19:59.751750 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:19:59.751750 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 11:19:59.751750 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Aug 24 11:19:59.754152 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 147/289] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 24 11:19:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:19:59.760403 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d166c0-aac8-4f46-9d70-710e8880185a None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:19:59.847451 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:59.925425 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d166c0-aac8-4f46-9d70-710e8880185a None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:19:59.964302 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a79aa2-753e-4a95-b625-d6818ce6622f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:19:59.965208 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a79aa2-753e-4a95-b625-d6818ce6622f None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:19:59.965487 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a79aa2-753e-4a95-b625-d6818ce6622f None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:19:59.965757 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a79aa2-753e-4a95-b625-d6818ce6622f None admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:19:59.966454 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a79aa2-753e-4a95-b625-d6818ce6622f None admin] RBAC: Adding query filter params (name=member) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:19:59.966759 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a79aa2-753e-4a95-b625-d6818ce6622f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:19:59.968170 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a79aa2-753e-4a95-b625-d6818ce6622f None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:19:59.978459 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 143/290] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Aug 24 11:19:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:19:59.983933 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3db62d-3346-4a6b-8207-2808fed6440d None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:00.081709 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:00.114831 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3db62d-3346-4a6b-8207-2808fed6440d None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:00.168337 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0116188c-612d-4e2b-b672-2f6e75047b04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:00.168973 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0116188c-612d-4e2b-b672-2f6e75047b04 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:00.169253 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0116188c-612d-4e2b-b672-2f6e75047b04 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:00.169522 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0116188c-612d-4e2b-b672-2f6e75047b04 None admin] PATH_INFO: `/v3/users/5bd9a7bf105d4a6f9bf3a4e537136a19` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:00.175065 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0116188c-612d-4e2b-b672-2f6e75047b04 None admin] RBAC: Authorizing `identity:get_user(user_id=5bd9a7bf105d4a6f9bf3a4e537136a19)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:00.176641 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0116188c-612d-4e2b-b672-2f6e75047b04 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:00.178288 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 148/291] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Aug 24 11:19:59 2022] GET /identity/v3/users/5bd9a7bf105d4a6f9bf3a4e537136a19 => generated 297 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:00.184487 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a79aa2-753e-4a95-b625-d6818ce6622f None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:00.293389 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a79aa2-753e-4a95-b625-d6818ce6622f None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:00.300759 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:00.330191 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99e607c-dcf0-4a1c-9699-f16e83f9b812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:00.330878 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99e607c-dcf0-4a1c-9699-f16e83f9b812 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:00.331157 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99e607c-dcf0-4a1c-9699-f16e83f9b812 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:00.331428 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99e607c-dcf0-4a1c-9699-f16e83f9b812 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:00.403624 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99e607c-dcf0-4a1c-9699-f16e83f9b812 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:00.405064 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99e607c-dcf0-4a1c-9699-f16e83f9b812 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:00.509198 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 144/292] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 24 11:20:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 11:20:00.514946 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0116188c-612d-4e2b-b672-2f6e75047b04 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:00.652424 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0116188c-612d-4e2b-b672-2f6e75047b04 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:00.700864 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d76cab9-0312-4ffe-851d-4eee8349fe20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:00.701430 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d76cab9-0312-4ffe-851d-4eee8349fe20 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:00.701707 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d76cab9-0312-4ffe-851d-4eee8349fe20 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:00.701978 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d76cab9-0312-4ffe-851d-4eee8349fe20 None admin] PATH_INFO: `/v3/projects/d865cccda5444ed685650f098a696d95` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:00.703150 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d76cab9-0312-4ffe-851d-4eee8349fe20 None admin] RBAC: Authorizing `identity:get_project(project_id=d865cccda5444ed685650f098a696d95)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:00.704625 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d76cab9-0312-4ffe-851d-4eee8349fe20 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:00.706514 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 149/293] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Aug 24 11:20:00 2022] GET /identity/v3/projects/d865cccda5444ed685650f098a696d95 => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:00.712509 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99e607c-dcf0-4a1c-9699-f16e83f9b812 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:00.726688 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:00.868508 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99e607c-dcf0-4a1c-9699-f16e83f9b812 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:00.909328 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a079a3fa-38fa-4dec-8efa-76df2a201bcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:00.909983 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a079a3fa-38fa-4dec-8efa-76df2a201bcf None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:00.910262 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a079a3fa-38fa-4dec-8efa-76df2a201bcf None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:00.910557 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a079a3fa-38fa-4dec-8efa-76df2a201bcf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:00.911348 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a079a3fa-38fa-4dec-8efa-76df2a201bcf None admin] RBAC: Adding query filter params (role.id=27e3e65e24df4b86b0d3d18d3212101d, scope.project.id=d865cccda5444ed685650f098a696d95, user.id=5bd9a7bf105d4a6f9bf3a4e537136a19) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:20:00.911653 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a079a3fa-38fa-4dec-8efa-76df2a201bcf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:00.913107 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a079a3fa-38fa-4dec-8efa-76df2a201bcf None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:00.923101 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 145/294] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Aug 24 11:20:00 2022] GET /identity/v3/role_assignments?user.id=5bd9a7bf105d4a6f9bf3a4e537136a19&scope.project.id=d865cccda5444ed685650f098a696d95&role.id=27e3e65e24df4b86b0d3d18d3212101d => generated 608 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:01.355453 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7accde18-6a20-46d3-a61e-6beba63a56d1 None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:01.355994 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7accde18-6a20-46d3-a61e-6beba63a56d1 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:01.355994 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7accde18-6a20-46d3-a61e-6beba63a56d1 None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:01.357570 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 150/295] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:20:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:20:01.362989 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7f4f87-7536-457d-8fe2-a4172358ff72 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:01.363544 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7f4f87-7536-457d-8fe2-a4172358ff72 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:01.363544 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7f4f87-7536-457d-8fe2-a4172358ff72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:01.385217 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-4a7f4f87-7536-457d-8fe2-a4172358ff72 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:20:01.386547 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-4a7f4f87-7536-457d-8fe2-a4172358ff72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:20:01.397691 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99cee3b-8d17-40d4-b130-5f8a3d31fe0d None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:01.397999 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99cee3b-8d17-40d4-b130-5f8a3d31fe0d None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:01.398234 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99cee3b-8d17-40d4-b130-5f8a3d31fe0d None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:01.399798 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 151/296] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:20:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 11:20:01.405732 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc47042-e160-425a-b2ca-140adc4a2f92 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:01.406243 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc47042-e160-425a-b2ca-140adc4a2f92 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:01.406768 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc47042-e160-425a-b2ca-140adc4a2f92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:01.432004 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-1fc47042-e160-425a-b2ca-140adc4a2f92 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:20:01.433557 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-1fc47042-e160-425a-b2ca-140adc4a2f92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:20:01.456956 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:01.481243 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:01.492081 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 146/297] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:20:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 11:20:01.493373 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca6af74-5bd5-4533-be15-7f8aef81ceed None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:01.493656 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca6af74-5bd5-4533-be15-7f8aef81ceed None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:01.493928 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca6af74-5bd5-4533-be15-7f8aef81ceed None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:01.495339 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 147/298] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:20:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:20:01.504577 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b06073-4e0f-4fb4-8b65-cbec3a161fe5 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:01.504861 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b06073-4e0f-4fb4-8b65-cbec3a161fe5 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:01.505175 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b06073-4e0f-4fb4-8b65-cbec3a161fe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:01.522286 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 152/299] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:20:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 11:20:01.528651 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-a4b06073-4e0f-4fb4-8b65-cbec3a161fe5 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:20:01.530069 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-a4b06073-4e0f-4fb4-8b65-cbec3a161fe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:20:01.598329 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 148/300] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:20:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 11:20:01.783260 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc47042-e160-425a-b2ca-140adc4a2f92 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:01.787439 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b06073-4e0f-4fb4-8b65-cbec3a161fe5 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:01.895479 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc47042-e160-425a-b2ca-140adc4a2f92 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:01.910223 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b06073-4e0f-4fb4-8b65-cbec3a161fe5 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:01.930763 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05ad575-43c1-4de8-a1e7-837aa3722f96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:01.931736 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05ad575-43c1-4de8-a1e7-837aa3722f96 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:01.932156 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05ad575-43c1-4de8-a1e7-837aa3722f96 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:01.932598 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05ad575-43c1-4de8-a1e7-837aa3722f96 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:01.939406 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:01.944734 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05ad575-43c1-4de8-a1e7-837aa3722f96 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:20:01.945814 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87065dc5-a237-42cc-8bfb-75ae42772362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:01.946484 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87065dc5-a237-42cc-8bfb-75ae42772362 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:01.946764 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87065dc5-a237-42cc-8bfb-75ae42772362 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:01.947032 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87065dc5-a237-42cc-8bfb-75ae42772362 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:01.948143 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87065dc5-a237-42cc-8bfb-75ae42772362 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:01.949407 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-d05ad575-43c1-4de8-a1e7-837aa3722f96 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 11:20:01.949407 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:20:01.949407 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:20:01.949407 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:20:01.949407 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:20:01.949407 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:20:01.949407 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:20:01.949407 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:20:01.949407 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:20:01.949407 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:20:01.949407 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:20:01.949407 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:20:01.949407 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:20:01.949407 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:20:01.949407 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:20:01.949407 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:20:01.950260 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:20:01.950260 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:20:01.950260 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:20:01.950260 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:20:01.950260 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:20:01.950260 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:20:01.950260 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:20:01.950260 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:20:01.950260 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:20:01.950260 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:20:01.950260 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:20:01.950260 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Aug 24 11:20:01.950260 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:20:01.950260 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:20:01.950260 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:20:01.950260 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:20:01.955180 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:20:01.955180 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:20:01.955180 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:20:01.955180 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:20:01.955180 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:20:01.955180 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:20:01.955180 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:20:01.955180 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:20:01.955180 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:20:01.955180 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:20:01.955180 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 11:20:01.955180 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Aug 24 11:20:01.955782 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87065dc5-a237-42cc-8bfb-75ae42772362 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:01.955851 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 153/301] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 24 11:20:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:20:01.955851 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05ad575-43c1-4de8-a1e7-837aa3722f96 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:01.955967 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 149/302] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 11:20:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:20:01.956452 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87065dc5-a237-42cc-8bfb-75ae42772362 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:01.973172 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:02.061592 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87065dc5-a237-42cc-8bfb-75ae42772362 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:02.068941 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05ad575-43c1-4de8-a1e7-837aa3722f96 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:02.095904 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2219e70-0ecc-4e52-b32d-27c6d0e5bab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:02.096516 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2219e70-0ecc-4e52-b32d-27c6d0e5bab7 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:02.096789 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2219e70-0ecc-4e52-b32d-27c6d0e5bab7 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:02.097054 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2219e70-0ecc-4e52-b32d-27c6d0e5bab7 None admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:02.097779 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2219e70-0ecc-4e52-b32d-27c6d0e5bab7 None admin] RBAC: Adding query filter params (name=member) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:20:02.098074 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2219e70-0ecc-4e52-b32d-27c6d0e5bab7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:02.099520 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2219e70-0ecc-4e52-b32d-27c6d0e5bab7 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:02.108739 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 150/303] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Aug 24 11:20:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:20:02.109368 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2219e70-0ecc-4e52-b32d-27c6d0e5bab7 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:02.113982 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78cdbc1-baf0-436e-9732-a6e72d47c678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:02.114679 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78cdbc1-baf0-436e-9732-a6e72d47c678 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:02.114957 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78cdbc1-baf0-436e-9732-a6e72d47c678 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:02.115227 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78cdbc1-baf0-436e-9732-a6e72d47c678 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:02.126135 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78cdbc1-baf0-436e-9732-a6e72d47c678 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:20:02.131094 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-c78cdbc1-baf0-436e-9732-a6e72d47c678 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 11:20:02.131094 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:20:02.131094 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:20:02.131094 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:20:02.131094 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:20:02.131094 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:20:02.131094 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:20:02.131094 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:20:02.131094 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:20:02.131094 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:20:02.131094 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:20:02.131094 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:20:02.131094 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:20:02.131094 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:20:02.131094 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:20:02.131094 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:20:02.132186 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:20:02.132186 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:20:02.132186 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:20:02.132186 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:20:02.132186 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:20:02.132186 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:20:02.132186 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:20:02.132186 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:20:02.132186 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:20:02.132186 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:20:02.132186 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:20:02.132186 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Aug 24 11:20:02.132186 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:20:02.132186 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:20:02.132186 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:20:02.132186 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:20:02.133018 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:20:02.133018 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:20:02.133018 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:20:02.133018 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:20:02.133018 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:20:02.133018 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:20:02.133018 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:20:02.133018 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:20:02.133018 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:20:02.133018 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:20:02.133018 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 11:20:02.133018 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Aug 24 11:20:02.133018 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 154/304] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 24 11:20:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:20:02.133018 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78cdbc1-baf0-436e-9732-a6e72d47c678 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:02.177559 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:02.207635 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:02.221472 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2219e70-0ecc-4e52-b32d-27c6d0e5bab7 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:02.237252 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78cdbc1-baf0-436e-9732-a6e72d47c678 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:02.254285 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb78861-8249-4505-97cc-260f56c1f907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:02.254922 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb78861-8249-4505-97cc-260f56c1f907 None admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:02.255198 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb78861-8249-4505-97cc-260f56c1f907 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:02.255469 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb78861-8249-4505-97cc-260f56c1f907 None admin] PATH_INFO: `/v3/groups` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:02.256089 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb78861-8249-4505-97cc-260f56c1f907 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:02.257561 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb78861-8249-4505-97cc-260f56c1f907 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:02.270722 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09c9c7e-dbff-4909-92c4-4e1c1bcdd1f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:02.271350 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09c9c7e-dbff-4909-92c4-4e1c1bcdd1f9 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:02.271626 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09c9c7e-dbff-4909-92c4-4e1c1bcdd1f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:02.271897 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09c9c7e-dbff-4909-92c4-4e1c1bcdd1f9 None admin] PATH_INFO: `/v3/users/7104c363693c4e408034795ec47fd4b4` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:02.273037 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09c9c7e-dbff-4909-92c4-4e1c1bcdd1f9 None admin] RBAC: Authorizing `identity:get_user(user_id=7104c363693c4e408034795ec47fd4b4)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:02.274516 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09c9c7e-dbff-4909-92c4-4e1c1bcdd1f9 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:02.274898 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 151/305] 10.222.0.27 () {60 vars in 1134 bytes} [Wed Aug 24 11:20:02 2022] POST /identity/v3/groups => generated 229 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:20:02.275708 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb78861-8249-4505-97cc-260f56c1f907 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:02.276086 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 155/306] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Aug 24 11:20:02 2022] GET /identity/v3/users/7104c363693c4e408034795ec47fd4b4 => generated 293 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:02.279780 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebee243d-4c3b-4c28-8bbc-4cea948d9c6f None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:02.280062 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebee243d-4c3b-4c28-8bbc-4cea948d9c6f None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:02.280332 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebee243d-4c3b-4c28-8bbc-4cea948d9c6f None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:02.281670 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 156/307] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:20:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:20:02.287354 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebee243d-4c3b-4c28-8bbc-4cea948d9c6f None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:02.391967 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb78861-8249-4505-97cc-260f56c1f907 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:02.399783 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebee243d-4c3b-4c28-8bbc-4cea948d9c6f None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:02.417307 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:02.438035 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad63b58-b777-46c7-a532-5921d868a11e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:02.438723 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad63b58-b777-46c7-a532-5921d868a11e None admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:02.439000 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad63b58-b777-46c7-a532-5921d868a11e None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:02.439269 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad63b58-b777-46c7-a532-5921d868a11e None admin] PATH_INFO: `/v3/system/users/7104c363693c4e408034795ec47fd4b4/roles/27e3e65e24df4b86b0d3d18d3212101d` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:02.440761 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad63b58-b777-46c7-a532-5921d868a11e None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=7104c363693c4e408034795ec47fd4b4, role_id=27e3e65e24df4b86b0d3d18d3212101d)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:02.441180 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e980c04-6919-4302-80af-6554964cc965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:02.441796 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e980c04-6919-4302-80af-6554964cc965 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:02.442072 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e980c04-6919-4302-80af-6554964cc965 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:02.442222 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad63b58-b777-46c7-a532-5921d868a11e None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:02.442420 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e980c04-6919-4302-80af-6554964cc965 None admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:02.443096 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e980c04-6919-4302-80af-6554964cc965 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:20:02.443425 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e980c04-6919-4302-80af-6554964cc965 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:02.445060 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e980c04-6919-4302-80af-6554964cc965 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:02.452467 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 157/308] 10.222.0.27 () {58 vars in 1334 bytes} [Wed Aug 24 11:20:02 2022] PUT /identity/v3/system/users/7104c363693c4e408034795ec47fd4b4/roles/27e3e65e24df4b86b0d3d18d3212101d => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:20:02.453640 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca63f02c-809a-4597-a44b-c795cfd901ac None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:02.453922 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca63f02c-809a-4597-a44b-c795cfd901ac None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:02.454190 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca63f02c-809a-4597-a44b-c795cfd901ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:02.462189 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 152/309] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Aug 24 11:20:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:02.462830 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:02.469363 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e980c04-6919-4302-80af-6554964cc965 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:02.476089 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-ca63f02c-809a-4597-a44b-c795cfd901ac None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:20:02.478094 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-ca63f02c-809a-4597-a44b-c795cfd901ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:20:02.566134 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 158/310] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:20:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 11:20:02.612112 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e980c04-6919-4302-80af-6554964cc965 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:02.647877 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58280541-543b-450b-813c-8c9a34a73c33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:02.648440 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58280541-543b-450b-813c-8c9a34a73c33 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:02.648712 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58280541-543b-450b-813c-8c9a34a73c33 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:02.648980 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58280541-543b-450b-813c-8c9a34a73c33 None admin] PATH_INFO: `/v3/users/e2809cd58a9848bc9eedec23d675b67d` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:02.664132 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58280541-543b-450b-813c-8c9a34a73c33 None admin] RBAC: Authorizing `identity:get_user(user_id=e2809cd58a9848bc9eedec23d675b67d)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:02.665642 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58280541-543b-450b-813c-8c9a34a73c33 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:02.667695 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 153/311] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Aug 24 11:20:02 2022] GET /identity/v3/users/e2809cd58a9848bc9eedec23d675b67d => generated 293 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:20:02.675842 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca63f02c-809a-4597-a44b-c795cfd901ac None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:02.783480 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca63f02c-809a-4597-a44b-c795cfd901ac None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:02.819268 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656465f9-f397-4cca-b1d7-274765db67fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:02.819875 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656465f9-f397-4cca-b1d7-274765db67fa None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:02.820145 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656465f9-f397-4cca-b1d7-274765db67fa None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:02.820410 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656465f9-f397-4cca-b1d7-274765db67fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:02.821139 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656465f9-f397-4cca-b1d7-274765db67fa None admin] RBAC: Adding query filter params (role.id=7b4c8894d4a2493b97242eb334dc9014, user.id=e2809cd58a9848bc9eedec23d675b67d, scope.system=all) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:20:02.821436 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656465f9-f397-4cca-b1d7-274765db67fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:02.822984 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656465f9-f397-4cca-b1d7-274765db67fa None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:02.824457 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:02.829137 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 159/312] 10.222.0.27 () {56 vars in 1308 bytes} [Wed Aug 24 11:20:02 2022] GET /identity/v3/role_assignments?user.id=e2809cd58a9848bc9eedec23d675b67d&scope.system=all&role.id=7b4c8894d4a2493b97242eb334dc9014 => generated 226 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:02.835312 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58280541-543b-450b-813c-8c9a34a73c33 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:02.882688 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:02.949375 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58280541-543b-450b-813c-8c9a34a73c33 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:02.986698 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49307bd7-2453-4e2a-a224-0be5b3f9d2b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:02.987348 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49307bd7-2453-4e2a-a224-0be5b3f9d2b6 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:02.987623 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49307bd7-2453-4e2a-a224-0be5b3f9d2b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:02.987945 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49307bd7-2453-4e2a-a224-0be5b3f9d2b6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:02.998430 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49307bd7-2453-4e2a-a224-0be5b3f9d2b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:20:03.003160 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-49307bd7-2453-4e2a-a224-0be5b3f9d2b6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 11:20:03.003160 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:20:03.003160 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:20:03.003160 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:20:03.003160 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:20:03.003160 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:20:03.003160 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:20:03.003160 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:20:03.003160 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:20:03.003160 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:20:03.003160 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:20:03.003160 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:20:03.003160 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:20:03.003160 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:20:03.003160 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:20:03.003160 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:20:03.004163 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:20:03.004163 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:20:03.004163 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:20:03.004163 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:20:03.004163 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:20:03.004163 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:20:03.004163 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:20:03.004163 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:20:03.004163 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:20:03.004163 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:20:03.004163 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:20:03.004163 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Aug 24 11:20:03.004163 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:20:03.004163 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:20:03.004163 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:20:03.004163 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:20:03.004961 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:20:03.004961 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:20:03.004961 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:20:03.004961 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:20:03.004961 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:20:03.004961 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:20:03.004961 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:20:03.004961 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:20:03.004961 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:20:03.004961 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:20:03.004961 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 11:20:03.004961 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:20:03.004961 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 154/313] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 24 11:20:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:20:03.010380 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656465f9-f397-4cca-b1d7-274765db67fa None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:03.121153 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656465f9-f397-4cca-b1d7-274765db67fa None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:03.155976 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded77d29-6bb9-4afe-b5a1-8495dc7aa8d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:03.156580 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded77d29-6bb9-4afe-b5a1-8495dc7aa8d6 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:03.156848 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded77d29-6bb9-4afe-b5a1-8495dc7aa8d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:03.157108 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded77d29-6bb9-4afe-b5a1-8495dc7aa8d6 None admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:03.157769 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded77d29-6bb9-4afe-b5a1-8495dc7aa8d6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:20:03.158064 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded77d29-6bb9-4afe-b5a1-8495dc7aa8d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:03.159466 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded77d29-6bb9-4afe-b5a1-8495dc7aa8d6 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:03.168214 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 160/314] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Aug 24 11:20:03 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:03.173572 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49307bd7-2453-4e2a-a224-0be5b3f9d2b6 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:03.277760 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:03.282386 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49307bd7-2453-4e2a-a224-0be5b3f9d2b6 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:03.319029 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d04e15a-c0fb-4e7a-aea5-40c4462f24de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:03.320066 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d04e15a-c0fb-4e7a-aea5-40c4462f24de None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:03.320538 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d04e15a-c0fb-4e7a-aea5-40c4462f24de None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:03.321014 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d04e15a-c0fb-4e7a-aea5-40c4462f24de None admin] PATH_INFO: `/v3/users/69da67b6f4da4d1e8aa845f048d5cf77` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:03.322376 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d04e15a-c0fb-4e7a-aea5-40c4462f24de None admin] RBAC: Authorizing `identity:get_user(user_id=69da67b6f4da4d1e8aa845f048d5cf77)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:03.324177 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d04e15a-c0fb-4e7a-aea5-40c4462f24de None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:03.326339 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 155/315] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Aug 24 11:20:03 2022] GET /identity/v3/users/69da67b6f4da4d1e8aa845f048d5cf77 => generated 297 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:03.335498 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded77d29-6bb9-4afe-b5a1-8495dc7aa8d6 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:03.399540 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:03.441934 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded77d29-6bb9-4afe-b5a1-8495dc7aa8d6 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:03.480521 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7d99de-50b9-45a8-b123-a5aadfd5f20e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:03.481129 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7d99de-50b9-45a8-b123-a5aadfd5f20e None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:03.481407 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7d99de-50b9-45a8-b123-a5aadfd5f20e None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:03.481671 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7d99de-50b9-45a8-b123-a5aadfd5f20e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:03.551919 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7d99de-50b9-45a8-b123-a5aadfd5f20e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:03.553322 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7d99de-50b9-45a8-b123-a5aadfd5f20e None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:03.610754 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:03.655832 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 161/316] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 24 11:20:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 11:20:03.661760 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d04e15a-c0fb-4e7a-aea5-40c4462f24de None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:03.764716 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d04e15a-c0fb-4e7a-aea5-40c4462f24de None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:03.799958 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d852a446-2c17-4b04-b2ab-792314cf1d90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:03.800632 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d852a446-2c17-4b04-b2ab-792314cf1d90 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:03.800961 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d852a446-2c17-4b04-b2ab-792314cf1d90 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:03.801234 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d852a446-2c17-4b04-b2ab-792314cf1d90 None admin] PATH_INFO: `/v3/projects/d865cccda5444ed685650f098a696d95` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:03.802454 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d852a446-2c17-4b04-b2ab-792314cf1d90 None admin] RBAC: Authorizing `identity:get_project(project_id=d865cccda5444ed685650f098a696d95)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:03.803886 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d852a446-2c17-4b04-b2ab-792314cf1d90 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:03.805839 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 156/317] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Aug 24 11:20:03 2022] GET /identity/v3/projects/d865cccda5444ed685650f098a696d95 => generated 302 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:03.812065 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7d99de-50b9-45a8-b123-a5aadfd5f20e None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:03.913837 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7d99de-50b9-45a8-b123-a5aadfd5f20e None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:03.951793 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58079e0d-20ae-46a0-9bce-eb1375e015c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:03.953008 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58079e0d-20ae-46a0-9bce-eb1375e015c5 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:03.953503 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58079e0d-20ae-46a0-9bce-eb1375e015c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:03.954054 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58079e0d-20ae-46a0-9bce-eb1375e015c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:03.955584 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58079e0d-20ae-46a0-9bce-eb1375e015c5 None admin] RBAC: Adding query filter params (role.id=7b4c8894d4a2493b97242eb334dc9014, scope.project.id=d865cccda5444ed685650f098a696d95, user.id=69da67b6f4da4d1e8aa845f048d5cf77) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:20:03.956069 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58079e0d-20ae-46a0-9bce-eb1375e015c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:03.958128 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58079e0d-20ae-46a0-9bce-eb1375e015c5 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:03.965417 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 162/318] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Aug 24 11:20:03 2022] GET /identity/v3/role_assignments?user.id=69da67b6f4da4d1e8aa845f048d5cf77&scope.project.id=d865cccda5444ed685650f098a696d95&role.id=7b4c8894d4a2493b97242eb334dc9014 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:04.297391 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c289a2fa-1e2d-4369-87c8-f29d63247ec0 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:04.297677 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c289a2fa-1e2d-4369-87c8-f29d63247ec0 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:04.298031 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c289a2fa-1e2d-4369-87c8-f29d63247ec0 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:04.299605 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 157/319] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:20:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:20:04.304963 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb19f1ee-8974-4179-a48c-a08b5cf45cd9 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:04.305212 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb19f1ee-8974-4179-a48c-a08b5cf45cd9 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:04.305524 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb19f1ee-8974-4179-a48c-a08b5cf45cd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:04.323705 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-fb19f1ee-8974-4179-a48c-a08b5cf45cd9 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:20:04.324882 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-fb19f1ee-8974-4179-a48c-a08b5cf45cd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:20:04.342116 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:04.394001 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 163/320] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:20:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 11:20:04.457312 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1a9be6-2af8-4d20-aee4-41fc00377efa None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:04.457651 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1a9be6-2af8-4d20-aee4-41fc00377efa None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:04.457807 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1a9be6-2af8-4d20-aee4-41fc00377efa None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:04.459416 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 158/321] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:20:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:20:04.464661 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd666ac-8341-4590-9ac0-250c6698db04 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:04.465127 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd666ac-8341-4590-9ac0-250c6698db04 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:04.465200 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd666ac-8341-4590-9ac0-250c6698db04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:04.483891 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-7cd666ac-8341-4590-9ac0-250c6698db04 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:20:04.485092 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-7cd666ac-8341-4590-9ac0-250c6698db04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:20:04.555344 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 164/322] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:20:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 11:20:04.656816 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1a9be6-2af8-4d20-aee4-41fc00377efa None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:04.693206 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:04.758957 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1a9be6-2af8-4d20-aee4-41fc00377efa None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:04.789197 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2b5f22-3f84-40c2-a56c-bf8da2739619 None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:04.789601 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2b5f22-3f84-40c2-a56c-bf8da2739619 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:04.789881 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2b5f22-3f84-40c2-a56c-bf8da2739619 None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:04.791321 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 165/323] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:20:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:20:04.793562 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850a0952-823d-44cc-b6cb-41a18d175c46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:04.794200 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850a0952-823d-44cc-b6cb-41a18d175c46 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:04.794507 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850a0952-823d-44cc-b6cb-41a18d175c46 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:04.794772 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850a0952-823d-44cc-b6cb-41a18d175c46 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:04.795938 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850a0952-823d-44cc-b6cb-41a18d175c46 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:04.796408 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3198f638-f379-47a9-bcd4-6da9eab6d592 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:04.796688 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3198f638-f379-47a9-bcd4-6da9eab6d592 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:04.796958 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3198f638-f379-47a9-bcd4-6da9eab6d592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:04.797392 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850a0952-823d-44cc-b6cb-41a18d175c46 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:04.799117 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 159/324] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 11:20:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:04.804713 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850a0952-823d-44cc-b6cb-41a18d175c46 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:04.817800 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-3198f638-f379-47a9-bcd4-6da9eab6d592 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:20:04.819091 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-3198f638-f379-47a9-bcd4-6da9eab6d592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:20:04.887071 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 166/325] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:20:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 11:20:04.888154 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3198f638-f379-47a9-bcd4-6da9eab6d592 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:04.903362 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850a0952-823d-44cc-b6cb-41a18d175c46 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:04.904360 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:04.905697 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:04.940999 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ead3f24-c080-4726-9eca-fc85fc1e9277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:04.941592 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ead3f24-c080-4726-9eca-fc85fc1e9277 None admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:04.941866 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ead3f24-c080-4726-9eca-fc85fc1e9277 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:04.942133 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ead3f24-c080-4726-9eca-fc85fc1e9277 None admin] PATH_INFO: `/v3/groups` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:04.942795 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ead3f24-c080-4726-9eca-fc85fc1e9277 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:04.944256 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ead3f24-c080-4726-9eca-fc85fc1e9277 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:04.961554 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 160/326] 10.222.0.27 () {60 vars in 1134 bytes} [Wed Aug 24 11:20:04 2022] POST /identity/v3/groups => generated 226 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 11:20:04.999677 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3198f638-f379-47a9-bcd4-6da9eab6d592 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:05.039519 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f6ffcf-471d-41d5-98f0-420a39872373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:05.040153 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f6ffcf-471d-41d5-98f0-420a39872373 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:05.040408 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f6ffcf-471d-41d5-98f0-420a39872373 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:05.040700 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f6ffcf-471d-41d5-98f0-420a39872373 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:05.053134 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f6ffcf-471d-41d5-98f0-420a39872373 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:20:05.058468 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-98f6ffcf-471d-41d5-98f0-420a39872373 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 11:20:05.058468 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:20:05.058468 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:20:05.058468 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:20:05.058468 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:20:05.058468 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:20:05.058468 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:20:05.058468 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:20:05.058468 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:20:05.058468 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:20:05.058468 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:20:05.058468 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:20:05.058468 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:20:05.058468 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:20:05.058468 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:20:05.058468 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:20:05.059420 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:20:05.059420 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:20:05.059420 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:20:05.059420 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:20:05.059420 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:20:05.059420 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:20:05.059420 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:20:05.059420 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:20:05.059420 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:20:05.059420 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:20:05.059420 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:20:05.059420 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Aug 24 11:20:05.059420 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:20:05.059420 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:20:05.059420 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:20:05.059420 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:20:05.060234 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:20:05.060234 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:20:05.060234 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:20:05.060234 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:20:05.060234 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:20:05.060234 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:20:05.060234 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:20:05.060234 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:20:05.060234 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:20:05.060234 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:20:05.060234 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 11:20:05.060234 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Aug 24 11:20:05.060234 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 167/327] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 24 11:20:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:20:05.067289 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ead3f24-c080-4726-9eca-fc85fc1e9277 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:05.151119 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f6ffcf-471d-41d5-98f0-420a39872373 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:05.192236 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ead3f24-c080-4726-9eca-fc85fc1e9277 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:05.232948 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff944e56-41cd-418a-90a7-32a5c8ca52e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:05.233605 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff944e56-41cd-418a-90a7-32a5c8ca52e4 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:05.233883 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff944e56-41cd-418a-90a7-32a5c8ca52e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:05.234156 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff944e56-41cd-418a-90a7-32a5c8ca52e4 None admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:05.234867 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff944e56-41cd-418a-90a7-32a5c8ca52e4 None admin] RBAC: Adding query filter params (name=member) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:20:05.235172 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff944e56-41cd-418a-90a7-32a5c8ca52e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:05.236580 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff944e56-41cd-418a-90a7-32a5c8ca52e4 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:05.245170 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 161/328] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Aug 24 11:20:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:05.248650 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:05.251987 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff944e56-41cd-418a-90a7-32a5c8ca52e4 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:05.281753 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f6ffcf-471d-41d5-98f0-420a39872373 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:05.283715 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:05.329385 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab5ce21-8bdd-4020-8ae0-81fccfc1bbe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:05.330057 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab5ce21-8bdd-4020-8ae0-81fccfc1bbe3 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:05.330337 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab5ce21-8bdd-4020-8ae0-81fccfc1bbe3 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:05.330641 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab5ce21-8bdd-4020-8ae0-81fccfc1bbe3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:05.343397 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab5ce21-8bdd-4020-8ae0-81fccfc1bbe3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:20:05.348313 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-fab5ce21-8bdd-4020-8ae0-81fccfc1bbe3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 11:20:05.348313 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:20:05.348313 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:20:05.348313 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:20:05.348313 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:20:05.348313 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:20:05.348313 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:20:05.348313 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:20:05.348313 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:20:05.348313 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:20:05.348313 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:20:05.348313 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:20:05.348313 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:20:05.348313 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:20:05.348313 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:20:05.348313 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:20:05.349181 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:20:05.349181 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:20:05.349181 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:20:05.349181 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:20:05.349181 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:20:05.349181 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:20:05.349181 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:20:05.349181 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:20:05.349181 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:20:05.349181 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:20:05.349181 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:20:05.349181 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Aug 24 11:20:05.349181 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:20:05.349181 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:20:05.349181 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:20:05.349181 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:20:05.349974 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:20:05.349974 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:20:05.349974 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:20:05.349974 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:20:05.349974 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:20:05.349974 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:20:05.349974 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:20:05.349974 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:20:05.349974 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:20:05.349974 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:20:05.349974 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 11:20:05.349974 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Aug 24 11:20:05.349974 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 168/329] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 24 11:20:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 11:20:05.355682 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab5ce21-8bdd-4020-8ae0-81fccfc1bbe3 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:05.384468 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff944e56-41cd-418a-90a7-32a5c8ca52e4 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:05.434381 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b024e78f-ba8d-4b61-9c3d-3b44ce1f23ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:05.435197 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b024e78f-ba8d-4b61-9c3d-3b44ce1f23ec None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:05.435629 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b024e78f-ba8d-4b61-9c3d-3b44ce1f23ec None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:05.435979 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b024e78f-ba8d-4b61-9c3d-3b44ce1f23ec None admin] PATH_INFO: `/v3/users/7104c363693c4e408034795ec47fd4b4` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:05.437308 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b024e78f-ba8d-4b61-9c3d-3b44ce1f23ec None admin] RBAC: Authorizing `identity:get_user(user_id=7104c363693c4e408034795ec47fd4b4)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:05.439011 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b024e78f-ba8d-4b61-9c3d-3b44ce1f23ec None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:05.440864 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 162/330] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Aug 24 11:20:05 2022] GET /identity/v3/users/7104c363693c4e408034795ec47fd4b4 => generated 293 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:05.449739 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b024e78f-ba8d-4b61-9c3d-3b44ce1f23ec None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:05.496522 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab5ce21-8bdd-4020-8ae0-81fccfc1bbe3 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:05.547329 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fac97bd-ba0d-4ccd-820d-61bd3298e214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:05.548474 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fac97bd-ba0d-4ccd-820d-61bd3298e214 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:05.549763 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fac97bd-ba0d-4ccd-820d-61bd3298e214 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:05.550102 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fac97bd-ba0d-4ccd-820d-61bd3298e214 None admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:05.550957 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fac97bd-ba0d-4ccd-820d-61bd3298e214 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:20:05.551262 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fac97bd-ba0d-4ccd-820d-61bd3298e214 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:05.552679 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fac97bd-ba0d-4ccd-820d-61bd3298e214 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:05.554245 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:05.566381 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 169/331] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Aug 24 11:20:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:05.569244 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fac97bd-ba0d-4ccd-820d-61bd3298e214 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:05.585273 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:05.597222 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b024e78f-ba8d-4b61-9c3d-3b44ce1f23ec None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:05.642327 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8abdf1-3da5-4390-98fb-d1f60656ce03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:05.643451 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8abdf1-3da5-4390-98fb-d1f60656ce03 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:05.643931 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8abdf1-3da5-4390-98fb-d1f60656ce03 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:05.644479 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8abdf1-3da5-4390-98fb-d1f60656ce03 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:05.646674 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8abdf1-3da5-4390-98fb-d1f60656ce03 None admin] RBAC: Adding query filter params (role.id=27e3e65e24df4b86b0d3d18d3212101d, user.id=7104c363693c4e408034795ec47fd4b4, scope.system=all) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:20:05.647200 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8abdf1-3da5-4390-98fb-d1f60656ce03 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:05.648868 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8abdf1-3da5-4390-98fb-d1f60656ce03 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:05.665503 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 163/332] 10.222.0.27 () {56 vars in 1308 bytes} [Wed Aug 24 11:20:05 2022] GET /identity/v3/role_assignments?user.id=7104c363693c4e408034795ec47fd4b4&scope.system=all&role.id=27e3e65e24df4b86b0d3d18d3212101d => generated 510 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:05.706940 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fac97bd-ba0d-4ccd-820d-61bd3298e214 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:05.756725 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f82c50a-8f50-44fe-9d21-c4e5991ed5e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:05.757756 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f82c50a-8f50-44fe-9d21-c4e5991ed5e3 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:05.758287 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f82c50a-8f50-44fe-9d21-c4e5991ed5e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:05.758781 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f82c50a-8f50-44fe-9d21-c4e5991ed5e3 None admin] PATH_INFO: `/v3/users/e2809cd58a9848bc9eedec23d675b67d` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:05.761724 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f82c50a-8f50-44fe-9d21-c4e5991ed5e3 None admin] RBAC: Authorizing `identity:get_user(user_id=e2809cd58a9848bc9eedec23d675b67d)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:05.763787 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f82c50a-8f50-44fe-9d21-c4e5991ed5e3 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:05.766153 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 170/333] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Aug 24 11:20:05 2022] GET /identity/v3/users/e2809cd58a9848bc9eedec23d675b67d => generated 293 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:20:05.772438 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8abdf1-3da5-4390-98fb-d1f60656ce03 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:05.890287 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8abdf1-3da5-4390-98fb-d1f60656ce03 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:05.926810 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb90de3-be79-4d44-bfc9-b8c983111cfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:05.927486 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb90de3-be79-4d44-bfc9-b8c983111cfd None admin] REQUEST_METHOD: `PUT` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:05.927764 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb90de3-be79-4d44-bfc9-b8c983111cfd None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:05.928040 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb90de3-be79-4d44-bfc9-b8c983111cfd None admin] PATH_INFO: `/v3/system/users/e2809cd58a9848bc9eedec23d675b67d/roles/7b4c8894d4a2493b97242eb334dc9014` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:05.929488 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb90de3-be79-4d44-bfc9-b8c983111cfd None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=e2809cd58a9848bc9eedec23d675b67d, role_id=7b4c8894d4a2493b97242eb334dc9014)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:05.930937 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb90de3-be79-4d44-bfc9-b8c983111cfd None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:05.942003 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 164/334] 10.222.0.27 () {58 vars in 1334 bytes} [Wed Aug 24 11:20:05 2022] PUT /identity/v3/system/users/e2809cd58a9848bc9eedec23d675b67d/roles/7b4c8894d4a2493b97242eb334dc9014 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:20:07.389538 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c261477-2497-41fc-849d-12f5403d573f None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:07.390678 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c261477-2497-41fc-849d-12f5403d573f None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:07.391213 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c261477-2497-41fc-849d-12f5403d573f None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:07.393065 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 171/335] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:20:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:20:07.399109 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6d57a7-4e6d-4861-ac53-9f9bd97228cd None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:07.399939 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6d57a7-4e6d-4861-ac53-9f9bd97228cd None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:07.400413 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6d57a7-4e6d-4861-ac53-9f9bd97228cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:07.427451 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-2a6d57a7-4e6d-4861-ac53-9f9bd97228cd None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:20:07.428679 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-2a6d57a7-4e6d-4861-ac53-9f9bd97228cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:20:07.440106 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:07.515802 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 165/336] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:20:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 11:20:07.621660 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612340d6-a960-4d79-a793-de5eb6698865 None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:07.622302 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612340d6-a960-4d79-a793-de5eb6698865 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:07.622855 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612340d6-a960-4d79-a793-de5eb6698865 None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:07.624683 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 172/337] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:20:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:20:07.632878 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd004ae-e0a1-4647-9425-2e38f46a149f None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:07.633151 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd004ae-e0a1-4647-9425-2e38f46a149f None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:07.633594 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd004ae-e0a1-4647-9425-2e38f46a149f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:07.671421 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-3fd004ae-e0a1-4647-9425-2e38f46a149f None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:20:07.672812 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-3fd004ae-e0a1-4647-9425-2e38f46a149f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:20:07.752285 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 166/338] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:20:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 11:20:07.974327 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612340d6-a960-4d79-a793-de5eb6698865 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:08.035155 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda59944-2f39-4b26-9e89-a4fdcd7c59c4 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:08.035826 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda59944-2f39-4b26-9e89-a4fdcd7c59c4 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:08.036317 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda59944-2f39-4b26-9e89-a4fdcd7c59c4 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:08.038322 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 167/339] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:20:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 11:20:08.047566 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ca52f4-6bb0-4959-8169-91cba79993ce None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:08.048207 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ca52f4-6bb0-4959-8169-91cba79993ce None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:08.048691 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ca52f4-6bb0-4959-8169-91cba79993ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:08.051235 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:08.084050 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-56ca52f4-6bb0-4959-8169-91cba79993ce None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:20:08.085574 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-56ca52f4-6bb0-4959-8169-91cba79993ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:20:08.107842 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612340d6-a960-4d79-a793-de5eb6698865 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:08.157832 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffbf043-a143-4779-9fcc-2e0c80b52e7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:08.158863 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffbf043-a143-4779-9fcc-2e0c80b52e7e None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:08.159289 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffbf043-a143-4779-9fcc-2e0c80b52e7e None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:08.159690 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffbf043-a143-4779-9fcc-2e0c80b52e7e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:08.172398 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffbf043-a143-4779-9fcc-2e0c80b52e7e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:20:08.179179 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-1ffbf043-a143-4779-9fcc-2e0c80b52e7e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 11:20:08.179179 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:20:08.179179 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:20:08.179179 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:20:08.179179 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:20:08.179179 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:20:08.179179 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:20:08.179179 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:20:08.179179 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:20:08.179179 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:20:08.179179 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:20:08.179179 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:20:08.179179 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:20:08.179179 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:20:08.179179 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:20:08.179179 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:20:08.180106 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:20:08.180106 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:20:08.180106 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:20:08.180106 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:20:08.180106 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:20:08.180106 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:20:08.180106 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:20:08.180106 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:20:08.180106 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:20:08.180106 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:20:08.180106 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:20:08.180106 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Aug 24 11:20:08.180106 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:20:08.180106 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:20:08.180106 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:20:08.180106 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:20:08.180900 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:20:08.180900 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:20:08.180900 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:20:08.180900 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:20:08.180900 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:20:08.180900 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:20:08.180900 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:20:08.180900 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:20:08.180900 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:20:08.180900 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:20:08.180900 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 11:20:08.180900 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Aug 24 11:20:08.183363 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 173/340] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 24 11:20:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:20:08.189568 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffbf043-a143-4779-9fcc-2e0c80b52e7e None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:08.216787 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 168/341] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:20:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 11:20:08.295345 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffbf043-a143-4779-9fcc-2e0c80b52e7e None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:08.319544 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:08.331329 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637344ef-748e-4ad9-9b9b-13661f90d3a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:08.331969 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637344ef-748e-4ad9-9b9b-13661f90d3a9 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:08.332245 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637344ef-748e-4ad9-9b9b-13661f90d3a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:08.332514 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637344ef-748e-4ad9-9b9b-13661f90d3a9 None admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:08.333183 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637344ef-748e-4ad9-9b9b-13661f90d3a9 None admin] RBAC: Adding query filter params (name=member) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:20:08.333483 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637344ef-748e-4ad9-9b9b-13661f90d3a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:08.334905 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637344ef-748e-4ad9-9b9b-13661f90d3a9 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:08.343978 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 174/342] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Aug 24 11:20:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:20:08.349761 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ca52f4-6bb0-4959-8169-91cba79993ce None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:08.366807 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:08.368676 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637344ef-748e-4ad9-9b9b-13661f90d3a9 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:08.475473 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637344ef-748e-4ad9-9b9b-13661f90d3a9 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:08.511133 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588fa76e-8da5-4c4e-b660-42ec800c9465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:08.512090 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588fa76e-8da5-4c4e-b660-42ec800c9465 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:08.512591 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588fa76e-8da5-4c4e-b660-42ec800c9465 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:08.513028 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588fa76e-8da5-4c4e-b660-42ec800c9465 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:08.524360 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588fa76e-8da5-4c4e-b660-42ec800c9465 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:20:08.530249 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-588fa76e-8da5-4c4e-b660-42ec800c9465 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 11:20:08.530249 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:20:08.530249 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:20:08.530249 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:20:08.530249 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:20:08.530249 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:20:08.530249 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:20:08.530249 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:20:08.530249 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:20:08.530249 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:20:08.530249 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:20:08.530249 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:20:08.530249 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:20:08.530249 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:20:08.530249 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:20:08.530249 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:20:08.531338 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:20:08.531338 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:20:08.531338 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:20:08.531338 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:20:08.531338 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:20:08.531338 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:20:08.531338 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:20:08.531338 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:20:08.531338 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:20:08.531338 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:20:08.531338 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:20:08.531338 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Aug 24 11:20:08.531338 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:20:08.531338 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:20:08.531338 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:20:08.531338 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:20:08.532314 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:20:08.532314 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:20:08.532314 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:20:08.532314 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:20:08.532314 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:20:08.532314 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:20:08.532314 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:20:08.532314 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:20:08.532314 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:20:08.532314 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:20:08.532314 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 11:20:08.532314 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Aug 24 11:20:08.534558 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 175/343] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Aug 24 11:20:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:20:08.540491 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ca52f4-6bb0-4959-8169-91cba79993ce None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:08.544833 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588fa76e-8da5-4c4e-b660-42ec800c9465 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:08.595377 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:08.596546 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f78a67-e0bb-4ff9-a41f-13e9b5b36d83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:08.597156 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f78a67-e0bb-4ff9-a41f-13e9b5b36d83 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:08.597612 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f78a67-e0bb-4ff9-a41f-13e9b5b36d83 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:08.597967 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f78a67-e0bb-4ff9-a41f-13e9b5b36d83 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:08.651325 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588fa76e-8da5-4c4e-b660-42ec800c9465 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:08.686916 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cb56de-aeab-4dd9-ae14-600c6e2af5bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:08.687807 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cb56de-aeab-4dd9-ae14-600c6e2af5bf None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:08.688384 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cb56de-aeab-4dd9-ae14-600c6e2af5bf None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:08.688802 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cb56de-aeab-4dd9-ae14-600c6e2af5bf None admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:08.689613 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cb56de-aeab-4dd9-ae14-600c6e2af5bf None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:20:08.690048 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cb56de-aeab-4dd9-ae14-600c6e2af5bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:08.691760 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cb56de-aeab-4dd9-ae14-600c6e2af5bf None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:08.700860 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 176/344] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Aug 24 11:20:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:08.702405 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7ac6b4-fe8b-4e13-a21d-91b454c1828b None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:08.702825 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7ac6b4-fe8b-4e13-a21d-91b454c1828b None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:08.703227 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7ac6b4-fe8b-4e13-a21d-91b454c1828b None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:08.704852 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 177/345] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:20:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:20:08.706224 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7ac6b4-fe8b-4e13-a21d-91b454c1828b None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:08.730881 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f78a67-e0bb-4ff9-a41f-13e9b5b36d83 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:08.732456 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f78a67-e0bb-4ff9-a41f-13e9b5b36d83 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:08.744822 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:08.811456 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7ac6b4-fe8b-4e13-a21d-91b454c1828b None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:08.821608 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:08.847644 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9836d05-3bcd-455d-8e5a-66c7f53df429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:08.848278 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9836d05-3bcd-455d-8e5a-66c7f53df429 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:08.848555 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9836d05-3bcd-455d-8e5a-66c7f53df429 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:08.848824 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9836d05-3bcd-455d-8e5a-66c7f53df429 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:08.925151 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 169/346] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 24 11:20:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 573 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 11:20:08.925151 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e2f038-c82f-4657-8341-cc70fde2225a None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:08.925151 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e2f038-c82f-4657-8341-cc70fde2225a None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:08.925151 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e2f038-c82f-4657-8341-cc70fde2225a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:08.928535 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9836d05-3bcd-455d-8e5a-66c7f53df429 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:08.930242 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9836d05-3bcd-455d-8e5a-66c7f53df429 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:08.952191 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-86e2f038-c82f-4657-8341-cc70fde2225a None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:20:08.953797 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-86e2f038-c82f-4657-8341-cc70fde2225a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:20:09.048792 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 170/347] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:20:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 11:20:09.048977 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e2f038-c82f-4657-8341-cc70fde2225a None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:09.052883 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 178/348] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 24 11:20:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 11:20:09.053955 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9836d05-3bcd-455d-8e5a-66c7f53df429 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:09.072900 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:09.091436 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:09.169769 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e2f038-c82f-4657-8341-cc70fde2225a None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:09.191477 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9836d05-3bcd-455d-8e5a-66c7f53df429 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:09.208226 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908adfb3-79d9-4936-aaa6-3e59d51da431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:09.208868 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908adfb3-79d9-4936-aaa6-3e59d51da431 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:09.209146 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908adfb3-79d9-4936-aaa6-3e59d51da431 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:09.209419 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908adfb3-79d9-4936-aaa6-3e59d51da431 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:09.220189 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908adfb3-79d9-4936-aaa6-3e59d51da431 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:20:09.224976 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-908adfb3-79d9-4936-aaa6-3e59d51da431 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 11:20:09.224976 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:20:09.224976 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:20:09.224976 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:20:09.224976 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:20:09.224976 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:20:09.224976 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:20:09.224976 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:20:09.224976 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:20:09.224976 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:20:09.224976 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:20:09.224976 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:20:09.224976 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:20:09.224976 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:20:09.224976 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:20:09.224976 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:20:09.225943 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:20:09.225943 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:20:09.225943 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:20:09.225943 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:20:09.225943 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:20:09.225943 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:20:09.225943 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:20:09.225943 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:20:09.225943 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:20:09.225943 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:20:09.225943 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:20:09.225943 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Aug 24 11:20:09.225943 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:20:09.225943 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:20:09.225943 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:20:09.225943 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:20:09.226775 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:20:09.226775 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:20:09.226775 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:20:09.226775 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:20:09.226775 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:20:09.226775 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:20:09.226775 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:20:09.226775 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:20:09.226775 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:20:09.226775 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:20:09.226775 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 11:20:09.226775 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:20:09.226775 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 171/349] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 24 11:20:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:20:09.228135 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dae685e-9b78-49f4-ae3e-0a48c2299cb7 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:09.228135 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dae685e-9b78-49f4-ae3e-0a48c2299cb7 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:09.228399 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dae685e-9b78-49f4-ae3e-0a48c2299cb7 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:09.233025 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 172/350] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:20:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:20:09.233025 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dae685e-9b78-49f4-ae3e-0a48c2299cb7 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:09.237630 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847e8b43-5710-4d09-a36c-adf4857464ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:09.238657 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847e8b43-5710-4d09-a36c-adf4857464ee None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:09.239130 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847e8b43-5710-4d09-a36c-adf4857464ee None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:09.239688 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847e8b43-5710-4d09-a36c-adf4857464ee None admin] PATH_INFO: `/v3/projects/71e3821279484b7087ded02a637ad206` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:09.241086 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847e8b43-5710-4d09-a36c-adf4857464ee None admin] RBAC: Authorizing `identity:get_project(project_id=71e3821279484b7087ded02a637ad206)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:09.242870 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847e8b43-5710-4d09-a36c-adf4857464ee None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:09.244772 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 179/351] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Aug 24 11:20:09 2022] GET /identity/v3/projects/71e3821279484b7087ded02a637ad206 => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:09.246164 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf3712d-8399-4dc3-b46b-3d4299c8f620 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:09.246646 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf3712d-8399-4dc3-b46b-3d4299c8f620 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:09.247167 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf3712d-8399-4dc3-b46b-3d4299c8f620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:09.271817 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-caf3712d-8399-4dc3-b46b-3d4299c8f620 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:20:09.273293 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-caf3712d-8399-4dc3-b46b-3d4299c8f620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:20:09.333993 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:09.342275 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dae685e-9b78-49f4-ae3e-0a48c2299cb7 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:09.347351 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 180/352] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:20:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 11:20:09.348508 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf3712d-8399-4dc3-b46b-3d4299c8f620 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:09.357604 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:09.382323 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861776ec-245a-42e3-b833-7d0bc05dca3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:09.383033 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861776ec-245a-42e3-b833-7d0bc05dca3f None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:09.383329 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861776ec-245a-42e3-b833-7d0bc05dca3f None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:09.383676 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861776ec-245a-42e3-b833-7d0bc05dca3f None admin] PATH_INFO: `/v3/projects/71e3821279484b7087ded02a637ad206` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:09.384962 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861776ec-245a-42e3-b833-7d0bc05dca3f None admin] RBAC: Authorizing `identity:get_project(project_id=71e3821279484b7087ded02a637ad206)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:09.386464 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861776ec-245a-42e3-b833-7d0bc05dca3f None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:09.388418 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 173/353] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Aug 24 11:20:09 2022] GET /identity/v3/projects/71e3821279484b7087ded02a637ad206 => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:09.389986 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861776ec-245a-42e3-b833-7d0bc05dca3f None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:09.460251 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf3712d-8399-4dc3-b46b-3d4299c8f620 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:09.496775 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeeb8a3-c032-45cd-a693-d1d61fa59781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:09.498274 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeeb8a3-c032-45cd-a693-d1d61fa59781 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:09.498767 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeeb8a3-c032-45cd-a693-d1d61fa59781 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:09.499216 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeeb8a3-c032-45cd-a693-d1d61fa59781 None admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:09.500184 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aeeb8a3-c032-45cd-a693-d1d61fa59781 None admin] RBAC: Adding query filter params (name=member) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:20:09.500712 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aeeb8a3-c032-45cd-a693-d1d61fa59781 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:09.502269 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aeeb8a3-c032-45cd-a693-d1d61fa59781 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:09.503196 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861776ec-245a-42e3-b833-7d0bc05dca3f None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:09.513585 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 181/354] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Aug 24 11:20:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:09.514792 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeeb8a3-c032-45cd-a693-d1d61fa59781 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:09.542225 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02b41dd-4678-42b7-97cd-f3e649ff7964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:09.542928 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02b41dd-4678-42b7-97cd-f3e649ff7964 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:09.543207 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02b41dd-4678-42b7-97cd-f3e649ff7964 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:09.543526 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02b41dd-4678-42b7-97cd-f3e649ff7964 None admin] PATH_INFO: `/v3/groups/2578f3ba31c14d518437e94f91a5599c` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:09.550777 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02b41dd-4678-42b7-97cd-f3e649ff7964 None admin] RBAC: Authorizing `identity:get_group(group_id=2578f3ba31c14d518437e94f91a5599c)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:09.552318 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02b41dd-4678-42b7-97cd-f3e649ff7964 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:09.554298 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 174/355] 10.222.0.27 () {56 vars in 1180 bytes} [Wed Aug 24 11:20:09 2022] GET /identity/v3/groups/2578f3ba31c14d518437e94f91a5599c => generated 226 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:09.557544 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02b41dd-4678-42b7-97cd-f3e649ff7964 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:09.586568 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:09.598698 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:09.635062 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeeb8a3-c032-45cd-a693-d1d61fa59781 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:09.671098 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02b41dd-4678-42b7-97cd-f3e649ff7964 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:09.673919 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904cf04e-88ec-480c-96ee-1ea5a84537ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:09.674817 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904cf04e-88ec-480c-96ee-1ea5a84537ed None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:09.675302 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904cf04e-88ec-480c-96ee-1ea5a84537ed None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:09.676054 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904cf04e-88ec-480c-96ee-1ea5a84537ed None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:09.689181 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904cf04e-88ec-480c-96ee-1ea5a84537ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:20:09.695346 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-904cf04e-88ec-480c-96ee-1ea5a84537ed None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 11:20:09.695346 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:20:09.695346 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:20:09.695346 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:20:09.695346 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:20:09.695346 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:20:09.695346 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:20:09.695346 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:20:09.695346 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:20:09.695346 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:20:09.695346 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:20:09.695346 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:20:09.695346 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:20:09.695346 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:20:09.695346 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:20:09.695346 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:20:09.696298 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:20:09.696298 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:20:09.696298 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:20:09.696298 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:20:09.696298 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:20:09.696298 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:20:09.696298 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:20:09.696298 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:20:09.696298 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:20:09.696298 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:20:09.696298 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:20:09.696298 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Aug 24 11:20:09.696298 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:20:09.696298 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:20:09.696298 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:20:09.696298 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:20:09.697134 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:20:09.697134 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:20:09.697134 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:20:09.697134 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:20:09.697134 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:20:09.697134 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:20:09.697134 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:20:09.697134 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:20:09.697134 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:20:09.697134 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:20:09.697134 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 11:20:09.697134 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Aug 24 11:20:09.699080 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 182/356] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 24 11:20:09 2022] GET /identity/v3/roles/reader => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:20:09.700040 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904cf04e-88ec-480c-96ee-1ea5a84537ed None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:09.709941 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f98491-ea11-4571-b591-8d2af751b986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:09.710756 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f98491-ea11-4571-b591-8d2af751b986 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:09.711103 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f98491-ea11-4571-b591-8d2af751b986 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:09.711452 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f98491-ea11-4571-b591-8d2af751b986 None admin] PATH_INFO: `/v3/groups/2578f3ba31c14d518437e94f91a5599c` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:09.714919 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f98491-ea11-4571-b591-8d2af751b986 None admin] RBAC: Authorizing `identity:get_group(group_id=2578f3ba31c14d518437e94f91a5599c)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:09.716475 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f98491-ea11-4571-b591-8d2af751b986 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:09.718311 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 175/357] 10.222.0.27 () {56 vars in 1180 bytes} [Wed Aug 24 11:20:09 2022] GET /identity/v3/groups/2578f3ba31c14d518437e94f91a5599c => generated 226 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:09.718963 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f98491-ea11-4571-b591-8d2af751b986 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:09.836015 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:09.842244 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904cf04e-88ec-480c-96ee-1ea5a84537ed None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:09.845092 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f98491-ea11-4571-b591-8d2af751b986 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:09.872566 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:09.882853 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747529a0-05df-4085-8dae-94b7e333d8eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:09.883801 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747529a0-05df-4085-8dae-94b7e333d8eb None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:09.884266 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747529a0-05df-4085-8dae-94b7e333d8eb None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:09.884741 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747529a0-05df-4085-8dae-94b7e333d8eb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:09.885509 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba69c6f7-2952-4de3-a123-e5aba36ce111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:09.886051 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba69c6f7-2952-4de3-a123-e5aba36ce111 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:09.886334 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba69c6f7-2952-4de3-a123-e5aba36ce111 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:09.886650 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba69c6f7-2952-4de3-a123-e5aba36ce111 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:09.887389 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba69c6f7-2952-4de3-a123-e5aba36ce111 None admin] RBAC: Adding query filter params (group.id=2578f3ba31c14d518437e94f91a5599c, role.id=27e3e65e24df4b86b0d3d18d3212101d, scope.project.id=71e3821279484b7087ded02a637ad206) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:20:09.887820 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba69c6f7-2952-4de3-a123-e5aba36ce111 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:09.889391 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba69c6f7-2952-4de3-a123-e5aba36ce111 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:09.897745 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 176/358] 10.222.0.27 () {56 vars in 1376 bytes} [Wed Aug 24 11:20:09 2022] GET /identity/v3/role_assignments?group.id=2578f3ba31c14d518437e94f91a5599c&scope.project.id=71e3821279484b7087ded02a637ad206&role.id=27e3e65e24df4b86b0d3d18d3212101d => generated 260 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:09.898741 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba69c6f7-2952-4de3-a123-e5aba36ce111 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:09.973278 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747529a0-05df-4085-8dae-94b7e333d8eb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:09.975539 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747529a0-05df-4085-8dae-94b7e333d8eb None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:10.021459 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba69c6f7-2952-4de3-a123-e5aba36ce111 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:10.077520 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7491e423-e30a-4d31-848d-d33f75f712d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:10.078376 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7491e423-e30a-4d31-848d-d33f75f712d0 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:10.079009 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7491e423-e30a-4d31-848d-d33f75f712d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:10.079009 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7491e423-e30a-4d31-848d-d33f75f712d0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:10.092004 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7491e423-e30a-4d31-848d-d33f75f712d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:20:10.098809 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-7491e423-e30a-4d31-848d-d33f75f712d0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 11:20:10.098809 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:20:10.098809 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:20:10.098809 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:20:10.098809 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:20:10.098809 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:20:10.098809 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:20:10.098809 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:20:10.098809 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:20:10.098809 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:20:10.098809 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:20:10.098809 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:20:10.098809 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:20:10.098809 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:20:10.098809 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:20:10.098809 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:20:10.099838 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:20:10.099838 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:20:10.099838 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:20:10.099838 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:20:10.099838 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:20:10.099838 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:20:10.099838 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:20:10.099838 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:20:10.099838 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:20:10.099838 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:20:10.099838 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:20:10.099838 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Aug 24 11:20:10.099838 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:20:10.099838 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:20:10.099838 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:20:10.099838 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:20:10.100627 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:20:10.100627 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:20:10.100627 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:20:10.100627 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:20:10.100627 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:20:10.100627 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:20:10.100627 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:20:10.100627 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:20:10.100627 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:20:10.100627 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:20:10.100627 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 11:20:10.100627 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:20:10.100627 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 177/359] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Aug 24 11:20:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:20:10.101274 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7491e423-e30a-4d31-848d-d33f75f712d0 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:10.123547 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 183/360] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 24 11:20:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 11:20:10.125192 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747529a0-05df-4085-8dae-94b7e333d8eb None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:10.146477 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:10.171924 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:10.255151 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7491e423-e30a-4d31-848d-d33f75f712d0 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:10.273237 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747529a0-05df-4085-8dae-94b7e333d8eb None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:10.296659 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fbec73-447b-4b5a-9d38-0a31aa34bede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:10.297284 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fbec73-447b-4b5a-9d38-0a31aa34bede None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:10.297559 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fbec73-447b-4b5a-9d38-0a31aa34bede None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:10.297834 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fbec73-447b-4b5a-9d38-0a31aa34bede None admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:10.299739 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fbec73-447b-4b5a-9d38-0a31aa34bede None admin] RBAC: Adding query filter params (name=reader) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:20:10.299739 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fbec73-447b-4b5a-9d38-0a31aa34bede None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:10.300396 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fbec73-447b-4b5a-9d38-0a31aa34bede None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:10.312051 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 178/361] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Aug 24 11:20:10 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:10.313347 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de26588-d00f-4249-bd90-91cc16175162 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:10.313631 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de26588-d00f-4249-bd90-91cc16175162 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:10.313906 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de26588-d00f-4249-bd90-91cc16175162 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:10.315376 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 179/362] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:20:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:20:10.315916 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de26588-d00f-4249-bd90-91cc16175162 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:10.326569 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8accde9b-c458-48b8-a980-d8f24a1c5de0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:10.327193 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8accde9b-c458-48b8-a980-d8f24a1c5de0 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:10.327468 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8accde9b-c458-48b8-a980-d8f24a1c5de0 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:10.327744 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8accde9b-c458-48b8-a980-d8f24a1c5de0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:10.328733 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8accde9b-c458-48b8-a980-d8f24a1c5de0 None admin] RBAC: Adding query filter params (group.id=2578f3ba31c14d518437e94f91a5599c, role.id=96f07e9110194606acccfbd8467649a7, scope.project.id=71e3821279484b7087ded02a637ad206) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:20:10.328849 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8accde9b-c458-48b8-a980-d8f24a1c5de0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:10.330231 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8accde9b-c458-48b8-a980-d8f24a1c5de0 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:10.336548 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 184/363] 10.222.0.27 () {56 vars in 1376 bytes} [Wed Aug 24 11:20:10 2022] GET /identity/v3/role_assignments?group.id=2578f3ba31c14d518437e94f91a5599c&scope.project.id=71e3821279484b7087ded02a637ad206&role.id=96f07e9110194606acccfbd8467649a7 => generated 260 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:10.337279 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8accde9b-c458-48b8-a980-d8f24a1c5de0 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:10.432279 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:10.455645 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de26588-d00f-4249-bd90-91cc16175162 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:10.466675 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:10.483095 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8accde9b-c458-48b8-a980-d8f24a1c5de0 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:10.515495 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464766bb-a980-4601-9dfa-92f1b34ba1f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:10.516593 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464766bb-a980-4601-9dfa-92f1b34ba1f2 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:10.516882 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464766bb-a980-4601-9dfa-92f1b34ba1f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:10.517210 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464766bb-a980-4601-9dfa-92f1b34ba1f2 None admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:10.517971 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464766bb-a980-4601-9dfa-92f1b34ba1f2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:20:10.518274 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464766bb-a980-4601-9dfa-92f1b34ba1f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:10.519825 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464766bb-a980-4601-9dfa-92f1b34ba1f2 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:10.529250 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8415ed15-b626-43be-b0c3-3790d7a268a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:10.529949 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8415ed15-b626-43be-b0c3-3790d7a268a0 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:10.530215 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8415ed15-b626-43be-b0c3-3790d7a268a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:10.530517 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8415ed15-b626-43be-b0c3-3790d7a268a0 None admin] PATH_INFO: `/v3/projects/d865cccda5444ed685650f098a696d95` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:10.531411 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 180/364] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Aug 24 11:20:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:10.531724 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8415ed15-b626-43be-b0c3-3790d7a268a0 None admin] RBAC: Authorizing `identity:get_project(project_id=d865cccda5444ed685650f098a696d95)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:10.532277 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464766bb-a980-4601-9dfa-92f1b34ba1f2 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:10.533320 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8415ed15-b626-43be-b0c3-3790d7a268a0 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:10.535471 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 185/365] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Aug 24 11:20:10 2022] GET /identity/v3/projects/d865cccda5444ed685650f098a696d95 => generated 302 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:10.536759 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d592aec-192b-44cf-9952-6576a3c3d26a None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:10.537064 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d592aec-192b-44cf-9952-6576a3c3d26a None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:10.537336 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d592aec-192b-44cf-9952-6576a3c3d26a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:10.561447 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-0d592aec-192b-44cf-9952-6576a3c3d26a None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:20:10.562761 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-0d592aec-192b-44cf-9952-6576a3c3d26a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:20:10.642898 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 186/366] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:20:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 11:20:10.644862 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d592aec-192b-44cf-9952-6576a3c3d26a None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:10.676491 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464766bb-a980-4601-9dfa-92f1b34ba1f2 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:10.730923 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44054459-12b5-43ad-bee3-2a1a445573a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:10.732267 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44054459-12b5-43ad-bee3-2a1a445573a5 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:10.733122 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44054459-12b5-43ad-bee3-2a1a445573a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:10.733812 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44054459-12b5-43ad-bee3-2a1a445573a5 None admin] PATH_INFO: `/v3/users/e2809cd58a9848bc9eedec23d675b67d` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:10.736558 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44054459-12b5-43ad-bee3-2a1a445573a5 None admin] RBAC: Authorizing `identity:get_user(user_id=e2809cd58a9848bc9eedec23d675b67d)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:10.738333 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44054459-12b5-43ad-bee3-2a1a445573a5 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:10.741215 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 181/367] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Aug 24 11:20:10 2022] GET /identity/v3/users/e2809cd58a9848bc9eedec23d675b67d => generated 293 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:10.742406 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44054459-12b5-43ad-bee3-2a1a445573a5 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:10.763120 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:10.771921 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:10.783460 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d592aec-192b-44cf-9952-6576a3c3d26a None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:10.824840 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7459f4b0-01b6-4ca1-a876-3693bc5343b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:10.825459 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7459f4b0-01b6-4ca1-a876-3693bc5343b3 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:10.825739 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7459f4b0-01b6-4ca1-a876-3693bc5343b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:10.826010 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7459f4b0-01b6-4ca1-a876-3693bc5343b3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:10.870257 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44054459-12b5-43ad-bee3-2a1a445573a5 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:10.908478 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b85cfdd-7289-4177-9472-206529e091f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:10.910251 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b85cfdd-7289-4177-9472-206529e091f5 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:10.910701 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b85cfdd-7289-4177-9472-206529e091f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:10.911111 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b85cfdd-7289-4177-9472-206529e091f5 None admin] PATH_INFO: `/v3/groups/2578f3ba31c14d518437e94f91a5599c` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:10.912410 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b85cfdd-7289-4177-9472-206529e091f5 None admin] RBAC: Authorizing `identity:get_group(group_id=2578f3ba31c14d518437e94f91a5599c)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:10.914084 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b85cfdd-7289-4177-9472-206529e091f5 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:10.916158 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 182/368] 10.222.0.27 () {56 vars in 1180 bytes} [Wed Aug 24 11:20:10 2022] GET /identity/v3/groups/2578f3ba31c14d518437e94f91a5599c => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:10.917060 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b85cfdd-7289-4177-9472-206529e091f5 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:11.003350 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7459f4b0-01b6-4ca1-a876-3693bc5343b3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:11.004799 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7459f4b0-01b6-4ca1-a876-3693bc5343b3 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:11.022719 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:11.035078 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b85cfdd-7289-4177-9472-206529e091f5 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:11.079918 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64aa0d73-5d02-4bc8-a528-226a5d56a423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:11.081070 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aa0d73-5d02-4bc8-a528-226a5d56a423 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:11.081553 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aa0d73-5d02-4bc8-a528-226a5d56a423 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:11.082047 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aa0d73-5d02-4bc8-a528-226a5d56a423 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:11.083146 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64aa0d73-5d02-4bc8-a528-226a5d56a423 None admin] RBAC: Adding query filter params (role.id=7b4c8894d4a2493b97242eb334dc9014, user.id=e2809cd58a9848bc9eedec23d675b67d, scope.system=all) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:20:11.083655 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64aa0d73-5d02-4bc8-a528-226a5d56a423 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:11.085381 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64aa0d73-5d02-4bc8-a528-226a5d56a423 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:11.106892 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 183/369] 10.222.0.27 () {56 vars in 1308 bytes} [Wed Aug 24 11:20:10 2022] GET /identity/v3/role_assignments?user.id=e2809cd58a9848bc9eedec23d675b67d&scope.system=all&role.id=7b4c8894d4a2493b97242eb334dc9014 => generated 510 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:11.107978 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64aa0d73-5d02-4bc8-a528-226a5d56a423 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:11.203428 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:11.224190 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 187/370] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 24 11:20:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 580 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 11:20:11.225056 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7459f4b0-01b6-4ca1-a876-3693bc5343b3 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:11.310570 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64aa0d73-5d02-4bc8-a528-226a5d56a423 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:11.352473 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45f0286-fb1e-4204-b004-77fe89d572e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:11.353097 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45f0286-fb1e-4204-b004-77fe89d572e4 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:11.353369 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45f0286-fb1e-4204-b004-77fe89d572e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:11.353658 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45f0286-fb1e-4204-b004-77fe89d572e4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:11.354829 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45f0286-fb1e-4204-b004-77fe89d572e4 None admin] RBAC: Adding query filter params (group.id=2578f3ba31c14d518437e94f91a5599c, role.id=27e3e65e24df4b86b0d3d18d3212101d, scope.project.id=d865cccda5444ed685650f098a696d95) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:20:11.355161 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45f0286-fb1e-4204-b004-77fe89d572e4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:11.357275 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45f0286-fb1e-4204-b004-77fe89d572e4 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:11.365289 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 184/371] 10.222.0.27 () {56 vars in 1376 bytes} [Wed Aug 24 11:20:11 2022] GET /identity/v3/role_assignments?group.id=2578f3ba31c14d518437e94f91a5599c&scope.project.id=d865cccda5444ed685650f098a696d95&role.id=27e3e65e24df4b86b0d3d18d3212101d => generated 260 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:11.365910 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45f0286-fb1e-4204-b004-77fe89d572e4 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:11.370828 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:11.392383 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7459f4b0-01b6-4ca1-a876-3693bc5343b3 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:11.451832 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051b2333-d0ce-46dc-a7a4-eebdf0413815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:11.452479 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051b2333-d0ce-46dc-a7a4-eebdf0413815 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:11.452749 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051b2333-d0ce-46dc-a7a4-eebdf0413815 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:11.453013 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051b2333-d0ce-46dc-a7a4-eebdf0413815 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:11.475435 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051b2333-d0ce-46dc-a7a4-eebdf0413815 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:20:11.480591 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-051b2333-d0ce-46dc-a7a4-eebdf0413815 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 11:20:11.480591 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:20:11.480591 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:20:11.480591 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:20:11.480591 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:20:11.480591 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:20:11.480591 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:20:11.480591 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:20:11.480591 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:20:11.480591 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:20:11.480591 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:20:11.480591 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:20:11.480591 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:20:11.480591 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:20:11.480591 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:20:11.480591 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:20:11.481461 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:20:11.481461 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:20:11.481461 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:20:11.481461 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:20:11.481461 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:20:11.481461 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:20:11.481461 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:20:11.481461 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:20:11.481461 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:20:11.481461 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:20:11.481461 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:20:11.481461 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Aug 24 11:20:11.481461 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:20:11.481461 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:20:11.481461 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:20:11.481461 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:20:11.482262 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:20:11.482262 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:20:11.482262 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:20:11.482262 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:20:11.482262 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:20:11.482262 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:20:11.482262 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:20:11.482262 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:20:11.482262 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:20:11.482262 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:20:11.482262 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 11:20:11.482262 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Aug 24 11:20:11.482262 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 188/372] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Aug 24 11:20:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:20:11.488366 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051b2333-d0ce-46dc-a7a4-eebdf0413815 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:11.529042 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45f0286-fb1e-4204-b004-77fe89d572e4 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:11.557211 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:11.568135 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e4b80f-f873-49ff-ac6f-02b75c82e83c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:11.568701 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e4b80f-f873-49ff-ac6f-02b75c82e83c None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:11.568974 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e4b80f-f873-49ff-ac6f-02b75c82e83c None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:11.569240 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e4b80f-f873-49ff-ac6f-02b75c82e83c None admin] PATH_INFO: `/v3/projects/d865cccda5444ed685650f098a696d95` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:11.570412 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e4b80f-f873-49ff-ac6f-02b75c82e83c None admin] RBAC: Authorizing `identity:get_project(project_id=d865cccda5444ed685650f098a696d95)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:11.571904 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e4b80f-f873-49ff-ac6f-02b75c82e83c None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:11.578415 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 185/373] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Aug 24 11:20:11 2022] GET /identity/v3/projects/d865cccda5444ed685650f098a696d95 => generated 302 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:11.579663 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e4b80f-f873-49ff-ac6f-02b75c82e83c None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:11.614055 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051b2333-d0ce-46dc-a7a4-eebdf0413815 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:11.651729 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1936f56-40fa-4988-a693-69580dcc89db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:11.652722 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1936f56-40fa-4988-a693-69580dcc89db None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:11.652997 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1936f56-40fa-4988-a693-69580dcc89db None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:11.653260 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1936f56-40fa-4988-a693-69580dcc89db None admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:11.653981 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1936f56-40fa-4988-a693-69580dcc89db None admin] RBAC: Adding query filter params (name=admin) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:20:11.654277 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1936f56-40fa-4988-a693-69580dcc89db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:11.654797 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:11.656238 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1936f56-40fa-4988-a693-69580dcc89db None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:11.666503 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 189/374] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 24 11:20:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:20:11.672210 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1936f56-40fa-4988-a693-69580dcc89db None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:11.689528 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e4b80f-f873-49ff-ac6f-02b75c82e83c None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:11.723737 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb507c57-14aa-44fa-b02d-37549e2fb539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:11.724380 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb507c57-14aa-44fa-b02d-37549e2fb539 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:11.724657 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb507c57-14aa-44fa-b02d-37549e2fb539 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:11.724929 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb507c57-14aa-44fa-b02d-37549e2fb539 None admin] PATH_INFO: `/v3/groups/2578f3ba31c14d518437e94f91a5599c` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:11.727534 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb507c57-14aa-44fa-b02d-37549e2fb539 None admin] RBAC: Authorizing `identity:get_group(group_id=2578f3ba31c14d518437e94f91a5599c)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:11.729004 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb507c57-14aa-44fa-b02d-37549e2fb539 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:11.736702 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 186/375] 10.222.0.27 () {56 vars in 1180 bytes} [Wed Aug 24 11:20:11 2022] GET /identity/v3/groups/2578f3ba31c14d518437e94f91a5599c => generated 226 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:11.738015 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb507c57-14aa-44fa-b02d-37549e2fb539 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:11.780217 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1936f56-40fa-4988-a693-69580dcc89db None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:11.794399 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:11.818700 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e8718e-8040-462c-bc2f-856464d243db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:11.819225 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e8718e-8040-462c-bc2f-856464d243db None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:11.819496 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e8718e-8040-462c-bc2f-856464d243db None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:11.819816 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e8718e-8040-462c-bc2f-856464d243db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:11.842739 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb507c57-14aa-44fa-b02d-37549e2fb539 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:11.884003 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fc534c-ee69-49ce-81a8-f148b5b3f095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:11.884813 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fc534c-ee69-49ce-81a8-f148b5b3f095 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:11.885071 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fc534c-ee69-49ce-81a8-f148b5b3f095 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:11.885337 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fc534c-ee69-49ce-81a8-f148b5b3f095 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:11.886657 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fc534c-ee69-49ce-81a8-f148b5b3f095 None admin] RBAC: Adding query filter params (group.id=2578f3ba31c14d518437e94f91a5599c, role.id=96f07e9110194606acccfbd8467649a7, scope.project.id=d865cccda5444ed685650f098a696d95) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:20:11.886972 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fc534c-ee69-49ce-81a8-f148b5b3f095 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:11.888574 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fc534c-ee69-49ce-81a8-f148b5b3f095 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:11.898485 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 187/376] 10.222.0.27 () {56 vars in 1376 bytes} [Wed Aug 24 11:20:11 2022] GET /identity/v3/role_assignments?group.id=2578f3ba31c14d518437e94f91a5599c&scope.project.id=d865cccda5444ed685650f098a696d95&role.id=96f07e9110194606acccfbd8467649a7 => generated 260 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:20:11.909147 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e8718e-8040-462c-bc2f-856464d243db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:11.910924 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e8718e-8040-462c-bc2f-856464d243db None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:12.062599 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 190/377] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 24 11:20:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 11:20:12.068649 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fc534c-ee69-49ce-81a8-f148b5b3f095 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:12.071784 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:12.157795 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eac658d-c16a-4e1a-8a67-9ab4c504e14b None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:12.158114 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eac658d-c16a-4e1a-8a67-9ab4c504e14b None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:12.158343 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eac658d-c16a-4e1a-8a67-9ab4c504e14b None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:12.159880 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 191/378] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:20:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 11:20:12.165258 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02aeb43-8528-4b1a-8f30-6a8ede9b13b2 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:12.165862 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02aeb43-8528-4b1a-8f30-6a8ede9b13b2 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:12.166327 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02aeb43-8528-4b1a-8f30-6a8ede9b13b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:12.186443 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-d02aeb43-8528-4b1a-8f30-6a8ede9b13b2 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:20:12.188185 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-d02aeb43-8528-4b1a-8f30-6a8ede9b13b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:20:12.190874 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fc534c-ee69-49ce-81a8-f148b5b3f095 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:12.220581 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:12.232038 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484eecf1-00e7-4e89-bb51-60a0339c2506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:12.232676 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484eecf1-00e7-4e89-bb51-60a0339c2506 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:12.232950 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484eecf1-00e7-4e89-bb51-60a0339c2506 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:12.233219 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484eecf1-00e7-4e89-bb51-60a0339c2506 None admin] PATH_INFO: `/v3/projects/5558cde3f9bd4a779ecb6a225f26878d` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:12.234383 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484eecf1-00e7-4e89-bb51-60a0339c2506 None admin] RBAC: Authorizing `identity:get_project(project_id=5558cde3f9bd4a779ecb6a225f26878d)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:12.235833 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484eecf1-00e7-4e89-bb51-60a0339c2506 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:12.238323 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 188/379] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Aug 24 11:20:12 2022] GET /identity/v3/projects/5558cde3f9bd4a779ecb6a225f26878d => generated 344 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:12.243631 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484eecf1-00e7-4e89-bb51-60a0339c2506 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:12.278327 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 192/380] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:20:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 11:20:12.318504 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:12.351713 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484eecf1-00e7-4e89-bb51-60a0339c2506 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:12.385821 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5c35b3-5414-4aba-af9d-e0cb86bd5b8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:12.386482 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5c35b3-5414-4aba-af9d-e0cb86bd5b8b None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:12.386760 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5c35b3-5414-4aba-af9d-e0cb86bd5b8b None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:12.387028 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5c35b3-5414-4aba-af9d-e0cb86bd5b8b None admin] PATH_INFO: `/v3/groups/29f5669037044f0ab59746007087b8bd` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:12.392012 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5c35b3-5414-4aba-af9d-e0cb86bd5b8b None admin] RBAC: Authorizing `identity:get_group(group_id=29f5669037044f0ab59746007087b8bd)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:12.393478 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5c35b3-5414-4aba-af9d-e0cb86bd5b8b None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:12.395407 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 189/381] 10.222.0.27 () {56 vars in 1180 bytes} [Wed Aug 24 11:20:12 2022] GET /identity/v3/groups/29f5669037044f0ab59746007087b8bd => generated 229 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:20:12.403546 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02aeb43-8528-4b1a-8f30-6a8ede9b13b2 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:12.506618 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02aeb43-8528-4b1a-8f30-6a8ede9b13b2 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:12.542316 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e61ebf-1e1b-44e9-be42-b6ec3b1fdcdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:12.542977 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e61ebf-1e1b-44e9-be42-b6ec3b1fdcdb None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:12.543250 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e61ebf-1e1b-44e9-be42-b6ec3b1fdcdb None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:12.543514 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e61ebf-1e1b-44e9-be42-b6ec3b1fdcdb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:12.544272 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e61ebf-1e1b-44e9-be42-b6ec3b1fdcdb None admin] RBAC: Adding query filter params (group.id=29f5669037044f0ab59746007087b8bd, role.id=30bb1e97257f4ca5b90c88545777317b, scope.project.id=5558cde3f9bd4a779ecb6a225f26878d) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:20:12.544588 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e61ebf-1e1b-44e9-be42-b6ec3b1fdcdb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:12.546059 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e61ebf-1e1b-44e9-be42-b6ec3b1fdcdb None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:12.558525 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 193/382] 10.222.0.27 () {56 vars in 1376 bytes} [Wed Aug 24 11:20:12 2022] GET /identity/v3/role_assignments?group.id=29f5669037044f0ab59746007087b8bd&scope.project.id=5558cde3f9bd4a779ecb6a225f26878d&role.id=30bb1e97257f4ca5b90c88545777317b => generated 260 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:12.581346 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5c35b3-5414-4aba-af9d-e0cb86bd5b8b None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:12.703470 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5c35b3-5414-4aba-af9d-e0cb86bd5b8b None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:12.741877 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67249369-d2c0-4f11-aee7-8a3d4af63ae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:12.742583 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67249369-d2c0-4f11-aee7-8a3d4af63ae7 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:12.742859 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67249369-d2c0-4f11-aee7-8a3d4af63ae7 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:12.743126 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67249369-d2c0-4f11-aee7-8a3d4af63ae7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:12.745098 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:12.755078 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67249369-d2c0-4f11-aee7-8a3d4af63ae7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:20:12.760210 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-67249369-d2c0-4f11-aee7-8a3d4af63ae7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 11:20:12.760210 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:20:12.760210 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:20:12.760210 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:20:12.760210 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:20:12.760210 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:20:12.760210 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:20:12.760210 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:20:12.760210 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:20:12.760210 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:20:12.760210 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:20:12.760210 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:20:12.760210 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:20:12.760210 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:20:12.760210 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:20:12.760210 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:20:12.761133 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:20:12.761133 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:20:12.761133 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:20:12.761133 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:20:12.761133 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:20:12.761133 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:20:12.761133 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:20:12.761133 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:20:12.761133 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:20:12.761133 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:20:12.761133 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:20:12.761133 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Aug 24 11:20:12.761133 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:20:12.761133 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:20:12.761133 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:20:12.761133 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:20:12.761957 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:20:12.761957 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:20:12.761957 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:20:12.761957 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:20:12.761957 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:20:12.761957 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:20:12.761957 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:20:12.761957 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:20:12.761957 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:20:12.761957 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:20:12.761957 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 11:20:12.761957 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:20:12.764921 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 190/383] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 24 11:20:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:20:12.770688 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e61ebf-1e1b-44e9-be42-b6ec3b1fdcdb None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:12.780597 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:12.876854 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e61ebf-1e1b-44e9-be42-b6ec3b1fdcdb None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:12.911472 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f4dfe3-cc17-4eef-b275-2258409f4a01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:12.912082 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f4dfe3-cc17-4eef-b275-2258409f4a01 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:12.912354 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f4dfe3-cc17-4eef-b275-2258409f4a01 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:12.912613 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f4dfe3-cc17-4eef-b275-2258409f4a01 None admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:12.913322 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f4dfe3-cc17-4eef-b275-2258409f4a01 None admin] RBAC: Adding query filter params (name=member) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:20:12.913619 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f4dfe3-cc17-4eef-b275-2258409f4a01 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:12.915027 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f4dfe3-cc17-4eef-b275-2258409f4a01 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:12.923881 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 194/384] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Aug 24 11:20:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:12.931679 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67249369-d2c0-4f11-aee7-8a3d4af63ae7 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:12.994299 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893179f2-36b6-47c8-adc8-45cc5f9436d6 None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:12.994688 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893179f2-36b6-47c8-adc8-45cc5f9436d6 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:12.994876 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893179f2-36b6-47c8-adc8-45cc5f9436d6 None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:12.996368 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 195/385] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:20:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 11:20:13.002706 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12b3a9e-4034-4aef-94be-e48b4ffcffdc None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:13.003224 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12b3a9e-4034-4aef-94be-e48b4ffcffdc None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:13.003773 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12b3a9e-4034-4aef-94be-e48b4ffcffdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:13.025881 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-c12b3a9e-4034-4aef-94be-e48b4ffcffdc None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:20:13.027945 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-c12b3a9e-4034-4aef-94be-e48b4ffcffdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:20:13.053209 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67249369-d2c0-4f11-aee7-8a3d4af63ae7 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:13.122324 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b3a5a1-370a-4981-9682-2c02b4ed99b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:13.123009 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b3a5a1-370a-4981-9682-2c02b4ed99b0 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:13.123285 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b3a5a1-370a-4981-9682-2c02b4ed99b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:13.123614 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b3a5a1-370a-4981-9682-2c02b4ed99b0 None admin] PATH_INFO: `/v3/groups/2578f3ba31c14d518437e94f91a5599c` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:13.125773 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b3a5a1-370a-4981-9682-2c02b4ed99b0 None admin] RBAC: Authorizing `identity:get_group(group_id=2578f3ba31c14d518437e94f91a5599c)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:13.127309 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b3a5a1-370a-4981-9682-2c02b4ed99b0 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:13.129347 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 191/386] 10.222.0.27 () {56 vars in 1180 bytes} [Wed Aug 24 11:20:12 2022] GET /identity/v3/groups/2578f3ba31c14d518437e94f91a5599c => generated 226 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:13.137497 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b3a5a1-370a-4981-9682-2c02b4ed99b0 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:13.138742 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:13.155524 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 196/387] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:20:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 11:20:13.234897 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:13.273047 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b3a5a1-370a-4981-9682-2c02b4ed99b0 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:13.318078 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae404a8c-e995-43cd-8a14-d38b4c97da74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:13.318748 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae404a8c-e995-43cd-8a14-d38b4c97da74 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:13.319024 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae404a8c-e995-43cd-8a14-d38b4c97da74 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:13.319295 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae404a8c-e995-43cd-8a14-d38b4c97da74 None admin] PATH_INFO: `/v3/projects/71e3821279484b7087ded02a637ad206` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:13.320465 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae404a8c-e995-43cd-8a14-d38b4c97da74 None admin] RBAC: Authorizing `identity:get_project(project_id=71e3821279484b7087ded02a637ad206)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:13.321981 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae404a8c-e995-43cd-8a14-d38b4c97da74 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:13.323844 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 192/388] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Aug 24 11:20:13 2022] GET /identity/v3/projects/71e3821279484b7087ded02a637ad206 => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:20:13.329513 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12b3a9e-4034-4aef-94be-e48b4ffcffdc None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:13.443716 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12b3a9e-4034-4aef-94be-e48b4ffcffdc None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:13.481037 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a1b0ff-111d-4d89-8373-460fb17c41a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:13.481698 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a1b0ff-111d-4d89-8373-460fb17c41a6 None admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:13.481972 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a1b0ff-111d-4d89-8373-460fb17c41a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:13.482240 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a1b0ff-111d-4d89-8373-460fb17c41a6 None admin] PATH_INFO: `/v3/projects/71e3821279484b7087ded02a637ad206/groups/2578f3ba31c14d518437e94f91a5599c/roles/27e3e65e24df4b86b0d3d18d3212101d` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:13.485305 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a1b0ff-111d-4d89-8373-460fb17c41a6 None admin] RBAC: Authorizing `identity:create_grant(project_id=71e3821279484b7087ded02a637ad206, group_id=2578f3ba31c14d518437e94f91a5599c, role_id=27e3e65e24df4b86b0d3d18d3212101d)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:13.486840 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a1b0ff-111d-4d89-8373-460fb17c41a6 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:13.502778 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 197/389] 10.222.0.27 () {58 vars in 1442 bytes} [Wed Aug 24 11:20:13 2022] PUT /identity/v3/projects/71e3821279484b7087ded02a637ad206/groups/2578f3ba31c14d518437e94f91a5599c/roles/27e3e65e24df4b86b0d3d18d3212101d => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:20:13.787298 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae404a8c-e995-43cd-8a14-d38b4c97da74 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:13.922007 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae404a8c-e995-43cd-8a14-d38b4c97da74 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:13.957939 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:13.963677 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70a6bfa-9035-45a0-821b-2c1c067dff68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:13.964801 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70a6bfa-9035-45a0-821b-2c1c067dff68 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:13.965365 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70a6bfa-9035-45a0-821b-2c1c067dff68 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:13.965990 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70a6bfa-9035-45a0-821b-2c1c067dff68 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:13.979210 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70a6bfa-9035-45a0-821b-2c1c067dff68 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:20:13.984462 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-a70a6bfa-9035-45a0-821b-2c1c067dff68 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 11:20:13.984462 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:20:13.984462 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:20:13.984462 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:20:13.984462 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:20:13.984462 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:20:13.984462 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:20:13.984462 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:20:13.984462 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:20:13.984462 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:20:13.984462 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:20:13.984462 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:20:13.984462 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:20:13.984462 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:20:13.984462 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:20:13.984462 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:20:13.985372 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:20:13.985372 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:20:13.985372 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:20:13.985372 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:20:13.985372 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:20:13.985372 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:20:13.985372 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:20:13.985372 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:20:13.985372 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:20:13.985372 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:20:13.985372 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:20:13.985372 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Aug 24 11:20:13.985372 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:20:13.985372 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:20:13.985372 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:20:13.985372 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:20:13.986260 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:20:13.986260 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:20:13.986260 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:20:13.986260 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:20:13.986260 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:20:13.986260 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:20:13.986260 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:20:13.986260 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:20:13.986260 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:20:13.986260 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:20:13.986260 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 11:20:13.986260 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:20:13.986260 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 193/390] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Aug 24 11:20:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:20:13.992296 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a1b0ff-111d-4d89-8373-460fb17c41a6 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:14.088422 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:14.119803 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a1b0ff-111d-4d89-8373-460fb17c41a6 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:14.157533 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7053094-cd82-43b5-96e9-dd3c2176cacb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:14.158142 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7053094-cd82-43b5-96e9-dd3c2176cacb None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:14.158448 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7053094-cd82-43b5-96e9-dd3c2176cacb None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:14.158718 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7053094-cd82-43b5-96e9-dd3c2176cacb None admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:14.159390 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7053094-cd82-43b5-96e9-dd3c2176cacb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:20:14.159690 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7053094-cd82-43b5-96e9-dd3c2176cacb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:14.161114 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7053094-cd82-43b5-96e9-dd3c2176cacb None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:14.172391 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 198/391] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Aug 24 11:20:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:14.179055 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70a6bfa-9035-45a0-821b-2c1c067dff68 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:14.311038 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70a6bfa-9035-45a0-821b-2c1c067dff68 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:14.353658 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeaac5d-4a54-4ac3-ace0-c5a071a17795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:14.354233 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeaac5d-4a54-4ac3-ace0-c5a071a17795 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:14.354537 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeaac5d-4a54-4ac3-ace0-c5a071a17795 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:14.354806 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeaac5d-4a54-4ac3-ace0-c5a071a17795 None admin] PATH_INFO: `/v3/groups/2578f3ba31c14d518437e94f91a5599c` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:14.356325 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aeaac5d-4a54-4ac3-ace0-c5a071a17795 None admin] RBAC: Authorizing `identity:get_group(group_id=2578f3ba31c14d518437e94f91a5599c)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:14.357806 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aeaac5d-4a54-4ac3-ace0-c5a071a17795 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:14.359682 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 194/392] 10.222.0.27 () {56 vars in 1180 bytes} [Wed Aug 24 11:20:14 2022] GET /identity/v3/groups/2578f3ba31c14d518437e94f91a5599c => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:14.365633 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7053094-cd82-43b5-96e9-dd3c2176cacb None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:14.497242 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7053094-cd82-43b5-96e9-dd3c2176cacb None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:14.519800 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:14.540460 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64331b97-bec5-46b5-8137-b89aadb02c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:14.541138 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64331b97-bec5-46b5-8137-b89aadb02c06 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:14.541416 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64331b97-bec5-46b5-8137-b89aadb02c06 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:14.541686 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64331b97-bec5-46b5-8137-b89aadb02c06 None admin] PATH_INFO: `/v3/projects/71e3821279484b7087ded02a637ad206` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:14.547115 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64331b97-bec5-46b5-8137-b89aadb02c06 None admin] RBAC: Authorizing `identity:get_project(project_id=71e3821279484b7087ded02a637ad206)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:14.548614 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64331b97-bec5-46b5-8137-b89aadb02c06 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:14.550461 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 199/393] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Aug 24 11:20:14 2022] GET /identity/v3/projects/71e3821279484b7087ded02a637ad206 => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:14.555180 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ae4ce3-5151-4d9d-9e49-d0dcf99a0662 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:14.555719 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ae4ce3-5151-4d9d-9e49-d0dcf99a0662 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:14.556205 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ae4ce3-5151-4d9d-9e49-d0dcf99a0662 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:14.558015 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 195/394] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:20:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:20:14.562107 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64331b97-bec5-46b5-8137-b89aadb02c06 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:14.564673 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f6b0cc-0bc7-4f75-b861-f693ad63fd22 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:14.565440 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f6b0cc-0bc7-4f75-b861-f693ad63fd22 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:14.566292 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f6b0cc-0bc7-4f75-b861-f693ad63fd22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:14.602111 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-c7f6b0cc-0bc7-4f75-b861-f693ad63fd22 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:20:14.604026 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-c7f6b0cc-0bc7-4f75-b861-f693ad63fd22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:20:14.719915 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:14.736030 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64331b97-bec5-46b5-8137-b89aadb02c06 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:14.754559 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 196/395] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:20:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 11:20:14.777640 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046306e5-a58e-4068-be5c-0df8d3c71ba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:14.778715 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046306e5-a58e-4068-be5c-0df8d3c71ba6 None admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:14.779189 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046306e5-a58e-4068-be5c-0df8d3c71ba6 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:14.779678 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046306e5-a58e-4068-be5c-0df8d3c71ba6 None admin] PATH_INFO: `/v3/projects/71e3821279484b7087ded02a637ad206/groups/2578f3ba31c14d518437e94f91a5599c/roles/96f07e9110194606acccfbd8467649a7` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:14.784209 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046306e5-a58e-4068-be5c-0df8d3c71ba6 None admin] RBAC: Authorizing `identity:create_grant(project_id=71e3821279484b7087ded02a637ad206, group_id=2578f3ba31c14d518437e94f91a5599c, role_id=96f07e9110194606acccfbd8467649a7)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:14.785712 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046306e5-a58e-4068-be5c-0df8d3c71ba6 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:14.802040 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 200/396] 10.222.0.27 () {58 vars in 1442 bytes} [Wed Aug 24 11:20:14 2022] PUT /identity/v3/projects/71e3821279484b7087ded02a637ad206/groups/2578f3ba31c14d518437e94f91a5599c/roles/96f07e9110194606acccfbd8467649a7 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:20:14.871972 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0db8c18-8eb5-4ff0-acb4-6ea54fed2811 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:14.872509 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0db8c18-8eb5-4ff0-acb4-6ea54fed2811 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:14.872509 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0db8c18-8eb5-4ff0-acb4-6ea54fed2811 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:14.874089 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 197/397] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:20:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:20:14.878133 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cd2c3a-c945-4467-b6ae-925eb24a05d5 None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:14.878807 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cd2c3a-c945-4467-b6ae-925eb24a05d5 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:14.879285 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cd2c3a-c945-4467-b6ae-925eb24a05d5 None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:14.881164 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 201/398] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:20:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:20:14.884642 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b4d1b8-ab10-4446-b4ab-6a6e8e64ba09 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:14.885176 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b4d1b8-ab10-4446-b4ab-6a6e8e64ba09 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:14.885652 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b4d1b8-ab10-4446-b4ab-6a6e8e64ba09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:14.886143 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10683d0-8ac1-492e-b7a8-b4bab349b53b None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:14.886664 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10683d0-8ac1-492e-b7a8-b4bab349b53b None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:14.887122 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10683d0-8ac1-492e-b7a8-b4bab349b53b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:14.907481 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-b10683d0-8ac1-492e-b7a8-b4bab349b53b None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:20:14.909049 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-b10683d0-8ac1-492e-b7a8-b4bab349b53b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:20:14.914477 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-22b4d1b8-ab10-4446-b4ab-6a6e8e64ba09 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:20:14.915804 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-22b4d1b8-ab10-4446-b4ab-6a6e8e64ba09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:20:14.959200 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:14.987504 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 202/399] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:20:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 11:20:15.040739 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 198/400] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:20:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 11:20:15.091680 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10683d0-8ac1-492e-b7a8-b4bab349b53b None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:15.223064 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10683d0-8ac1-492e-b7a8-b4bab349b53b None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:15.261750 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9712869-7cc4-4342-8a63-121e556700e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:15.262851 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9712869-7cc4-4342-8a63-121e556700e4 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:15.263317 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9712869-7cc4-4342-8a63-121e556700e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:15.263770 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9712869-7cc4-4342-8a63-121e556700e4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:15.277789 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9712869-7cc4-4342-8a63-121e556700e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:20:15.279423 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b4d1b8-ab10-4446-b4ab-6a6e8e64ba09 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:15.283163 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-f9712869-7cc4-4342-8a63-121e556700e4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 11:20:15.283163 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:20:15.283163 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:20:15.283163 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:20:15.283163 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:20:15.283163 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:20:15.283163 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:20:15.283163 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:20:15.283163 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:20:15.283163 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:20:15.283163 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:20:15.283163 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:20:15.283163 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:20:15.283163 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:20:15.283163 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:20:15.283163 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:20:15.284050 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:20:15.284050 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:20:15.284050 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:20:15.284050 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:20:15.284050 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:20:15.284050 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:20:15.284050 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:20:15.284050 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:20:15.284050 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:20:15.284050 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:20:15.284050 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:20:15.284050 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Aug 24 11:20:15.284050 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:20:15.284050 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:20:15.284050 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:20:15.284050 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:20:15.284927 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:20:15.284927 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:20:15.284927 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:20:15.284927 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:20:15.284927 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:20:15.284927 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:20:15.284927 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:20:15.284927 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:20:15.284927 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:20:15.284927 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:20:15.284927 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 11:20:15.284927 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Aug 24 11:20:15.287607 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 203/401] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 24 11:20:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:20:15.295352 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9712869-7cc4-4342-8a63-121e556700e4 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:15.350242 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:15.414382 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9712869-7cc4-4342-8a63-121e556700e4 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:15.430773 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b4d1b8-ab10-4446-b4ab-6a6e8e64ba09 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:15.450098 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:15.452166 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa919ef5-fadb-4510-87ab-83e30437dafc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:15.452988 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa919ef5-fadb-4510-87ab-83e30437dafc None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:15.453499 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa919ef5-fadb-4510-87ab-83e30437dafc None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:15.454017 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa919ef5-fadb-4510-87ab-83e30437dafc None admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:15.455003 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa919ef5-fadb-4510-87ab-83e30437dafc None admin] RBAC: Adding query filter params (name=member) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:20:15.455646 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa919ef5-fadb-4510-87ab-83e30437dafc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:15.457494 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa919ef5-fadb-4510-87ab-83e30437dafc None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:15.468910 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 204/402] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Aug 24 11:20:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:15.470142 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa919ef5-fadb-4510-87ab-83e30437dafc None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:15.474699 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d4cb77-88d9-4485-9058-18eb7c85cbd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:15.475372 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d4cb77-88d9-4485-9058-18eb7c85cbd9 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:15.475725 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d4cb77-88d9-4485-9058-18eb7c85cbd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:15.476090 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d4cb77-88d9-4485-9058-18eb7c85cbd9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:15.487926 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d4cb77-88d9-4485-9058-18eb7c85cbd9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:20:15.493142 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-85d4cb77-88d9-4485-9058-18eb7c85cbd9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 11:20:15.493142 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:20:15.493142 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:20:15.493142 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:20:15.493142 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:20:15.493142 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:20:15.493142 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:20:15.493142 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:20:15.493142 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:20:15.493142 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:20:15.493142 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:20:15.493142 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:20:15.493142 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:20:15.493142 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:20:15.493142 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:20:15.493142 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:20:15.494096 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:20:15.494096 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:20:15.494096 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:20:15.494096 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:20:15.494096 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:20:15.494096 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:20:15.494096 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:20:15.494096 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:20:15.494096 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:20:15.494096 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:20:15.494096 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:20:15.494096 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Aug 24 11:20:15.494096 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:20:15.494096 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:20:15.494096 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:20:15.494096 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:20:15.494970 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:20:15.494970 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:20:15.494970 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:20:15.494970 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:20:15.494970 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:20:15.494970 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:20:15.494970 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:20:15.494970 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:20:15.494970 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:20:15.494970 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:20:15.494970 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 11:20:15.494970 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:20:15.499266 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 199/403] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Aug 24 11:20:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:20:15.500202 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d4cb77-88d9-4485-9058-18eb7c85cbd9 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:15.582235 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:15.586834 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa919ef5-fadb-4510-87ab-83e30437dafc None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:15.613297 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d4cb77-88d9-4485-9058-18eb7c85cbd9 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:15.624593 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905a0ec8-a8ac-4f12-9d8e-20c37e15fd32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:15.625606 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905a0ec8-a8ac-4f12-9d8e-20c37e15fd32 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:15.626088 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905a0ec8-a8ac-4f12-9d8e-20c37e15fd32 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:15.626587 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905a0ec8-a8ac-4f12-9d8e-20c37e15fd32 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:15.637620 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905a0ec8-a8ac-4f12-9d8e-20c37e15fd32 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:20:15.643184 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-905a0ec8-a8ac-4f12-9d8e-20c37e15fd32 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 11:20:15.643184 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:20:15.643184 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:20:15.643184 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:20:15.643184 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:20:15.643184 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:20:15.643184 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:20:15.643184 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:20:15.643184 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:20:15.643184 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:20:15.643184 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:20:15.643184 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:20:15.643184 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:20:15.643184 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:20:15.643184 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:20:15.643184 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:20:15.644246 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:20:15.644246 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:20:15.644246 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:20:15.644246 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:20:15.644246 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:20:15.644246 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:20:15.644246 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:20:15.644246 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:20:15.644246 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:20:15.644246 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:20:15.644246 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:20:15.644246 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Aug 24 11:20:15.644246 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:20:15.644246 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:20:15.644246 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:20:15.644246 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:20:15.645079 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:20:15.645079 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:20:15.645079 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:20:15.645079 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:20:15.645079 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:20:15.645079 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:20:15.645079 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:20:15.645079 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:20:15.645079 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:20:15.645079 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:20:15.645079 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 11:20:15.645079 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Aug 24 11:20:15.647800 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 205/404] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Aug 24 11:20:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:20:15.648848 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905a0ec8-a8ac-4f12-9d8e-20c37e15fd32 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:15.658661 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9170e4-1be1-4754-826c-940de74b7499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:15.659305 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9170e4-1be1-4754-826c-940de74b7499 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:15.659581 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9170e4-1be1-4754-826c-940de74b7499 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:15.659933 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9170e4-1be1-4754-826c-940de74b7499 None admin] PATH_INFO: `/v3/groups/2578f3ba31c14d518437e94f91a5599c` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:15.661076 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9170e4-1be1-4754-826c-940de74b7499 None admin] RBAC: Authorizing `identity:get_group(group_id=2578f3ba31c14d518437e94f91a5599c)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:15.662595 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9170e4-1be1-4754-826c-940de74b7499 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:15.668988 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 200/405] 10.222.0.27 () {56 vars in 1180 bytes} [Wed Aug 24 11:20:15 2022] GET /identity/v3/groups/2578f3ba31c14d518437e94f91a5599c => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:15.669849 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9170e4-1be1-4754-826c-940de74b7499 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:15.721328 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:15.758799 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905a0ec8-a8ac-4f12-9d8e-20c37e15fd32 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:15.780573 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9170e4-1be1-4754-826c-940de74b7499 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:15.793967 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4df24e7-7309-4fdc-8f25-da21170dc999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:15.794911 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4df24e7-7309-4fdc-8f25-da21170dc999 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:15.795402 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4df24e7-7309-4fdc-8f25-da21170dc999 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:15.795862 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4df24e7-7309-4fdc-8f25-da21170dc999 None admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:15.796712 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4df24e7-7309-4fdc-8f25-da21170dc999 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:20:15.797195 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4df24e7-7309-4fdc-8f25-da21170dc999 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:15.798899 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4df24e7-7309-4fdc-8f25-da21170dc999 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:15.807761 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 206/406] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 24 11:20:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:15.808798 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4df24e7-7309-4fdc-8f25-da21170dc999 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:15.823964 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d67655-a922-40ce-88b4-6ee89c0e8e41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:15.824899 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d67655-a922-40ce-88b4-6ee89c0e8e41 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:15.826113 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d67655-a922-40ce-88b4-6ee89c0e8e41 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:15.826666 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d67655-a922-40ce-88b4-6ee89c0e8e41 None admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:15.828158 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d67655-a922-40ce-88b4-6ee89c0e8e41 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:20:15.828660 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d67655-a922-40ce-88b4-6ee89c0e8e41 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:15.830796 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d67655-a922-40ce-88b4-6ee89c0e8e41 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:15.840552 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:15.841805 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 201/407] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Aug 24 11:20:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:15.843089 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d67655-a922-40ce-88b4-6ee89c0e8e41 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:15.941840 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4df24e7-7309-4fdc-8f25-da21170dc999 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:15.966881 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d67655-a922-40ce-88b4-6ee89c0e8e41 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:15.976422 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:15.977886 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36febe69-674e-483e-8559-182704a15d4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:15.979277 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36febe69-674e-483e-8559-182704a15d4c None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:15.979877 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36febe69-674e-483e-8559-182704a15d4c None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:15.980339 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36febe69-674e-483e-8559-182704a15d4c None admin] PATH_INFO: `/v3/projects/d865cccda5444ed685650f098a696d95` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:15.981719 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36febe69-674e-483e-8559-182704a15d4c None admin] RBAC: Authorizing `identity:get_project(project_id=d865cccda5444ed685650f098a696d95)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:15.983381 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36febe69-674e-483e-8559-182704a15d4c None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:15.985253 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 207/408] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Aug 24 11:20:15 2022] GET /identity/v3/projects/d865cccda5444ed685650f098a696d95 => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:15.986197 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36febe69-674e-483e-8559-182704a15d4c None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:16.008261 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3461d84a-7fe4-4e98-90af-aa4eb3babe4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:16.008933 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3461d84a-7fe4-4e98-90af-aa4eb3babe4a None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:16.009146 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3461d84a-7fe4-4e98-90af-aa4eb3babe4a None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:16.009399 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3461d84a-7fe4-4e98-90af-aa4eb3babe4a None admin] PATH_INFO: `/v3/groups/29f5669037044f0ab59746007087b8bd` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:16.010560 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3461d84a-7fe4-4e98-90af-aa4eb3babe4a None admin] RBAC: Authorizing `identity:get_group(group_id=29f5669037044f0ab59746007087b8bd)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:16.012053 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3461d84a-7fe4-4e98-90af-aa4eb3babe4a None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:16.013658 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 202/409] 10.222.0.27 () {56 vars in 1180 bytes} [Wed Aug 24 11:20:15 2022] GET /identity/v3/groups/29f5669037044f0ab59746007087b8bd => generated 229 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:16.014795 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe44786-c6bc-4fd7-bbac-9c5168c6d0e7 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:16.015067 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe44786-c6bc-4fd7-bbac-9c5168c6d0e7 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:16.015640 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe44786-c6bc-4fd7-bbac-9c5168c6d0e7 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:16.018495 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 203/410] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:20:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:20:16.019291 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe44786-c6bc-4fd7-bbac-9c5168c6d0e7 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:16.083980 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:16.094549 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36febe69-674e-483e-8559-182704a15d4c None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:16.138962 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe44786-c6bc-4fd7-bbac-9c5168c6d0e7 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:16.139494 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab224eee-04ec-458f-bfb9-931ad470eec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:16.140129 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab224eee-04ec-458f-bfb9-931ad470eec9 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:16.140427 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab224eee-04ec-458f-bfb9-931ad470eec9 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:16.140686 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab224eee-04ec-458f-bfb9-931ad470eec9 None admin] PATH_INFO: `/v3/groups/2578f3ba31c14d518437e94f91a5599c` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:16.141803 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab224eee-04ec-458f-bfb9-931ad470eec9 None admin] RBAC: Authorizing `identity:get_group(group_id=2578f3ba31c14d518437e94f91a5599c)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:16.143288 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab224eee-04ec-458f-bfb9-931ad470eec9 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:16.144899 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 208/411] 10.222.0.27 () {56 vars in 1180 bytes} [Wed Aug 24 11:20:15 2022] GET /identity/v3/groups/2578f3ba31c14d518437e94f91a5599c => generated 226 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:16.145655 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab224eee-04ec-458f-bfb9-931ad470eec9 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:16.178326 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bb830a-e26a-4798-b209-6c22be102191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:16.179310 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bb830a-e26a-4798-b209-6c22be102191 None admin] REQUEST_METHOD: `PUT` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:16.179792 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bb830a-e26a-4798-b209-6c22be102191 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:16.180207 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bb830a-e26a-4798-b209-6c22be102191 None admin] PATH_INFO: `/v3/projects/d865cccda5444ed685650f098a696d95/groups/2578f3ba31c14d518437e94f91a5599c/roles/27e3e65e24df4b86b0d3d18d3212101d` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:16.182240 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bb830a-e26a-4798-b209-6c22be102191 None admin] RBAC: Authorizing `identity:create_grant(project_id=d865cccda5444ed685650f098a696d95, group_id=2578f3ba31c14d518437e94f91a5599c, role_id=27e3e65e24df4b86b0d3d18d3212101d)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:16.183858 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bb830a-e26a-4798-b209-6c22be102191 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:16.199278 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 204/412] 10.222.0.27 () {58 vars in 1442 bytes} [Wed Aug 24 11:20:16 2022] PUT /identity/v3/projects/d865cccda5444ed685650f098a696d95/groups/2578f3ba31c14d518437e94f91a5599c/roles/27e3e65e24df4b86b0d3d18d3212101d => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:20:16.200398 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb50fce1-29ac-4a69-9c79-cebbdb653ae9 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:16.200755 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb50fce1-29ac-4a69-9c79-cebbdb653ae9 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:16.201097 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb50fce1-29ac-4a69-9c79-cebbdb653ae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:16.222619 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-eb50fce1-29ac-4a69-9c79-cebbdb653ae9 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:20:16.224011 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-eb50fce1-29ac-4a69-9c79-cebbdb653ae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:20:16.258862 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:16.292874 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab224eee-04ec-458f-bfb9-931ad470eec9 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:16.305968 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 205/413] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:20:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 11:20:16.306919 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb50fce1-29ac-4a69-9c79-cebbdb653ae9 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:16.338302 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122ff165-14cb-4960-af62-911fce0e00c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:16.339339 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122ff165-14cb-4960-af62-911fce0e00c0 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:16.339911 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122ff165-14cb-4960-af62-911fce0e00c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:16.340377 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122ff165-14cb-4960-af62-911fce0e00c0 None admin] PATH_INFO: `/v3/projects/5558cde3f9bd4a779ecb6a225f26878d` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:16.342194 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122ff165-14cb-4960-af62-911fce0e00c0 None admin] RBAC: Authorizing `identity:get_project(project_id=5558cde3f9bd4a779ecb6a225f26878d)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:16.344025 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122ff165-14cb-4960-af62-911fce0e00c0 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:16.347136 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 209/414] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Aug 24 11:20:16 2022] GET /identity/v3/projects/5558cde3f9bd4a779ecb6a225f26878d => generated 344 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:16.363588 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122ff165-14cb-4960-af62-911fce0e00c0 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:16.409471 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:16.421717 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb50fce1-29ac-4a69-9c79-cebbdb653ae9 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:16.459466 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabbda9b-1d71-4f74-bf65-cae3e8f48df2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:16.460253 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabbda9b-1d71-4f74-bf65-cae3e8f48df2 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:16.460588 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabbda9b-1d71-4f74-bf65-cae3e8f48df2 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:16.460925 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabbda9b-1d71-4f74-bf65-cae3e8f48df2 None admin] PATH_INFO: `/v3/projects/d865cccda5444ed685650f098a696d95` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:16.462177 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabbda9b-1d71-4f74-bf65-cae3e8f48df2 None admin] RBAC: Authorizing `identity:get_project(project_id=d865cccda5444ed685650f098a696d95)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:16.463732 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabbda9b-1d71-4f74-bf65-cae3e8f48df2 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:16.465619 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 206/415] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Aug 24 11:20:16 2022] GET /identity/v3/projects/d865cccda5444ed685650f098a696d95 => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:16.471227 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabbda9b-1d71-4f74-bf65-cae3e8f48df2 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:16.491856 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122ff165-14cb-4960-af62-911fce0e00c0 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:16.513182 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:16.567212 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccffdaa0-106e-4af7-9c31-9fb3c43dcd85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:16.568221 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccffdaa0-106e-4af7-9c31-9fb3c43dcd85 None admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:16.568696 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccffdaa0-106e-4af7-9c31-9fb3c43dcd85 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:16.569156 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccffdaa0-106e-4af7-9c31-9fb3c43dcd85 None admin] PATH_INFO: `/v3/projects/5558cde3f9bd4a779ecb6a225f26878d/groups/29f5669037044f0ab59746007087b8bd/roles/30bb1e97257f4ca5b90c88545777317b` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:16.575690 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccffdaa0-106e-4af7-9c31-9fb3c43dcd85 None admin] RBAC: Authorizing `identity:create_grant(project_id=5558cde3f9bd4a779ecb6a225f26878d, group_id=29f5669037044f0ab59746007087b8bd, role_id=30bb1e97257f4ca5b90c88545777317b)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:16.577379 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccffdaa0-106e-4af7-9c31-9fb3c43dcd85 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:16.583667 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabbda9b-1d71-4f74-bf65-cae3e8f48df2 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:16.608013 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 210/416] 10.222.0.27 () {58 vars in 1442 bytes} [Wed Aug 24 11:20:16 2022] PUT /identity/v3/projects/5558cde3f9bd4a779ecb6a225f26878d/groups/29f5669037044f0ab59746007087b8bd/roles/30bb1e97257f4ca5b90c88545777317b => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:20:16.629055 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ce0c69-2aec-480d-9ec4-be1723e12525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:16.629817 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ce0c69-2aec-480d-9ec4-be1723e12525 None admin] REQUEST_METHOD: `PUT` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:16.630097 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ce0c69-2aec-480d-9ec4-be1723e12525 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:16.630430 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ce0c69-2aec-480d-9ec4-be1723e12525 None admin] PATH_INFO: `/v3/projects/d865cccda5444ed685650f098a696d95/groups/2578f3ba31c14d518437e94f91a5599c/roles/96f07e9110194606acccfbd8467649a7` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:16.633569 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ce0c69-2aec-480d-9ec4-be1723e12525 None admin] RBAC: Authorizing `identity:create_grant(project_id=d865cccda5444ed685650f098a696d95, group_id=2578f3ba31c14d518437e94f91a5599c, role_id=96f07e9110194606acccfbd8467649a7)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:16.635126 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ce0c69-2aec-480d-9ec4-be1723e12525 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:16.652952 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 207/417] 10.222.0.27 () {58 vars in 1442 bytes} [Wed Aug 24 11:20:16 2022] PUT /identity/v3/projects/d865cccda5444ed685650f098a696d95/groups/2578f3ba31c14d518437e94f91a5599c/roles/96f07e9110194606acccfbd8467649a7 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 11:20:16.695720 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccffdaa0-106e-4af7-9c31-9fb3c43dcd85 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:16.816241 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:16.832732 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccffdaa0-106e-4af7-9c31-9fb3c43dcd85 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:16.871992 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7507b3a7-1504-4452-be66-806a77c6a0b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:16.872635 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7507b3a7-1504-4452-be66-806a77c6a0b5 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:16.872910 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7507b3a7-1504-4452-be66-806a77c6a0b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:16.873175 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7507b3a7-1504-4452-be66-806a77c6a0b5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:16.884029 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7507b3a7-1504-4452-be66-806a77c6a0b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:20:16.889065 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-7507b3a7-1504-4452-be66-806a77c6a0b5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 11:20:16.889065 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:20:16.889065 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:20:16.889065 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:20:16.889065 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:20:16.889065 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:20:16.889065 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:20:16.889065 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:20:16.889065 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:20:16.889065 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:20:16.889065 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:20:16.889065 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:20:16.889065 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:20:16.889065 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:20:16.889065 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:20:16.889065 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:20:16.889972 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:20:16.889972 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:20:16.889972 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:20:16.889972 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:20:16.889972 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:20:16.889972 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:20:16.889972 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:20:16.889972 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:20:16.889972 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:20:16.889972 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:20:16.889972 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:20:16.889972 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Aug 24 11:20:16.889972 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:20:16.889972 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:20:16.889972 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:20:16.889972 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:20:16.890856 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:20:16.890856 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:20:16.890856 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:20:16.890856 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:20:16.890856 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:20:16.890856 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:20:16.890856 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:20:16.890856 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:20:16.890856 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:20:16.890856 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:20:16.890856 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 11:20:16.890856 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Aug 24 11:20:16.890856 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 211/418] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 24 11:20:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:20:16.898094 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ce0c69-2aec-480d-9ec4-be1723e12525 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:16.998381 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:17.005520 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ce0c69-2aec-480d-9ec4-be1723e12525 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:17.042775 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58874040-b336-4d94-a4b8-01920026f282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:17.043390 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58874040-b336-4d94-a4b8-01920026f282 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:17.043664 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58874040-b336-4d94-a4b8-01920026f282 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:17.043936 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58874040-b336-4d94-a4b8-01920026f282 None admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:17.044605 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58874040-b336-4d94-a4b8-01920026f282 None admin] RBAC: Adding query filter params (name=member) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:20:17.044900 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58874040-b336-4d94-a4b8-01920026f282 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:17.046301 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58874040-b336-4d94-a4b8-01920026f282 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:17.055187 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 208/419] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Aug 24 11:20:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:20:17.060680 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7507b3a7-1504-4452-be66-806a77c6a0b5 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:17.134985 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfe0d00-c94d-427f-ad0a-b7dc1e52c46c None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:17.135322 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfe0d00-c94d-427f-ad0a-b7dc1e52c46c None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:17.135532 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfe0d00-c94d-427f-ad0a-b7dc1e52c46c None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:17.137153 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 209/420] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:20:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 11:20:17.142388 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e354c43-2244-49f5-a6bc-5c6dc4a81400 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:17.142683 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e354c43-2244-49f5-a6bc-5c6dc4a81400 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:17.142955 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e354c43-2244-49f5-a6bc-5c6dc4a81400 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:17.161748 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-5e354c43-2244-49f5-a6bc-5c6dc4a81400 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:20:17.162963 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-5e354c43-2244-49f5-a6bc-5c6dc4a81400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:20:17.208594 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7507b3a7-1504-4452-be66-806a77c6a0b5 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:17.246914 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 210/421] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:20:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 11:20:17.286006 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3083bd00-ea2c-4ae4-b042-ea7e40cb3fe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:17.286649 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3083bd00-ea2c-4ae4-b042-ea7e40cb3fe2 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:17.286923 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3083bd00-ea2c-4ae4-b042-ea7e40cb3fe2 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:17.287192 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3083bd00-ea2c-4ae4-b042-ea7e40cb3fe2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:17.310250 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:17.381819 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3083bd00-ea2c-4ae4-b042-ea7e40cb3fe2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:17.383223 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3083bd00-ea2c-4ae4-b042-ea7e40cb3fe2 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:17.498714 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 212/422] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 24 11:20:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 11:20:17.504977 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e354c43-2244-49f5-a6bc-5c6dc4a81400 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:17.634473 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:17.644900 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3083bd00-ea2c-4ae4-b042-ea7e40cb3fe2 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:17.650101 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e354c43-2244-49f5-a6bc-5c6dc4a81400 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:17.696094 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a856fe56-0c74-444f-9f60-730a7e8f04ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:17.697024 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a856fe56-0c74-444f-9f60-730a7e8f04ec None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:17.697474 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a856fe56-0c74-444f-9f60-730a7e8f04ec None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:17.697913 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a856fe56-0c74-444f-9f60-730a7e8f04ec None admin] PATH_INFO: `/v3/projects/71e3821279484b7087ded02a637ad206` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:17.699344 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a856fe56-0c74-444f-9f60-730a7e8f04ec None admin] RBAC: Authorizing `identity:get_project(project_id=71e3821279484b7087ded02a637ad206)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:17.701029 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a856fe56-0c74-444f-9f60-730a7e8f04ec None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:17.703960 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 211/423] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Aug 24 11:20:17 2022] GET /identity/v3/projects/71e3821279484b7087ded02a637ad206 => generated 298 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:17.710769 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a856fe56-0c74-444f-9f60-730a7e8f04ec None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:17.756644 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:17.814633 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a856fe56-0c74-444f-9f60-730a7e8f04ec None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:17.849173 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd244389-b1eb-41b7-abd0-ba7bfd287565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:17.850168 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd244389-b1eb-41b7-abd0-ba7bfd287565 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:17.850659 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd244389-b1eb-41b7-abd0-ba7bfd287565 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:17.851118 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd244389-b1eb-41b7-abd0-ba7bfd287565 None admin] PATH_INFO: `/v3/groups/2578f3ba31c14d518437e94f91a5599c` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:17.852451 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd244389-b1eb-41b7-abd0-ba7bfd287565 None admin] RBAC: Authorizing `identity:get_group(group_id=2578f3ba31c14d518437e94f91a5599c)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:17.854124 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd244389-b1eb-41b7-abd0-ba7bfd287565 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:17.856222 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 212/424] 10.222.0.27 () {56 vars in 1180 bytes} [Wed Aug 24 11:20:17 2022] GET /identity/v3/groups/2578f3ba31c14d518437e94f91a5599c => generated 226 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:17.862165 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd244389-b1eb-41b7-abd0-ba7bfd287565 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:17.886801 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:17.888413 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3083bd00-ea2c-4ae4-b042-ea7e40cb3fe2 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:17.934382 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b867885-f269-41f8-bd76-4ed3826c0cf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:17.934382 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b867885-f269-41f8-bd76-4ed3826c0cf5 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:17.934382 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b867885-f269-41f8-bd76-4ed3826c0cf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:17.934382 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b867885-f269-41f8-bd76-4ed3826c0cf5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:17.946502 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b867885-f269-41f8-bd76-4ed3826c0cf5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:20:17.948846 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-0b867885-f269-41f8-bd76-4ed3826c0cf5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 11:20:17.948846 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:20:17.948846 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:20:17.948846 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:20:17.948846 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:20:17.948846 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:20:17.948846 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:20:17.948846 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:20:17.948846 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:20:17.948846 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:20:17.948846 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:20:17.948846 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:20:17.948846 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:20:17.948846 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:20:17.948846 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:20:17.948846 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:20:17.949743 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:20:17.949743 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:20:17.949743 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:20:17.949743 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:20:17.949743 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:20:17.949743 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:20:17.949743 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:20:17.949743 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:20:17.949743 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:20:17.949743 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:20:17.949743 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:20:17.949743 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Aug 24 11:20:17.949743 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:20:17.949743 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:20:17.949743 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:20:17.949743 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:20:17.950683 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:20:17.950683 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:20:17.950683 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:20:17.950683 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:20:17.950683 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:20:17.950683 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:20:17.950683 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:20:17.950683 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:20:17.950683 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:20:17.950683 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:20:17.950683 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 11:20:17.950683 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Aug 24 11:20:17.950683 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 213/425] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Aug 24 11:20:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:20:17.955838 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b867885-f269-41f8-bd76-4ed3826c0cf5 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:17.989517 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd244389-b1eb-41b7-abd0-ba7bfd287565 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:18.024889 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b3714e-2704-4160-9ccc-0bb6e4fe0f19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:18.026242 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b3714e-2704-4160-9ccc-0bb6e4fe0f19 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:18.026685 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b3714e-2704-4160-9ccc-0bb6e4fe0f19 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:18.027470 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b3714e-2704-4160-9ccc-0bb6e4fe0f19 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:18.028351 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b3714e-2704-4160-9ccc-0bb6e4fe0f19 None admin] RBAC: Adding query filter params (group.id=2578f3ba31c14d518437e94f91a5599c, role.id=27e3e65e24df4b86b0d3d18d3212101d, scope.project.id=71e3821279484b7087ded02a637ad206) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:20:18.028811 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b3714e-2704-4160-9ccc-0bb6e4fe0f19 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:18.030440 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b3714e-2704-4160-9ccc-0bb6e4fe0f19 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:18.037141 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 213/426] 10.222.0.27 () {56 vars in 1376 bytes} [Wed Aug 24 11:20:17 2022] GET /identity/v3/role_assignments?group.id=2578f3ba31c14d518437e94f91a5599c&scope.project.id=71e3821279484b7087ded02a637ad206&role.id=27e3e65e24df4b86b0d3d18d3212101d => generated 611 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:20:18.156858 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b867885-f269-41f8-bd76-4ed3826c0cf5 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:18.170835 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:18.200261 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d94370-a71c-42bc-9749-c47aee61aa94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:18.200934 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d94370-a71c-42bc-9749-c47aee61aa94 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:18.201222 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d94370-a71c-42bc-9749-c47aee61aa94 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:18.201490 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d94370-a71c-42bc-9749-c47aee61aa94 None admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:18.202175 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d94370-a71c-42bc-9749-c47aee61aa94 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:20:18.202513 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d94370-a71c-42bc-9749-c47aee61aa94 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:18.203943 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d94370-a71c-42bc-9749-c47aee61aa94 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:18.213691 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 214/427] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Aug 24 11:20:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:18.219497 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b3714e-2704-4160-9ccc-0bb6e4fe0f19 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:18.323124 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:18.340157 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b3714e-2704-4160-9ccc-0bb6e4fe0f19 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:18.375040 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dac6fc-7992-4359-876c-b4a63e974052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:18.376008 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dac6fc-7992-4359-876c-b4a63e974052 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:18.376485 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dac6fc-7992-4359-876c-b4a63e974052 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:18.376967 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dac6fc-7992-4359-876c-b4a63e974052 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:18.446790 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dac6fc-7992-4359-876c-b4a63e974052 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:18.448655 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dac6fc-7992-4359-876c-b4a63e974052 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:18.511508 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48578159-bf1d-4bb0-b860-435c782b5e59 None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:18.512144 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48578159-bf1d-4bb0-b860-435c782b5e59 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:18.512608 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48578159-bf1d-4bb0-b860-435c782b5e59 None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:18.514446 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 215/428] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:20:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:20:18.521719 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c80c73-995f-421c-a174-a1e5c1da930c None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:18.522290 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c80c73-995f-421c-a174-a1e5c1da930c None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:18.522795 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c80c73-995f-421c-a174-a1e5c1da930c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:18.535828 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:18.547111 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-99c80c73-995f-421c-a174-a1e5c1da930c None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:20:18.549098 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-99c80c73-995f-421c-a174-a1e5c1da930c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:20:18.553321 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 214/429] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 24 11:20:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 11:20:18.559906 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dac6fc-7992-4359-876c-b4a63e974052 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:18.645363 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 216/430] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:20:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 11:20:18.687218 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dac6fc-7992-4359-876c-b4a63e974052 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:18.723204 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2da84e-c2f9-4c0f-a34f-02a15f8451f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:18.724149 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2da84e-c2f9-4c0f-a34f-02a15f8451f7 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:18.724623 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2da84e-c2f9-4c0f-a34f-02a15f8451f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:18.725066 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2da84e-c2f9-4c0f-a34f-02a15f8451f7 None admin] PATH_INFO: `/v3/projects/71e3821279484b7087ded02a637ad206` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:18.726425 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2da84e-c2f9-4c0f-a34f-02a15f8451f7 None admin] RBAC: Authorizing `identity:get_project(project_id=71e3821279484b7087ded02a637ad206)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:18.728119 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2da84e-c2f9-4c0f-a34f-02a15f8451f7 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:18.729973 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 215/431] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Aug 24 11:20:18 2022] GET /identity/v3/projects/71e3821279484b7087ded02a637ad206 => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:20:18.735843 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c80c73-995f-421c-a174-a1e5c1da930c None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:18.836532 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:18.845589 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c80c73-995f-421c-a174-a1e5c1da930c None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:18.884022 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948abbaa-4e5b-456f-b3e0-570b24462084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:18.884657 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948abbaa-4e5b-456f-b3e0-570b24462084 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:18.884931 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948abbaa-4e5b-456f-b3e0-570b24462084 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:18.885200 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948abbaa-4e5b-456f-b3e0-570b24462084 None admin] PATH_INFO: `/v3/groups/2578f3ba31c14d518437e94f91a5599c` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:18.886315 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948abbaa-4e5b-456f-b3e0-570b24462084 None admin] RBAC: Authorizing `identity:get_group(group_id=2578f3ba31c14d518437e94f91a5599c)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:18.887785 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948abbaa-4e5b-456f-b3e0-570b24462084 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:18.889699 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 217/432] 10.222.0.27 () {56 vars in 1180 bytes} [Wed Aug 24 11:20:18 2022] GET /identity/v3/groups/2578f3ba31c14d518437e94f91a5599c => generated 226 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:18.895423 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2da84e-c2f9-4c0f-a34f-02a15f8451f7 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:18.963356 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:18.964571 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948abbaa-4e5b-456f-b3e0-570b24462084 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:19.023568 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2da84e-c2f9-4c0f-a34f-02a15f8451f7 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:19.063952 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1eeeacd-ba9b-420b-b884-982930b858b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:19.064576 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eeeacd-ba9b-420b-b884-982930b858b0 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:19.064826 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eeeacd-ba9b-420b-b884-982930b858b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:19.065086 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eeeacd-ba9b-420b-b884-982930b858b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:19.065951 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1eeeacd-ba9b-420b-b884-982930b858b0 None admin] RBAC: Adding query filter params (group.id=2578f3ba31c14d518437e94f91a5599c, role.id=96f07e9110194606acccfbd8467649a7, scope.project.id=71e3821279484b7087ded02a637ad206) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:20:19.066406 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1eeeacd-ba9b-420b-b884-982930b858b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:19.067900 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1eeeacd-ba9b-420b-b884-982930b858b0 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:19.075325 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 216/433] 10.222.0.27 () {56 vars in 1376 bytes} [Wed Aug 24 11:20:18 2022] GET /identity/v3/role_assignments?group.id=2578f3ba31c14d518437e94f91a5599c&scope.project.id=71e3821279484b7087ded02a637ad206&role.id=96f07e9110194606acccfbd8467649a7 => generated 611 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:20:19.076573 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67439047-fa68-4704-bee9-533e2f32696f None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:19.076915 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67439047-fa68-4704-bee9-533e2f32696f None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:19.077186 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67439047-fa68-4704-bee9-533e2f32696f None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:19.078450 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 217/434] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:20:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:20:19.084337 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1ebb18-a72e-4358-85ac-3fd5be1e983a None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:19.084633 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1ebb18-a72e-4358-85ac-3fd5be1e983a None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:19.084886 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1ebb18-a72e-4358-85ac-3fd5be1e983a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:19.087862 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948abbaa-4e5b-456f-b3e0-570b24462084 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:19.108046 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-4c1ebb18-a72e-4358-85ac-3fd5be1e983a None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:20:19.109553 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-4c1ebb18-a72e-4358-85ac-3fd5be1e983a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:20:19.138975 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca159ce4-bd42-4178-9ee2-047bf330284b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:19.138975 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca159ce4-bd42-4178-9ee2-047bf330284b None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:19.139273 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca159ce4-bd42-4178-9ee2-047bf330284b None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:19.139560 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca159ce4-bd42-4178-9ee2-047bf330284b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:19.155557 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca159ce4-bd42-4178-9ee2-047bf330284b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:20:19.162469 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-ca159ce4-bd42-4178-9ee2-047bf330284b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 11:20:19.162469 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:20:19.162469 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:20:19.162469 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:20:19.162469 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:20:19.162469 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:20:19.162469 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:20:19.162469 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:20:19.162469 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:20:19.162469 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:20:19.162469 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:20:19.162469 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:20:19.162469 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:20:19.162469 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:20:19.162469 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:20:19.162469 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:20:19.163455 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:20:19.163455 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:20:19.163455 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:20:19.163455 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:20:19.163455 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:20:19.163455 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:20:19.163455 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:20:19.163455 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:20:19.163455 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:20:19.163455 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:20:19.163455 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:20:19.163455 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Aug 24 11:20:19.163455 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:20:19.163455 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:20:19.163455 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:20:19.163455 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:20:19.164355 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:20:19.164355 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:20:19.164355 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:20:19.164355 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:20:19.164355 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:20:19.164355 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:20:19.164355 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:20:19.164355 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:20:19.164355 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:20:19.164355 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:20:19.164355 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 11:20:19.164355 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Aug 24 11:20:19.164355 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 218/435] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 24 11:20:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 11:20:19.165260 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f995e6e-714e-44cf-9f7c-b5ece60ee8e7 None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:19.165452 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f995e6e-714e-44cf-9f7c-b5ece60ee8e7 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:19.165744 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f995e6e-714e-44cf-9f7c-b5ece60ee8e7 None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:19.166973 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 219/436] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:20:19 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:20:19.169607 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f995e6e-714e-44cf-9f7c-b5ece60ee8e7 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:19.202753 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:19.213195 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 218/437] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:20:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 11:20:19.213195 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a1c46b-d862-408b-93c1-cd4f75708f74 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:19.213195 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a1c46b-d862-408b-93c1-cd4f75708f74 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:19.213195 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a1c46b-d862-408b-93c1-cd4f75708f74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:19.226273 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-02a1c46b-d862-408b-93c1-cd4f75708f74 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:20:19.227610 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-02a1c46b-d862-408b-93c1-cd4f75708f74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:20:19.286758 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:19.315089 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f995e6e-714e-44cf-9f7c-b5ece60ee8e7 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:19.321607 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 219/438] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:20:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 11:20:19.352165 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5702ba68-e2b6-4dc8-b6d5-2e1dd125d05c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:19.352785 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5702ba68-e2b6-4dc8-b6d5-2e1dd125d05c None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:19.353057 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5702ba68-e2b6-4dc8-b6d5-2e1dd125d05c None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:19.353326 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5702ba68-e2b6-4dc8-b6d5-2e1dd125d05c None admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:19.354006 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5702ba68-e2b6-4dc8-b6d5-2e1dd125d05c None admin] RBAC: Adding query filter params (name=member) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:20:19.354306 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5702ba68-e2b6-4dc8-b6d5-2e1dd125d05c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:19.355741 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5702ba68-e2b6-4dc8-b6d5-2e1dd125d05c None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:19.364785 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 220/439] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Aug 24 11:20:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:20:19.370422 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a1c46b-d862-408b-93c1-cd4f75708f74 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:19.472155 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a1c46b-d862-408b-93c1-cd4f75708f74 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:19.483292 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5702ba68-e2b6-4dc8-b6d5-2e1dd125d05c None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:19.514072 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183803c0-69e1-4e7e-bd11-9a9fd53e0c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:19.515426 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183803c0-69e1-4e7e-bd11-9a9fd53e0c7a None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:19.516019 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183803c0-69e1-4e7e-bd11-9a9fd53e0c7a None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:19.516296 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183803c0-69e1-4e7e-bd11-9a9fd53e0c7a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:19.571421 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:19.599669 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183803c0-69e1-4e7e-bd11-9a9fd53e0c7a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:19.601178 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183803c0-69e1-4e7e-bd11-9a9fd53e0c7a None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:19.604850 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:19.617187 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5702ba68-e2b6-4dc8-b6d5-2e1dd125d05c None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:19.650472 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67caa7d-eb38-43b7-b288-b175d191ba05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:19.651094 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67caa7d-eb38-43b7-b288-b175d191ba05 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:19.651367 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67caa7d-eb38-43b7-b288-b175d191ba05 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:19.651630 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67caa7d-eb38-43b7-b288-b175d191ba05 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:19.661936 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67caa7d-eb38-43b7-b288-b175d191ba05 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:20:19.667947 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-f67caa7d-eb38-43b7-b288-b175d191ba05 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 11:20:19.667947 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:20:19.667947 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:20:19.667947 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:20:19.667947 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:20:19.667947 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:20:19.667947 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:20:19.667947 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:20:19.667947 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:20:19.667947 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:20:19.667947 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:20:19.667947 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:20:19.667947 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:20:19.667947 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:20:19.667947 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:20:19.667947 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:20:19.668843 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:20:19.668843 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:20:19.668843 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:20:19.668843 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:20:19.668843 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:20:19.668843 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:20:19.668843 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:20:19.668843 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:20:19.668843 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:20:19.668843 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:20:19.668843 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:20:19.668843 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Aug 24 11:20:19.668843 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:20:19.668843 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:20:19.668843 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:20:19.668843 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:20:19.669846 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:20:19.669846 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:20:19.669846 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:20:19.669846 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:20:19.669846 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:20:19.669846 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:20:19.669846 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:20:19.669846 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:20:19.669846 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:20:19.669846 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:20:19.669846 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 11:20:19.669846 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Aug 24 11:20:19.669846 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 221/440] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Aug 24 11:20:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 11:20:19.670876 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67caa7d-eb38-43b7-b288-b175d191ba05 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:19.699784 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 220/441] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 24 11:20:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 11:20:19.700901 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183803c0-69e1-4e7e-bd11-9a9fd53e0c7a None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:19.767811 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67caa7d-eb38-43b7-b288-b175d191ba05 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:19.778665 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:19.799924 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183803c0-69e1-4e7e-bd11-9a9fd53e0c7a None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:19.804790 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90808552-e7b9-43ba-acb8-4a7bb224f0b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:19.805415 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90808552-e7b9-43ba-acb8-4a7bb224f0b9 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:19.805686 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90808552-e7b9-43ba-acb8-4a7bb224f0b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:19.805949 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90808552-e7b9-43ba-acb8-4a7bb224f0b9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:19.816758 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90808552-e7b9-43ba-acb8-4a7bb224f0b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:20:19.821918 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-90808552-e7b9-43ba-acb8-4a7bb224f0b9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 11:20:19.821918 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:20:19.821918 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:20:19.821918 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:20:19.821918 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:20:19.821918 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:20:19.821918 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:20:19.821918 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:20:19.821918 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:20:19.821918 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:20:19.821918 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:20:19.821918 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:20:19.821918 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:20:19.821918 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:20:19.821918 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:20:19.821918 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:20:19.822928 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:20:19.822928 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:20:19.822928 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:20:19.822928 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:20:19.822928 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:20:19.822928 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:20:19.822928 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:20:19.822928 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:20:19.822928 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:20:19.822928 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:20:19.822928 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:20:19.822928 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Aug 24 11:20:19.822928 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:20:19.822928 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:20:19.822928 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:20:19.822928 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:20:19.823771 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:20:19.823771 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:20:19.823771 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:20:19.823771 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:20:19.823771 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:20:19.823771 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:20:19.823771 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:20:19.823771 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:20:19.823771 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:20:19.823771 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:20:19.823771 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 11:20:19.823771 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Aug 24 11:20:19.823771 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 222/442] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Aug 24 11:20:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:20:19.824424 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90808552-e7b9-43ba-acb8-4a7bb224f0b9 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:19.834419 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:19.836411 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a93f6f-2e77-42be-baee-6fcc496a0211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:19.837023 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a93f6f-2e77-42be-baee-6fcc496a0211 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:19.837428 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a93f6f-2e77-42be-baee-6fcc496a0211 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:19.837548 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a93f6f-2e77-42be-baee-6fcc496a0211 None admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:19.838215 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a93f6f-2e77-42be-baee-6fcc496a0211 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:20:19.838545 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a93f6f-2e77-42be-baee-6fcc496a0211 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:19.839946 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a93f6f-2e77-42be-baee-6fcc496a0211 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:19.848010 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 221/443] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Aug 24 11:20:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:19.848811 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a93f6f-2e77-42be-baee-6fcc496a0211 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:19.926272 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90808552-e7b9-43ba-acb8-4a7bb224f0b9 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:19.950374 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a93f6f-2e77-42be-baee-6fcc496a0211 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:19.961360 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be800483-11cc-4049-af93-7e5b2a41a61e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:19.961986 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be800483-11cc-4049-af93-7e5b2a41a61e None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:19.962246 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be800483-11cc-4049-af93-7e5b2a41a61e None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:19.962545 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be800483-11cc-4049-af93-7e5b2a41a61e None admin] PATH_INFO: `/v3/projects/d865cccda5444ed685650f098a696d95` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:19.963718 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be800483-11cc-4049-af93-7e5b2a41a61e None admin] RBAC: Authorizing `identity:get_project(project_id=d865cccda5444ed685650f098a696d95)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:19.965214 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be800483-11cc-4049-af93-7e5b2a41a61e None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:19.966896 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 223/444] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Aug 24 11:20:19 2022] GET /identity/v3/projects/d865cccda5444ed685650f098a696d95 => generated 302 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:19.967643 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be800483-11cc-4049-af93-7e5b2a41a61e None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:19.984052 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217e10a2-8678-4f05-8e95-d64317ecc2c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:19.984688 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217e10a2-8678-4f05-8e95-d64317ecc2c4 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:19.984931 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217e10a2-8678-4f05-8e95-d64317ecc2c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:19.985197 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217e10a2-8678-4f05-8e95-d64317ecc2c4 None admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:19.985856 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217e10a2-8678-4f05-8e95-d64317ecc2c4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:20:19.986157 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217e10a2-8678-4f05-8e95-d64317ecc2c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:19.987578 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217e10a2-8678-4f05-8e95-d64317ecc2c4 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:19.995592 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 222/445] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 24 11:20:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:19.996367 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217e10a2-8678-4f05-8e95-d64317ecc2c4 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:19.998824 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:20.044773 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:20.067745 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be800483-11cc-4049-af93-7e5b2a41a61e None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:20.095627 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217e10a2-8678-4f05-8e95-d64317ecc2c4 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:20.101970 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55af8640-2754-49b1-b926-f864354c43bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:20.102612 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55af8640-2754-49b1-b926-f864354c43bb None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:20.102888 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55af8640-2754-49b1-b926-f864354c43bb None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:20.103157 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55af8640-2754-49b1-b926-f864354c43bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:20.130717 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873307ef-5ae5-4102-8696-37917862002b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:20.131345 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873307ef-5ae5-4102-8696-37917862002b None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:20.131617 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873307ef-5ae5-4102-8696-37917862002b None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:20.131887 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873307ef-5ae5-4102-8696-37917862002b None admin] PATH_INFO: `/v3/groups/2578f3ba31c14d518437e94f91a5599c` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:20.132997 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873307ef-5ae5-4102-8696-37917862002b None admin] RBAC: Authorizing `identity:get_group(group_id=2578f3ba31c14d518437e94f91a5599c)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:20.134485 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873307ef-5ae5-4102-8696-37917862002b None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:20.136031 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 223/446] 10.222.0.27 () {56 vars in 1180 bytes} [Wed Aug 24 11:20:19 2022] GET /identity/v3/groups/2578f3ba31c14d518437e94f91a5599c => generated 226 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:20.136778 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873307ef-5ae5-4102-8696-37917862002b None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:20.172607 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55af8640-2754-49b1-b926-f864354c43bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:20.174115 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55af8640-2754-49b1-b926-f864354c43bb None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:20.209615 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:20.239820 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873307ef-5ae5-4102-8696-37917862002b None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:20.246988 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:20.270895 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 224/447] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 24 11:20:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 11:20:20.271717 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55af8640-2754-49b1-b926-f864354c43bb None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:20.277410 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b3ddee-06de-474d-96c3-8c11e72a372f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:20.278027 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b3ddee-06de-474d-96c3-8c11e72a372f None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:20.278306 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b3ddee-06de-474d-96c3-8c11e72a372f None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:20.278606 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b3ddee-06de-474d-96c3-8c11e72a372f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:20.345280 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b3ddee-06de-474d-96c3-8c11e72a372f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:20.346861 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b3ddee-06de-474d-96c3-8c11e72a372f None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:20.368640 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55af8640-2754-49b1-b926-f864354c43bb None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:20.402363 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21ae1b0-8367-4db9-b79b-27205d03fbed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:20.402980 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21ae1b0-8367-4db9-b79b-27205d03fbed None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:20.403257 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21ae1b0-8367-4db9-b79b-27205d03fbed None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:20.403522 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21ae1b0-8367-4db9-b79b-27205d03fbed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:20.404244 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21ae1b0-8367-4db9-b79b-27205d03fbed None admin] RBAC: Adding query filter params (group.id=2578f3ba31c14d518437e94f91a5599c, role.id=27e3e65e24df4b86b0d3d18d3212101d, scope.project.id=d865cccda5444ed685650f098a696d95) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:20:20.404546 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21ae1b0-8367-4db9-b79b-27205d03fbed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:20.406024 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21ae1b0-8367-4db9-b79b-27205d03fbed None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:20.411755 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 225/448] 10.222.0.27 () {56 vars in 1376 bytes} [Wed Aug 24 11:20:20 2022] GET /identity/v3/role_assignments?group.id=2578f3ba31c14d518437e94f91a5599c&scope.project.id=d865cccda5444ed685650f098a696d95&role.id=27e3e65e24df4b86b0d3d18d3212101d => generated 611 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:20.414531 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:20.419351 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21ae1b0-8367-4db9-b79b-27205d03fbed None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:20.456190 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 224/449] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 24 11:20:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 11:20:20.457544 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b3ddee-06de-474d-96c3-8c11e72a372f None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:20.466235 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:20.533405 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21ae1b0-8367-4db9-b79b-27205d03fbed None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:20.570172 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f805b8c-5038-413b-9fb6-04d4f892626c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:20.570825 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f805b8c-5038-413b-9fb6-04d4f892626c None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:20.571093 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f805b8c-5038-413b-9fb6-04d4f892626c None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:20.571373 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f805b8c-5038-413b-9fb6-04d4f892626c None admin] PATH_INFO: `/v3/projects/d865cccda5444ed685650f098a696d95` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:20.572588 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f805b8c-5038-413b-9fb6-04d4f892626c None admin] RBAC: Authorizing `identity:get_project(project_id=d865cccda5444ed685650f098a696d95)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:20.574079 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f805b8c-5038-413b-9fb6-04d4f892626c None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:20.580462 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 226/450] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Aug 24 11:20:20 2022] GET /identity/v3/projects/d865cccda5444ed685650f098a696d95 => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:20.581549 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f805b8c-5038-413b-9fb6-04d4f892626c None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:20.586878 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b3ddee-06de-474d-96c3-8c11e72a372f None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:20.628775 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c62c88b-fb23-4f3d-8461-7333ef5641cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:20.629507 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c62c88b-fb23-4f3d-8461-7333ef5641cf None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:20.629784 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c62c88b-fb23-4f3d-8461-7333ef5641cf None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:20.630053 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c62c88b-fb23-4f3d-8461-7333ef5641cf None admin] PATH_INFO: `/v3/projects/5558cde3f9bd4a779ecb6a225f26878d` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:20.631270 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c62c88b-fb23-4f3d-8461-7333ef5641cf None admin] RBAC: Authorizing `identity:get_project(project_id=5558cde3f9bd4a779ecb6a225f26878d)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:20.632938 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c62c88b-fb23-4f3d-8461-7333ef5641cf None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:20.634809 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 225/451] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Aug 24 11:20:20 2022] GET /identity/v3/projects/5558cde3f9bd4a779ecb6a225f26878d => generated 344 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:20.640487 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c62c88b-fb23-4f3d-8461-7333ef5641cf None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:20.684400 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:20.701806 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f805b8c-5038-413b-9fb6-04d4f892626c None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:20.711723 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:20.744178 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dfaf9f-fc9b-45a1-bd9f-80aeef36c6ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:20.745224 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dfaf9f-fc9b-45a1-bd9f-80aeef36c6ad None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:20.746073 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dfaf9f-fc9b-45a1-bd9f-80aeef36c6ad None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:20.746073 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dfaf9f-fc9b-45a1-bd9f-80aeef36c6ad None admin] PATH_INFO: `/v3/groups/2578f3ba31c14d518437e94f91a5599c` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:20.747125 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dfaf9f-fc9b-45a1-bd9f-80aeef36c6ad None admin] RBAC: Authorizing `identity:get_group(group_id=2578f3ba31c14d518437e94f91a5599c)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:20.748503 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dfaf9f-fc9b-45a1-bd9f-80aeef36c6ad None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:20.750099 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 227/452] 10.222.0.27 () {56 vars in 1180 bytes} [Wed Aug 24 11:20:20 2022] GET /identity/v3/groups/2578f3ba31c14d518437e94f91a5599c => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:20.755868 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c62c88b-fb23-4f3d-8461-7333ef5641cf None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:20.756138 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dfaf9f-fc9b-45a1-bd9f-80aeef36c6ad None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:20.793313 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb18ac84-8d9c-40ca-a23c-b8b50cfe733e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:20.793946 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb18ac84-8d9c-40ca-a23c-b8b50cfe733e None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:20.794222 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb18ac84-8d9c-40ca-a23c-b8b50cfe733e None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:20.794526 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb18ac84-8d9c-40ca-a23c-b8b50cfe733e None admin] PATH_INFO: `/v3/groups/29f5669037044f0ab59746007087b8bd` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:20.795665 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb18ac84-8d9c-40ca-a23c-b8b50cfe733e None admin] RBAC: Authorizing `identity:get_group(group_id=29f5669037044f0ab59746007087b8bd)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:20.797136 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb18ac84-8d9c-40ca-a23c-b8b50cfe733e None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:20.798780 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 226/453] 10.222.0.27 () {56 vars in 1180 bytes} [Wed Aug 24 11:20:20 2022] GET /identity/v3/groups/29f5669037044f0ab59746007087b8bd => generated 229 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:20:20.804544 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb18ac84-8d9c-40ca-a23c-b8b50cfe733e None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:20.860594 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dfaf9f-fc9b-45a1-bd9f-80aeef36c6ad None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:20.893940 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc51eccc-92e0-4add-a6b7-bf52930785eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:20.894568 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc51eccc-92e0-4add-a6b7-bf52930785eb None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:20.894843 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc51eccc-92e0-4add-a6b7-bf52930785eb None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:20.895116 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc51eccc-92e0-4add-a6b7-bf52930785eb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:20.895860 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc51eccc-92e0-4add-a6b7-bf52930785eb None admin] RBAC: Adding query filter params (group.id=2578f3ba31c14d518437e94f91a5599c, role.id=96f07e9110194606acccfbd8467649a7, scope.project.id=d865cccda5444ed685650f098a696d95) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:20:20.896170 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc51eccc-92e0-4add-a6b7-bf52930785eb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:20.897645 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc51eccc-92e0-4add-a6b7-bf52930785eb None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:20.901073 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb18ac84-8d9c-40ca-a23c-b8b50cfe733e None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:20.903767 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 228/454] 10.222.0.27 () {56 vars in 1376 bytes} [Wed Aug 24 11:20:20 2022] GET /identity/v3/role_assignments?group.id=2578f3ba31c14d518437e94f91a5599c&scope.project.id=d865cccda5444ed685650f098a696d95&role.id=96f07e9110194606acccfbd8467649a7 => generated 611 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:20:20.909163 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:20.939657 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bf60fd-a8cc-4956-a52c-3a0844055788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:20.940283 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bf60fd-a8cc-4956-a52c-3a0844055788 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:20.940560 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bf60fd-a8cc-4956-a52c-3a0844055788 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:20.940828 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bf60fd-a8cc-4956-a52c-3a0844055788 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:20.941652 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bf60fd-a8cc-4956-a52c-3a0844055788 None admin] RBAC: Adding query filter params (group.id=29f5669037044f0ab59746007087b8bd, role.id=30bb1e97257f4ca5b90c88545777317b, scope.project.id=5558cde3f9bd4a779ecb6a225f26878d) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:20:20.941953 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bf60fd-a8cc-4956-a52c-3a0844055788 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:20.943477 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bf60fd-a8cc-4956-a52c-3a0844055788 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:20.950335 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 227/455] 10.222.0.27 () {56 vars in 1376 bytes} [Wed Aug 24 11:20:20 2022] GET /identity/v3/role_assignments?group.id=29f5669037044f0ab59746007087b8bd&scope.project.id=5558cde3f9bd4a779ecb6a225f26878d&role.id=30bb1e97257f4ca5b90c88545777317b => generated 611 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:20:23.462223 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31c255f-9d70-44d8-8be6-f175a0206b83 None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:23.462782 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31c255f-9d70-44d8-8be6-f175a0206b83 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:23.462782 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31c255f-9d70-44d8-8be6-f175a0206b83 None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:23.464298 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 229/456] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:20:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:20:23.469635 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62d7dde-7e7d-4d19-8fd4-e11f27c1c376 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:23.470060 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62d7dde-7e7d-4d19-8fd4-e11f27c1c376 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:23.470230 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62d7dde-7e7d-4d19-8fd4-e11f27c1c376 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:23.492430 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-c62d7dde-7e7d-4d19-8fd4-e11f27c1c376 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:20:23.493642 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-c62d7dde-7e7d-4d19-8fd4-e11f27c1c376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:20:23.586679 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 228/457] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:20:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 11:20:23.760514 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad80317-b0e2-427f-813d-088939110efc None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:23.761194 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad80317-b0e2-427f-813d-088939110efc None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:23.761670 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad80317-b0e2-427f-813d-088939110efc None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:23.763620 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 230/458] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:20:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:20:23.771080 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e7cee5-174d-409e-90c1-3c47e95ef365 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:23.771363 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e7cee5-174d-409e-90c1-3c47e95ef365 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:23.771633 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e7cee5-174d-409e-90c1-3c47e95ef365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:23.799403 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-f5e7cee5-174d-409e-90c1-3c47e95ef365 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:20:23.800776 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-f5e7cee5-174d-409e-90c1-3c47e95ef365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:20:23.884685 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 229/459] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:20:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 11:20:23.959428 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad80317-b0e2-427f-813d-088939110efc None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:24.016313 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:24.082080 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7596f9-f108-4aa0-9634-e2fe5a1c5b4b None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:24.082726 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7596f9-f108-4aa0-9634-e2fe5a1c5b4b None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:24.083193 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7596f9-f108-4aa0-9634-e2fe5a1c5b4b None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:24.085054 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 230/460] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:20:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:20:24.091391 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120cb150-750f-4b34-90f5-802278003f6a None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:24.091906 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120cb150-750f-4b34-90f5-802278003f6a None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:24.092513 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120cb150-750f-4b34-90f5-802278003f6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:24.110009 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad80317-b0e2-427f-813d-088939110efc None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:24.130385 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-120cb150-750f-4b34-90f5-802278003f6a None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:20:24.134015 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-120cb150-750f-4b34-90f5-802278003f6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:20:24.175824 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9f700c-f089-447d-9821-5da74057cea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:24.176816 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9f700c-f089-447d-9821-5da74057cea0 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:24.177302 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9f700c-f089-447d-9821-5da74057cea0 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:24.177808 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9f700c-f089-447d-9821-5da74057cea0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:24.182686 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:24.193039 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9f700c-f089-447d-9821-5da74057cea0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:24.194571 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9f700c-f089-447d-9821-5da74057cea0 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:24.209766 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-eb9f700c-f089-447d-9821-5da74057cea0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:20:24.209766 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:20:24.209766 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:20:24.209766 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:20:24.209766 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:20:24.209766 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:20:24.209766 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:20:24.209766 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:20:24.209766 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:20:24.209766 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:20:24.209766 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:20:24.209766 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:20:24.209766 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 11:20:24.209766 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 11:20:24.209766 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 11:20:24.209766 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 11:20:24.210942 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:20:24.210942 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:20:24.210942 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:20:24.210942 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:20:24.210942 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:20:24.210942 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:20:24.210942 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:20:24.210942 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Aug 24 11:20:24.210942 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:20:24.210942 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:20:24.210942 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:20:24.210942 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:20:24.210942 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:20:24.210942 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:20:24.210942 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:20:24.210942 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:20:24.210942 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 11:20:24.212048 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 11:20:24.212048 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:20:24.212048 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Aug 24 11:20:24.213276 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 231/461] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 11:20:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:20:24.214619 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793a39c7-4121-4525-9276-1dbdc497ba3f None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:24.214987 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793a39c7-4121-4525-9276-1dbdc497ba3f None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:24.215348 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793a39c7-4121-4525-9276-1dbdc497ba3f None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:24.220771 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 232/462] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:20:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:20:24.220771 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793a39c7-4121-4525-9276-1dbdc497ba3f None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:24.245275 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 231/463] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:20:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 11:20:24.246838 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2febf104-a8a5-4a01-ad40-19defde3c67f None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:24.247308 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2febf104-a8a5-4a01-ad40-19defde3c67f None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:24.247737 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2febf104-a8a5-4a01-ad40-19defde3c67f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:24.273481 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-2febf104-a8a5-4a01-ad40-19defde3c67f None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:20:24.274958 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-2febf104-a8a5-4a01-ad40-19defde3c67f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:20:24.342264 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:24.353551 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793a39c7-4121-4525-9276-1dbdc497ba3f None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:24.369867 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 232/464] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:20:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 11:20:24.369867 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2febf104-a8a5-4a01-ad40-19defde3c67f None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:24.415172 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402e9612-d865-4fdf-9897-416c28ea93a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:24.415783 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402e9612-d865-4fdf-9897-416c28ea93a3 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:24.416054 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402e9612-d865-4fdf-9897-416c28ea93a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:24.416320 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402e9612-d865-4fdf-9897-416c28ea93a3 None admin] PATH_INFO: `/v3/domains` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:24.418417 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402e9612-d865-4fdf-9897-416c28ea93a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:20:24.418726 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402e9612-d865-4fdf-9897-416c28ea93a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:24.420937 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402e9612-d865-4fdf-9897-416c28ea93a3 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:24.444626 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 233/465] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 24 11:20:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:24.450204 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402e9612-d865-4fdf-9897-416c28ea93a3 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:24.511009 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:24.521903 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2febf104-a8a5-4a01-ad40-19defde3c67f None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:24.563093 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a68456a-41ce-43c0-9b68-41209b89bed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:24.563763 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a68456a-41ce-43c0-9b68-41209b89bed3 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:24.564130 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a68456a-41ce-43c0-9b68-41209b89bed3 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:24.564467 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a68456a-41ce-43c0-9b68-41209b89bed3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:24.578283 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a68456a-41ce-43c0-9b68-41209b89bed3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:24.580258 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a68456a-41ce-43c0-9b68-41209b89bed3 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:24.602387 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-6a68456a-41ce-43c0-9b68-41209b89bed3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:20:24.602387 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:20:24.602387 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:20:24.602387 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:20:24.602387 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:20:24.602387 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:20:24.602387 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:20:24.602387 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:20:24.602387 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:20:24.602387 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:20:24.602387 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:20:24.602387 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:20:24.602387 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 11:20:24.602387 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 11:20:24.602387 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 11:20:24.602387 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 11:20:24.603370 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:20:24.603370 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:20:24.603370 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:20:24.603370 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:20:24.603370 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:20:24.603370 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:20:24.603370 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:20:24.603370 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Aug 24 11:20:24.603370 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:20:24.603370 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:20:24.603370 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:20:24.603370 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:20:24.603370 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:20:24.603370 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:20:24.603370 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:20:24.603370 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:20:24.603370 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 11:20:24.604281 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 11:20:24.604281 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:20:24.604281 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:20:24.604281 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 233/466] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 11:20:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:20:24.605274 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a68456a-41ce-43c0-9b68-41209b89bed3 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:24.606505 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402e9612-d865-4fdf-9897-416c28ea93a3 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:24.643107 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915650a5-1c5a-4304-9c91-c89aac57701a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:24.644038 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915650a5-1c5a-4304-9c91-c89aac57701a None admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:24.644583 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915650a5-1c5a-4304-9c91-c89aac57701a None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:24.645093 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915650a5-1c5a-4304-9c91-c89aac57701a None admin] PATH_INFO: `/v3/users` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:24.645970 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915650a5-1c5a-4304-9c91-c89aac57701a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:24.647717 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915650a5-1c5a-4304-9c91-c89aac57701a None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:24.669349 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 234/467] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Aug 24 11:20:24 2022] POST /identity/v3/users => generated 246 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:20:24.670514 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915650a5-1c5a-4304-9c91-c89aac57701a None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:24.694101 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:24.733806 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a68456a-41ce-43c0-9b68-41209b89bed3 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:24.776208 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d618eb2e-e39f-4976-bb4a-4f78a616b2c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:24.777328 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d618eb2e-e39f-4976-bb4a-4f78a616b2c1 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:24.777667 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d618eb2e-e39f-4976-bb4a-4f78a616b2c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:24.778002 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d618eb2e-e39f-4976-bb4a-4f78a616b2c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:24.791477 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d618eb2e-e39f-4976-bb4a-4f78a616b2c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:24.793118 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d618eb2e-e39f-4976-bb4a-4f78a616b2c1 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:24.795440 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:24.811410 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-d618eb2e-e39f-4976-bb4a-4f78a616b2c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:20:24.811410 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:20:24.811410 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:20:24.811410 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:20:24.811410 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:20:24.811410 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:20:24.811410 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:20:24.811410 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:20:24.811410 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:20:24.811410 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:20:24.811410 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:20:24.811410 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:20:24.811410 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 11:20:24.811410 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 11:20:24.811410 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 11:20:24.811410 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 11:20:24.812388 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:20:24.812388 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:20:24.812388 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:20:24.812388 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:20:24.812388 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:20:24.812388 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:20:24.812388 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:20:24.812388 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Aug 24 11:20:24.812388 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:20:24.812388 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:20:24.812388 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:20:24.812388 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:20:24.812388 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:20:24.812388 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:20:24.812388 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:20:24.812388 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:20:24.812388 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 11:20:24.813281 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 11:20:24.813281 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:20:24.813281 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:20:24.817370 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 234/468] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 11:20:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:20:24.818328 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d618eb2e-e39f-4976-bb4a-4f78a616b2c1 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:24.827487 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915650a5-1c5a-4304-9c91-c89aac57701a None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:24.872565 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e47a143-c42c-4330-9301-aa8365afd7de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:24.873515 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e47a143-c42c-4330-9301-aa8365afd7de None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:24.873792 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e47a143-c42c-4330-9301-aa8365afd7de None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:24.874065 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e47a143-c42c-4330-9301-aa8365afd7de None admin] PATH_INFO: `/v3/domains` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:24.876146 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e47a143-c42c-4330-9301-aa8365afd7de None admin] RBAC: Adding query filter params (name=Default) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:20:24.876146 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e47a143-c42c-4330-9301-aa8365afd7de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:24.876454 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e47a143-c42c-4330-9301-aa8365afd7de None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:24.891599 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 235/469] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 24 11:20:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:24.892461 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e47a143-c42c-4330-9301-aa8365afd7de None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:24.931368 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d618eb2e-e39f-4976-bb4a-4f78a616b2c1 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:24.963723 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:24.966820 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc37a4c-92bd-4373-8e40-56e46a649e52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:24.967511 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc37a4c-92bd-4373-8e40-56e46a649e52 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:24.968402 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc37a4c-92bd-4373-8e40-56e46a649e52 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:24.968402 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc37a4c-92bd-4373-8e40-56e46a649e52 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:24.979231 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc37a4c-92bd-4373-8e40-56e46a649e52 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:24.980945 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc37a4c-92bd-4373-8e40-56e46a649e52 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:24.996131 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-8fc37a4c-92bd-4373-8e40-56e46a649e52 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:20:24.996131 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:20:24.996131 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:20:24.996131 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:20:24.996131 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:20:24.996131 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:20:24.996131 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:20:24.996131 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:20:24.996131 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:20:24.996131 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:20:24.996131 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:20:24.996131 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:20:24.996131 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 11:20:24.996131 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 11:20:24.996131 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 11:20:24.996131 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 11:20:24.997168 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:20:24.997168 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:20:24.997168 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:20:24.997168 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:20:24.997168 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:20:24.997168 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:20:24.997168 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:20:24.997168 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Aug 24 11:20:24.997168 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:20:24.997168 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:20:24.997168 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:20:24.997168 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:20:24.997168 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:20:24.997168 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:20:24.997168 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:20:24.997168 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:20:24.997168 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 11:20:24.998495 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 11:20:24.998495 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:20:24.998495 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:20:24.998495 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 235/470] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 11:20:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:20:24.998495 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eacb31a-2f37-4961-ae1d-c2474bfd145f None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:24.998495 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eacb31a-2f37-4961-ae1d-c2474bfd145f None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:24.998828 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eacb31a-2f37-4961-ae1d-c2474bfd145f None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:25.000091 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 236/471] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:20:24 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:20:25.000566 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eacb31a-2f37-4961-ae1d-c2474bfd145f None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:25.006861 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e47a143-c42c-4330-9301-aa8365afd7de None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:25.042916 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3289e75b-4f98-475d-8f77-c4318c78a4b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:25.043513 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3289e75b-4f98-475d-8f77-c4318c78a4b1 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:25.043783 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3289e75b-4f98-475d-8f77-c4318c78a4b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:25.044037 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3289e75b-4f98-475d-8f77-c4318c78a4b1 None admin] PATH_INFO: `/v3/domains` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:25.044669 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3289e75b-4f98-475d-8f77-c4318c78a4b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:20:25.044962 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3289e75b-4f98-475d-8f77-c4318c78a4b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:25.046528 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3289e75b-4f98-475d-8f77-c4318c78a4b1 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:25.051914 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:25.063443 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 236/472] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 24 11:20:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:25.063443 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3289e75b-4f98-475d-8f77-c4318c78a4b1 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:25.107183 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eacb31a-2f37-4961-ae1d-c2474bfd145f None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:25.142120 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337708d7-5164-4b03-b6bb-b0a0347d584e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:25.143067 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337708d7-5164-4b03-b6bb-b0a0347d584e None admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:25.143529 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337708d7-5164-4b03-b6bb-b0a0347d584e None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:25.143981 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337708d7-5164-4b03-b6bb-b0a0347d584e None admin] PATH_INFO: `/v3/users` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:25.144686 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337708d7-5164-4b03-b6bb-b0a0347d584e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:25.146133 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337708d7-5164-4b03-b6bb-b0a0347d584e None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:25.171024 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 237/473] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Aug 24 11:20:24 2022] POST /identity/v3/users => generated 248 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:20:25.173419 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5299e5a2-c008-43c6-ab6d-727bb2c3159b None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:25.173886 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5299e5a2-c008-43c6-ab6d-727bb2c3159b None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:25.174349 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5299e5a2-c008-43c6-ab6d-727bb2c3159b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:25.175403 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3289e75b-4f98-475d-8f77-c4318c78a4b1 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:25.199678 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-5299e5a2-c008-43c6-ab6d-727bb2c3159b None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:20:25.201213 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-5299e5a2-c008-43c6-ab6d-727bb2c3159b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:20:25.250284 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:25.273900 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1e0119-b9b3-47f5-9491-0a08043947da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:25.274540 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1e0119-b9b3-47f5-9491-0a08043947da None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:25.274814 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1e0119-b9b3-47f5-9491-0a08043947da None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:25.275079 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1e0119-b9b3-47f5-9491-0a08043947da None admin] PATH_INFO: `/v3/domains` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:25.275728 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1e0119-b9b3-47f5-9491-0a08043947da None admin] RBAC: Adding query filter params (name=Default) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:20:25.276022 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1e0119-b9b3-47f5-9491-0a08043947da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:25.277779 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1e0119-b9b3-47f5-9491-0a08043947da None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:25.288924 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 238/474] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:20:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 11:20:25.290238 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5299e5a2-c008-43c6-ab6d-727bb2c3159b None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:25.305918 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 237/475] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 24 11:20:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:25.315474 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1e0119-b9b3-47f5-9491-0a08043947da None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:25.332813 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:25.416426 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5299e5a2-c008-43c6-ab6d-727bb2c3159b None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:25.436708 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1e0119-b9b3-47f5-9491-0a08043947da None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:25.458584 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7490ed-8f8b-4cf3-9856-452fea7bee8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:25.459354 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7490ed-8f8b-4cf3-9856-452fea7bee8f None admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:25.459723 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7490ed-8f8b-4cf3-9856-452fea7bee8f None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:25.460083 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7490ed-8f8b-4cf3-9856-452fea7bee8f None admin] PATH_INFO: `/v3/users` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:25.460826 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7490ed-8f8b-4cf3-9856-452fea7bee8f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:25.463217 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7490ed-8f8b-4cf3-9856-452fea7bee8f None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:25.480428 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98d5470-25dc-4e7f-b185-52ead0e921ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:25.481265 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98d5470-25dc-4e7f-b185-52ead0e921ed None admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:25.481519 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98d5470-25dc-4e7f-b185-52ead0e921ed None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:25.481870 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98d5470-25dc-4e7f-b185-52ead0e921ed None admin] PATH_INFO: `/v3/users` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:25.483168 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98d5470-25dc-4e7f-b185-52ead0e921ed None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:25.484262 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98d5470-25dc-4e7f-b185-52ead0e921ed None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:25.491912 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 239/476] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Aug 24 11:20:25 2022] POST /identity/v3/users => generated 248 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:20:25.511818 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 238/477] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Aug 24 11:20:25 2022] POST /identity/v3/users => generated 249 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:20:25.607887 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7490ed-8f8b-4cf3-9856-452fea7bee8f None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:25.718455 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:25.735339 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7490ed-8f8b-4cf3-9856-452fea7bee8f None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:25.782409 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749c3550-c051-4282-a86d-a05a09dbd429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:25.782409 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749c3550-c051-4282-a86d-a05a09dbd429 None admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:25.782409 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749c3550-c051-4282-a86d-a05a09dbd429 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:25.782409 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749c3550-c051-4282-a86d-a05a09dbd429 None admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:25.782810 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749c3550-c051-4282-a86d-a05a09dbd429 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:25.782810 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749c3550-c051-4282-a86d-a05a09dbd429 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:25.791716 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.sql.core [None req-749c3550-c051-4282-a86d-a05a09dbd429 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 24 11:20:25.791716 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 24 11:20:25.791716 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [parameters: {'id': '3bf41ac62e624c4bac1eaeed12c3923c', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 24 11:20:25.791716 dv-cinder-848899-3-smb devstack@keystone.service[81501]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81501) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 24 11:20:25.808882 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-749c3550-c051-4282-a86d-a05a09dbd429 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 24 11:20:25.808882 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:20:25.808882 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 11:20:25.808882 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 11:20:25.808882 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 11:20:25.808882 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 11:20:25.808882 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 11:20:25.808882 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 11:20:25.808882 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 11:20:25.808882 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application conn.query(q) Aug 24 11:20:25.808882 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 11:20:25.808882 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 11:20:25.808882 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 11:20:25.808882 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application result.read() Aug 24 11:20:25.808882 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 11:20:25.809801 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 11:20:25.809801 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 11:20:25.809801 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 11:20:25.809801 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 11:20:25.809801 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 11:20:25.809801 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 11:20:25.809801 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 11:20:25.809801 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 24 11:20:25.809801 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:20:25.809801 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 24 11:20:25.809801 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:20:25.809801 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:20:25.809801 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 24 11:20:25.809801 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 24 11:20:25.809801 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 24 11:20:25.809801 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return ref.to_dict() Aug 24 11:20:25.809801 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 11:20:25.809801 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application next(self.gen) Aug 24 11:20:25.810854 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 24 11:20:25.810854 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application yield resource Aug 24 11:20:25.810854 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 11:20:25.810854 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application next(self.gen) Aug 24 11:20:25.810854 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 24 11:20:25.810854 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application self.session.rollback() Aug 24 11:20:25.810854 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 11:20:25.810854 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application self.force_reraise() Aug 24 11:20:25.810854 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 11:20:25.810854 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise self.value Aug 24 11:20:25.810854 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 24 11:20:25.810854 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 24 11:20:25.810854 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 24 11:20:25.810854 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application session.commit() Aug 24 11:20:25.810854 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 24 11:20:25.810854 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 24 11:20:25.810854 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 24 11:20:25.811740 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application self._prepare_impl() Aug 24 11:20:25.811740 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 24 11:20:25.811740 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application self.session.flush() Aug 24 11:20:25.811740 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 24 11:20:25.811740 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application self._flush(objects) Aug 24 11:20:25.811740 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 24 11:20:25.811740 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 24 11:20:25.811740 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 24 11:20:25.811740 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application compat.raise_( Aug 24 11:20:25.811740 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 11:20:25.811740 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception Aug 24 11:20:25.811740 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 24 11:20:25.811740 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application flush_context.execute() Aug 24 11:20:25.811740 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 24 11:20:25.811740 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rec.execute(self) Aug 24 11:20:25.811740 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 24 11:20:25.811740 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 24 11:20:25.814087 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 24 11:20:25.814087 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 24 11:20:25.814087 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 24 11:20:25.814087 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 24 11:20:25.814087 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 24 11:20:25.814087 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 24 11:20:25.814087 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 24 11:20:25.814087 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 24 11:20:25.814087 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 24 11:20:25.814087 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 24 11:20:25.814087 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 24 11:20:25.814087 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 24 11:20:25.814087 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 24 11:20:25.814087 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 24 11:20:25.814087 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 11:20:25.814087 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception Aug 24 11:20:25.816078 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 11:20:25.816078 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 11:20:25.816078 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 11:20:25.816078 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 11:20:25.816078 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 11:20:25.816078 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 11:20:25.816078 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 11:20:25.816078 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application conn.query(q) Aug 24 11:20:25.816078 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 11:20:25.816078 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 11:20:25.816078 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 11:20:25.816078 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application result.read() Aug 24 11:20:25.816078 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 11:20:25.816078 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 11:20:25.816078 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 11:20:25.816078 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 11:20:25.818017 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 11:20:25.818017 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 11:20:25.818017 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 11:20:25.818017 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 11:20:25.818017 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 24 11:20:25.818017 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 24 11:20:25.818017 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [parameters: {'id': '3bf41ac62e624c4bac1eaeed12c3923c', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 24 11:20:25.818017 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 24 11:20:25.818017 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:20:25.818017 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 11:20:25.818017 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:20:25.818017 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:20:25.818017 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:20:25.818017 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:20:25.818017 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:20:25.818017 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:20:25.821563 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:20:25.821563 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:20:25.821563 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:20:25.821563 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:20:25.821563 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:20:25.821563 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:20:25.821563 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 24 11:20:25.821563 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 24 11:20:25.821563 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:20:25.821563 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:20:25.821563 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 24 11:20:25.821563 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 24 11:20:25.821563 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 24 11:20:25.821563 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 24 11:20:25.821563 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 24 11:20:25.821563 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:20:25.823533 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 240/478] 10.222.0.27 () {60 vars in 1131 bytes} [Wed Aug 24 11:20:25 2022] POST /identity/v3/roles => generated 144 bytes in 203 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:20:25.823676 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98d5470-25dc-4e7f-b185-52ead0e921ed None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:25.867200 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:25.928855 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98d5470-25dc-4e7f-b185-52ead0e921ed None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:25.968031 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e12b00-2c6a-4fce-b5df-f07128c50dd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:25.968678 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e12b00-2c6a-4fce-b5df-f07128c50dd7 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:25.968957 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e12b00-2c6a-4fce-b5df-f07128c50dd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:25.969230 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e12b00-2c6a-4fce-b5df-f07128c50dd7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:25.987260 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e12b00-2c6a-4fce-b5df-f07128c50dd7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:20:25.992542 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-22e12b00-2c6a-4fce-b5df-f07128c50dd7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 11:20:25.992542 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:20:25.992542 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:20:25.992542 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:20:25.992542 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:20:25.992542 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:20:25.992542 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:20:25.992542 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:20:25.992542 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:20:25.992542 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:20:25.992542 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:20:25.992542 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:20:25.992542 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:20:25.992542 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:20:25.992542 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:20:25.992542 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:20:25.994563 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:20:25.994563 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:20:25.994563 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:20:25.994563 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:20:25.994563 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:20:25.994563 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:20:25.994563 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:20:25.994563 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:20:25.994563 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:20:25.994563 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:20:25.994563 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:20:25.994563 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Aug 24 11:20:25.994563 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:20:25.994563 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:20:25.994563 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:20:25.994563 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:20:25.996476 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:20:25.996476 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:20:25.996476 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:20:25.996476 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:20:25.996476 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:20:25.996476 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:20:25.996476 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:20:25.996476 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:20:25.996476 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:20:25.996476 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:20:25.996476 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 11:20:25.996476 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Aug 24 11:20:25.996476 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 239/479] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Aug 24 11:20:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:20:26.003446 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749c3550-c051-4282-a86d-a05a09dbd429 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:26.147764 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749c3550-c051-4282-a86d-a05a09dbd429 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:26.190096 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247cc7c2-70c3-41d6-8908-5d9537d28b4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:26.190753 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247cc7c2-70c3-41d6-8908-5d9537d28b4b None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:26.191054 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247cc7c2-70c3-41d6-8908-5d9537d28b4b None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:26.191328 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247cc7c2-70c3-41d6-8908-5d9537d28b4b None admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:26.192007 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247cc7c2-70c3-41d6-8908-5d9537d28b4b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:20:26.192306 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247cc7c2-70c3-41d6-8908-5d9537d28b4b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:26.193707 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247cc7c2-70c3-41d6-8908-5d9537d28b4b None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:26.202627 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 241/480] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Aug 24 11:20:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:26.837212 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd57fb25-14c0-47a3-ac5c-f7ba5b8e1abf None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:26.837921 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd57fb25-14c0-47a3-ac5c-f7ba5b8e1abf None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:26.837921 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd57fb25-14c0-47a3-ac5c-f7ba5b8e1abf None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:26.839415 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 240/481] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:20:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:20:26.844400 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6859420c-c218-4861-b3cc-fe2792d5f05b None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:26.844918 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6859420c-c218-4861-b3cc-fe2792d5f05b None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:26.845069 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6859420c-c218-4861-b3cc-fe2792d5f05b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:26.869397 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-6859420c-c218-4861-b3cc-fe2792d5f05b None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:20:26.870648 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-6859420c-c218-4861-b3cc-fe2792d5f05b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:20:26.881569 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:26.961034 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 242/482] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:20:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 11:20:27.301636 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd57fb25-14c0-47a3-ac5c-f7ba5b8e1abf None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:27.442312 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd57fb25-14c0-47a3-ac5c-f7ba5b8e1abf None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:27.447371 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:27.491953 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c458b492-e57e-485e-b688-3fa656b3f619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:27.492589 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c458b492-e57e-485e-b688-3fa656b3f619 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:27.492868 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c458b492-e57e-485e-b688-3fa656b3f619 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:27.493134 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c458b492-e57e-485e-b688-3fa656b3f619 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:27.508895 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c458b492-e57e-485e-b688-3fa656b3f619 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:20:27.513678 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-c458b492-e57e-485e-b688-3fa656b3f619 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 11:20:27.513678 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:20:27.513678 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:20:27.513678 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:20:27.513678 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:20:27.513678 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:20:27.513678 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:20:27.513678 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:20:27.513678 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:20:27.513678 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:20:27.513678 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:20:27.513678 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:20:27.513678 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:20:27.513678 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:20:27.513678 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:20:27.513678 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:20:27.515763 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:20:27.515763 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:20:27.515763 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:20:27.515763 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:20:27.515763 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:20:27.515763 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:20:27.515763 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:20:27.515763 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:20:27.515763 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:20:27.515763 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:20:27.515763 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:20:27.515763 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Aug 24 11:20:27.515763 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:20:27.515763 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:20:27.515763 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:20:27.515763 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:20:27.517663 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:20:27.517663 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:20:27.517663 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:20:27.517663 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:20:27.517663 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:20:27.517663 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:20:27.517663 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:20:27.517663 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:20:27.517663 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:20:27.517663 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:20:27.517663 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 11:20:27.517663 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Aug 24 11:20:27.517663 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 241/483] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Aug 24 11:20:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:20:27.521307 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6859420c-c218-4861-b3cc-fe2792d5f05b None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:27.651027 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6859420c-c218-4861-b3cc-fe2792d5f05b None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:27.705498 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02274b8-21e5-4a36-83df-86aae1e3236c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:27.706031 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02274b8-21e5-4a36-83df-86aae1e3236c None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:27.706307 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02274b8-21e5-4a36-83df-86aae1e3236c None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:27.706602 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02274b8-21e5-4a36-83df-86aae1e3236c None admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:27.707361 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02274b8-21e5-4a36-83df-86aae1e3236c None admin] RBAC: Adding query filter params (name=service) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:20:27.707635 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02274b8-21e5-4a36-83df-86aae1e3236c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:27.709044 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02274b8-21e5-4a36-83df-86aae1e3236c None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:27.721763 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 243/484] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Aug 24 11:20:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:27.727339 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c458b492-e57e-485e-b688-3fa656b3f619 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:27.864194 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c458b492-e57e-485e-b688-3fa656b3f619 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:27.888258 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f762d5-9c98-4584-8560-bffbbeb9f2d8 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:27.889027 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f762d5-9c98-4584-8560-bffbbeb9f2d8 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:27.889027 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f762d5-9c98-4584-8560-bffbbeb9f2d8 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:27.890396 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 244/485] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:20:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:20:27.895789 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519bfede-e7ac-4e62-93a8-0beaa3f6e0e7 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:27.896075 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519bfede-e7ac-4e62-93a8-0beaa3f6e0e7 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:27.896352 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519bfede-e7ac-4e62-93a8-0beaa3f6e0e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:27.911747 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee80f84c-2aba-416c-90b0-c7bf5595a261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:27.912380 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee80f84c-2aba-416c-90b0-c7bf5595a261 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:27.912654 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee80f84c-2aba-416c-90b0-c7bf5595a261 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:27.912923 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee80f84c-2aba-416c-90b0-c7bf5595a261 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:27.915315 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:27.924479 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee80f84c-2aba-416c-90b0-c7bf5595a261 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:27.926130 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee80f84c-2aba-416c-90b0-c7bf5595a261 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:27.927706 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-519bfede-e7ac-4e62-93a8-0beaa3f6e0e7 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:20:27.928927 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-519bfede-e7ac-4e62-93a8-0beaa3f6e0e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:20:27.942981 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-ee80f84c-2aba-416c-90b0-c7bf5595a261 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:20:27.942981 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:20:27.942981 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:20:27.942981 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:20:27.942981 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:20:27.942981 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:20:27.942981 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:20:27.942981 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:20:27.942981 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:20:27.942981 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:20:27.942981 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:20:27.942981 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:20:27.942981 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 11:20:27.942981 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 11:20:27.942981 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 11:20:27.942981 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 11:20:27.945031 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:20:27.945031 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:20:27.945031 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:20:27.945031 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:20:27.945031 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:20:27.945031 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:20:27.945031 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:20:27.945031 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Aug 24 11:20:27.945031 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:20:27.945031 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:20:27.945031 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:20:27.945031 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:20:27.945031 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:20:27.945031 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:20:27.945031 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:20:27.945031 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:20:27.945031 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 11:20:27.947096 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 11:20:27.947096 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:20:27.947096 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Aug 24 11:20:27.947096 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 242/486] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 11:20:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:20:27.947096 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f450cff6-95ff-41b1-b9f8-c0090bfdc9ab None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:27.947096 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f450cff6-95ff-41b1-b9f8-c0090bfdc9ab None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:27.947096 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f450cff6-95ff-41b1-b9f8-c0090bfdc9ab None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:27.952259 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 243/487] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:20:27 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:20:27.953121 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f450cff6-95ff-41b1-b9f8-c0090bfdc9ab None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:27.974270 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:28.009388 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 245/488] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:20:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 11:20:28.010681 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efcedb5-4209-4244-b9a3-9229ab76e52c None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:28.010960 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efcedb5-4209-4244-b9a3-9229ab76e52c None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:28.011234 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efcedb5-4209-4244-b9a3-9229ab76e52c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:28.039213 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-6efcedb5-4209-4244-b9a3-9229ab76e52c None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:20:28.040393 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-6efcedb5-4209-4244-b9a3-9229ab76e52c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:20:28.074112 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f450cff6-95ff-41b1-b9f8-c0090bfdc9ab None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:28.119047 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece27ecb-2ab8-4e74-b7a9-5e51ab2b2c1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:28.119733 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece27ecb-2ab8-4e74-b7a9-5e51ab2b2c1d None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:28.120103 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece27ecb-2ab8-4e74-b7a9-5e51ab2b2c1d None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:28.120469 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece27ecb-2ab8-4e74-b7a9-5e51ab2b2c1d None admin] PATH_INFO: `/v3/domains` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:28.121347 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece27ecb-2ab8-4e74-b7a9-5e51ab2b2c1d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:20:28.122042 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece27ecb-2ab8-4e74-b7a9-5e51ab2b2c1d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:28.123404 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece27ecb-2ab8-4e74-b7a9-5e51ab2b2c1d None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:28.134722 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 246/489] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:20:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 11:20:28.136187 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8999ac-b4ce-41e0-9993-b02416691470 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:28.136657 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8999ac-b4ce-41e0-9993-b02416691470 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:28.142076 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8999ac-b4ce-41e0-9993-b02416691470 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:28.142076 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 247/490] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:20:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:20:28.142588 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 244/491] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 24 11:20:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:28.145731 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8999ac-b4ce-41e0-9993-b02416691470 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:28.147291 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63964e2b-abda-4a1e-850b-1865eadd1d9c None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:28.147753 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63964e2b-abda-4a1e-850b-1865eadd1d9c None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:28.148198 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63964e2b-abda-4a1e-850b-1865eadd1d9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:28.183621 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-63964e2b-abda-4a1e-850b-1865eadd1d9c None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:20:28.185782 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-63964e2b-abda-4a1e-850b-1865eadd1d9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:20:28.262477 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:28.300996 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 245/492] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:20:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 11:20:28.301796 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63964e2b-abda-4a1e-850b-1865eadd1d9c None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:28.318879 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:28.323873 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8999ac-b4ce-41e0-9993-b02416691470 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:28.390761 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46d49b8-7f37-421c-a34a-8e53306ae485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:28.391401 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46d49b8-7f37-421c-a34a-8e53306ae485 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:28.391679 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46d49b8-7f37-421c-a34a-8e53306ae485 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:28.391950 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46d49b8-7f37-421c-a34a-8e53306ae485 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:28.406841 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46d49b8-7f37-421c-a34a-8e53306ae485 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:28.408360 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46d49b8-7f37-421c-a34a-8e53306ae485 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:28.437431 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-d46d49b8-7f37-421c-a34a-8e53306ae485 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 11:20:28.437431 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:20:28.437431 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:20:28.437431 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:20:28.437431 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:20:28.437431 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:20:28.437431 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:20:28.437431 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:20:28.437431 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:20:28.437431 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:20:28.437431 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:20:28.437431 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:20:28.437431 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 11:20:28.437431 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 11:20:28.437431 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 11:20:28.437431 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 11:20:28.438443 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:20:28.438443 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:20:28.438443 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 11:20:28.438443 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 11:20:28.438443 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 11:20:28.438443 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 11:20:28.438443 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:20:28.438443 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:20:28.438443 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:20:28.438443 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:20:28.438443 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:20:28.438443 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Aug 24 11:20:28.438443 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:20:28.438443 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:20:28.438443 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:20:28.438443 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:20:28.438443 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:20:28.438443 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:20:28.439350 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:20:28.439350 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:20:28.439350 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 11:20:28.439350 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 11:20:28.439350 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 11:20:28.439350 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 11:20:28.439350 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 11:20:28.439350 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 11:20:28.439350 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 11:20:28.439350 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:20:28.439350 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 248/493] 10.222.0.27 () {56 vars in 1093 bytes} [Wed Aug 24 11:20:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:20:28.440319 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46d49b8-7f37-421c-a34a-8e53306ae485 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:28.469230 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63964e2b-abda-4a1e-850b-1865eadd1d9c None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:28.506575 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740b3298-1aac-4540-839d-46fb90871955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:28.507528 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740b3298-1aac-4540-839d-46fb90871955 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:28.508139 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740b3298-1aac-4540-839d-46fb90871955 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:28.508624 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740b3298-1aac-4540-839d-46fb90871955 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:28.520814 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740b3298-1aac-4540-839d-46fb90871955 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:20:28.526128 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-740b3298-1aac-4540-839d-46fb90871955 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 11:20:28.526128 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:20:28.526128 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:20:28.526128 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:20:28.526128 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:20:28.526128 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:20:28.526128 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:20:28.526128 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:20:28.526128 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:20:28.526128 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:20:28.526128 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:20:28.526128 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:20:28.526128 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:20:28.526128 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:20:28.526128 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:20:28.526128 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:20:28.527520 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:20:28.527520 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:20:28.527520 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:20:28.527520 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:20:28.527520 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:20:28.527520 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:20:28.527520 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:20:28.527520 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:20:28.527520 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:20:28.527520 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:20:28.527520 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:20:28.527520 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Aug 24 11:20:28.527520 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:20:28.527520 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:20:28.527520 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:20:28.527520 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:20:28.528556 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:20:28.528556 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:20:28.528556 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:20:28.528556 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:20:28.528556 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:20:28.528556 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:20:28.528556 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:20:28.528556 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:20:28.528556 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:20:28.528556 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:20:28.528556 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 11:20:28.528556 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Aug 24 11:20:28.530881 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 246/494] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Aug 24 11:20:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:20:28.531876 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740b3298-1aac-4540-839d-46fb90871955 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:28.551662 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46d49b8-7f37-421c-a34a-8e53306ae485 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:28.577983 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:28.587800 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d7ff69-2da8-4e93-bb30-657ca5010863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:28.588261 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d7ff69-2da8-4e93-bb30-657ca5010863 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:28.588537 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d7ff69-2da8-4e93-bb30-657ca5010863 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:28.588805 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d7ff69-2da8-4e93-bb30-657ca5010863 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:28.599707 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d7ff69-2da8-4e93-bb30-657ca5010863 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:20:28.605446 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-a3d7ff69-2da8-4e93-bb30-657ca5010863 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 11:20:28.605446 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:20:28.605446 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:20:28.605446 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:20:28.605446 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:20:28.605446 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:20:28.605446 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:20:28.605446 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:20:28.605446 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:20:28.605446 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:20:28.605446 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:20:28.605446 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:20:28.605446 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:20:28.605446 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:20:28.605446 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:20:28.605446 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:20:28.606546 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:20:28.606546 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:20:28.606546 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:20:28.606546 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:20:28.606546 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:20:28.606546 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:20:28.606546 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:20:28.606546 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:20:28.606546 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:20:28.606546 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:20:28.606546 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:20:28.606546 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Aug 24 11:20:28.606546 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:20:28.606546 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:20:28.606546 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:20:28.606546 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:20:28.607678 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:20:28.607678 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:20:28.607678 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:20:28.607678 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:20:28.607678 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:20:28.607678 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:20:28.607678 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:20:28.607678 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:20:28.607678 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:20:28.607678 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:20:28.607678 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 11:20:28.607678 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:20:28.608355 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:28.608427 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 249/495] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Aug 24 11:20:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:20:28.608427 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d7ff69-2da8-4e93-bb30-657ca5010863 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:28.644053 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740b3298-1aac-4540-839d-46fb90871955 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:28.678931 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aa89a2-c149-4ac3-a4da-9b0f142944f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:28.679548 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aa89a2-c149-4ac3-a4da-9b0f142944f2 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:28.679826 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aa89a2-c149-4ac3-a4da-9b0f142944f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:28.680095 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aa89a2-c149-4ac3-a4da-9b0f142944f2 None admin] PATH_INFO: `/v3/users` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:28.680827 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48aa89a2-c149-4ac3-a4da-9b0f142944f2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:20:28.681130 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48aa89a2-c149-4ac3-a4da-9b0f142944f2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:28.682601 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48aa89a2-c149-4ac3-a4da-9b0f142944f2 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:28.714033 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d7ff69-2da8-4e93-bb30-657ca5010863 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:28.725117 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 247/496] 10.222.0.27 () {56 vars in 1133 bytes} [Wed Aug 24 11:20:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:28.725117 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aa89a2-c149-4ac3-a4da-9b0f142944f2 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:28.753658 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02975a6-504e-4ef0-9972-563458a4bacf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:28.754380 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02975a6-504e-4ef0-9972-563458a4bacf None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:28.754670 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02975a6-504e-4ef0-9972-563458a4bacf None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:28.754935 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02975a6-504e-4ef0-9972-563458a4bacf None admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:28.755591 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02975a6-504e-4ef0-9972-563458a4bacf None admin] RBAC: Adding query filter params (name=service) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:20:28.755886 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02975a6-504e-4ef0-9972-563458a4bacf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:28.757284 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02975a6-504e-4ef0-9972-563458a4bacf None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:28.765478 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 250/497] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Aug 24 11:20:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:28.767219 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02975a6-504e-4ef0-9972-563458a4bacf None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:28.820298 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:28.829172 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aa89a2-c149-4ac3-a4da-9b0f142944f2 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:28.853362 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:28.864526 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b96232-e5e3-4f86-9d69-991e839c4774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:28.865155 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b96232-e5e3-4f86-9d69-991e839c4774 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:28.865420 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b96232-e5e3-4f86-9d69-991e839c4774 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:28.865688 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b96232-e5e3-4f86-9d69-991e839c4774 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:28.873756 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02975a6-504e-4ef0-9972-563458a4bacf None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:28.875688 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b96232-e5e3-4f86-9d69-991e839c4774 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:20:28.880540 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-b1b96232-e5e3-4f86-9d69-991e839c4774 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 11:20:28.880540 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:20:28.880540 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:20:28.880540 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:20:28.880540 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:20:28.880540 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:20:28.880540 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:20:28.880540 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:20:28.880540 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:20:28.880540 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:20:28.880540 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:20:28.880540 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:20:28.880540 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:20:28.880540 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:20:28.880540 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:20:28.880540 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:20:28.881516 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:20:28.881516 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:20:28.881516 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:20:28.881516 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:20:28.881516 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:20:28.881516 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:20:28.881516 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:20:28.881516 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:20:28.881516 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:20:28.881516 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:20:28.881516 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:20:28.881516 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Aug 24 11:20:28.881516 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:20:28.881516 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:20:28.881516 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:20:28.881516 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:20:28.882447 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:20:28.882447 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:20:28.882447 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:20:28.882447 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:20:28.882447 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:20:28.882447 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:20:28.882447 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:20:28.882447 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:20:28.882447 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:20:28.882447 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:20:28.882447 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 11:20:28.882447 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Aug 24 11:20:28.882447 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 248/498] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Aug 24 11:20:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:20:28.882447 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b96232-e5e3-4f86-9d69-991e839c4774 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:28.911285 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa6c264-47b4-4cdf-9706-78b38cdf6c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:28.911905 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa6c264-47b4-4cdf-9706-78b38cdf6c7a None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:28.912176 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa6c264-47b4-4cdf-9706-78b38cdf6c7a None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:28.912437 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa6c264-47b4-4cdf-9706-78b38cdf6c7a None admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:28.913095 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa6c264-47b4-4cdf-9706-78b38cdf6c7a None admin] RBAC: Adding query filter params (name=service) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:20:28.913392 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa6c264-47b4-4cdf-9706-78b38cdf6c7a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:28.914822 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa6c264-47b4-4cdf-9706-78b38cdf6c7a None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:28.922846 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 251/499] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Aug 24 11:20:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:28.923637 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa6c264-47b4-4cdf-9706-78b38cdf6c7a None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:28.982674 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b96232-e5e3-4f86-9d69-991e839c4774 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:29.015298 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d070400-ffe4-43bf-be5c-8273f2fc7d67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:29.015916 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d070400-ffe4-43bf-be5c-8273f2fc7d67 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:29.016185 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d070400-ffe4-43bf-be5c-8273f2fc7d67 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:29.016454 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d070400-ffe4-43bf-be5c-8273f2fc7d67 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:29.020872 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa6c264-47b4-4cdf-9706-78b38cdf6c7a None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:29.031348 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:29.054814 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea9e525-0124-4710-bfdb-ffe4272fbc16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:29.055441 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea9e525-0124-4710-bfdb-ffe4272fbc16 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:29.055755 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea9e525-0124-4710-bfdb-ffe4272fbc16 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:29.056049 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea9e525-0124-4710-bfdb-ffe4272fbc16 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:29.067232 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea9e525-0124-4710-bfdb-ffe4272fbc16 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:29.067439 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:29.068784 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea9e525-0124-4710-bfdb-ffe4272fbc16 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:29.083338 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d070400-ffe4-43bf-be5c-8273f2fc7d67 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:29.083648 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-fea9e525-0124-4710-bfdb-ffe4272fbc16 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:20:29.083648 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:20:29.083648 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:20:29.083648 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:20:29.083648 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:20:29.083648 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:20:29.083648 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:20:29.083648 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:20:29.083648 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:20:29.083648 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:20:29.083648 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:20:29.083648 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:20:29.083648 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 11:20:29.083648 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 11:20:29.083648 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 11:20:29.083648 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 11:20:29.084561 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:20:29.084561 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:20:29.084561 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:20:29.084561 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:20:29.084561 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:20:29.084561 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:20:29.084561 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:20:29.084561 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Aug 24 11:20:29.084561 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:20:29.084561 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:20:29.084561 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:20:29.084561 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:20:29.084561 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:20:29.084561 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:20:29.084561 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:20:29.084561 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:20:29.084561 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 11:20:29.085423 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 11:20:29.085423 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:20:29.085423 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:20:29.085599 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d070400-ffe4-43bf-be5c-8273f2fc7d67 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:29.085666 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 252/500] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 11:20:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:20:29.086105 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529a5bac-eacf-4b1e-8f20-f10443305afb None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:29.086105 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529a5bac-eacf-4b1e-8f20-f10443305afb None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:29.086391 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529a5bac-eacf-4b1e-8f20-f10443305afb None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:29.087758 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 253/501] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:20:29 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:20:29.088408 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529a5bac-eacf-4b1e-8f20-f10443305afb None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:29.189106 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 249/502] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 24 11:20:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 11:20:29.189296 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529a5bac-eacf-4b1e-8f20-f10443305afb None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:29.189943 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d070400-ffe4-43bf-be5c-8273f2fc7d67 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:29.223158 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e44e6b1-83b7-4565-b39a-ec59eb8c8766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:29.223754 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e44e6b1-83b7-4565-b39a-ec59eb8c8766 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:29.224021 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e44e6b1-83b7-4565-b39a-ec59eb8c8766 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:29.224292 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e44e6b1-83b7-4565-b39a-ec59eb8c8766 None admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:29.224944 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e44e6b1-83b7-4565-b39a-ec59eb8c8766 None admin] RBAC: Adding query filter params (name=service) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:20:29.225235 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e44e6b1-83b7-4565-b39a-ec59eb8c8766 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:29.226639 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e44e6b1-83b7-4565-b39a-ec59eb8c8766 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:29.234327 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 254/503] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Aug 24 11:20:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:29.235128 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e44e6b1-83b7-4565-b39a-ec59eb8c8766 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:29.262177 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:29.277195 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:29.294275 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d070400-ffe4-43bf-be5c-8273f2fc7d67 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:29.329130 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8a878c-41ae-45f5-a9a1-b9e90f82023c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:29.329757 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8a878c-41ae-45f5-a9a1-b9e90f82023c None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:29.330031 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8a878c-41ae-45f5-a9a1-b9e90f82023c None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:29.330296 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8a878c-41ae-45f5-a9a1-b9e90f82023c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:29.340690 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8a878c-41ae-45f5-a9a1-b9e90f82023c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:29.341280 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e44e6b1-83b7-4565-b39a-ec59eb8c8766 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:29.342114 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8a878c-41ae-45f5-a9a1-b9e90f82023c None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:29.356470 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-3a8a878c-41ae-45f5-a9a1-b9e90f82023c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:20:29.356470 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:20:29.356470 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:20:29.356470 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:20:29.356470 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:20:29.356470 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:20:29.356470 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:20:29.356470 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:20:29.356470 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:20:29.356470 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:20:29.356470 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:20:29.356470 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:20:29.356470 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 11:20:29.356470 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 11:20:29.356470 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 11:20:29.356470 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 11:20:29.357391 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:20:29.357391 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:20:29.357391 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:20:29.357391 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:20:29.357391 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:20:29.357391 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:20:29.357391 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:20:29.357391 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Aug 24 11:20:29.357391 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:20:29.357391 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:20:29.357391 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:20:29.357391 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:20:29.357391 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:20:29.357391 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:20:29.357391 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:20:29.357391 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:20:29.357391 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 11:20:29.358246 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 11:20:29.358246 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:20:29.358246 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Aug 24 11:20:29.358246 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 250/504] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 11:20:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:20:29.358698 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1dabe7-91a7-4475-9786-7cf5abd9f838 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:29.358994 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1dabe7-91a7-4475-9786-7cf5abd9f838 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:29.359262 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1dabe7-91a7-4475-9786-7cf5abd9f838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:29.377559 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-ce1dabe7-91a7-4475-9786-7cf5abd9f838 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:20:29.378986 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-ce1dabe7-91a7-4475-9786-7cf5abd9f838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:20:29.380624 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4243dcb7-be08-443f-8427-80c0dae9c5b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:29.381233 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4243dcb7-be08-443f-8427-80c0dae9c5b9 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:29.382232 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4243dcb7-be08-443f-8427-80c0dae9c5b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:29.382232 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4243dcb7-be08-443f-8427-80c0dae9c5b9 None admin] PATH_INFO: `/v3/domains` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:29.382440 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4243dcb7-be08-443f-8427-80c0dae9c5b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:20:29.382731 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4243dcb7-be08-443f-8427-80c0dae9c5b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:29.384110 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4243dcb7-be08-443f-8427-80c0dae9c5b9 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:29.395950 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 255/505] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 24 11:20:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:29.396735 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4243dcb7-be08-443f-8427-80c0dae9c5b9 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:29.446665 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 251/506] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:20:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 11:20:29.447335 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1dabe7-91a7-4475-9786-7cf5abd9f838 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:29.495471 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:29.514056 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4243dcb7-be08-443f-8427-80c0dae9c5b9 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:29.515146 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:29.551440 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fc7c40-c7be-4ad5-a1f9-e2f08dfa2bdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:29.551622 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1dabe7-91a7-4475-9786-7cf5abd9f838 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:29.552120 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fc7c40-c7be-4ad5-a1f9-e2f08dfa2bdd None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:29.552396 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fc7c40-c7be-4ad5-a1f9-e2f08dfa2bdd None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:29.552664 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fc7c40-c7be-4ad5-a1f9-e2f08dfa2bdd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:29.564334 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fc7c40-c7be-4ad5-a1f9-e2f08dfa2bdd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:29.565954 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fc7c40-c7be-4ad5-a1f9-e2f08dfa2bdd None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:29.585445 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-b9fc7c40-c7be-4ad5-a1f9-e2f08dfa2bdd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:20:29.585445 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:20:29.585445 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:20:29.585445 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:20:29.585445 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:20:29.585445 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:20:29.585445 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:20:29.585445 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:20:29.585445 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:20:29.585445 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:20:29.585445 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:20:29.585445 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:20:29.585445 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 11:20:29.585445 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 11:20:29.585445 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 11:20:29.585445 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 11:20:29.586480 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:20:29.586480 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:20:29.586480 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:20:29.586480 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:20:29.586480 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:20:29.586480 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:20:29.586480 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:20:29.586480 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Aug 24 11:20:29.586480 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:20:29.586480 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:20:29.586480 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:20:29.586480 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:20:29.586480 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:20:29.586480 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:20:29.586480 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:20:29.586480 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:20:29.586480 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 11:20:29.587385 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 11:20:29.587385 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:20:29.587385 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:20:29.587385 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 256/507] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 11:20:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:20:29.587627 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fc7c40-c7be-4ad5-a1f9-e2f08dfa2bdd None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:29.596056 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542bb5d2-a78f-4156-85ab-60b8a8d3053a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:29.596628 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542bb5d2-a78f-4156-85ab-60b8a8d3053a None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:29.596900 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542bb5d2-a78f-4156-85ab-60b8a8d3053a None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:29.597166 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542bb5d2-a78f-4156-85ab-60b8a8d3053a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:29.607814 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542bb5d2-a78f-4156-85ab-60b8a8d3053a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:29.609281 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542bb5d2-a78f-4156-85ab-60b8a8d3053a None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:29.625135 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-542bb5d2-a78f-4156-85ab-60b8a8d3053a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:20:29.625135 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:20:29.625135 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:20:29.625135 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:20:29.625135 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:20:29.625135 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:20:29.625135 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:20:29.625135 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:20:29.625135 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:20:29.625135 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:20:29.625135 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:20:29.625135 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:20:29.625135 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 11:20:29.625135 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 11:20:29.625135 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 11:20:29.625135 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 11:20:29.626215 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:20:29.626215 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:20:29.626215 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:20:29.626215 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:20:29.626215 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:20:29.626215 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:20:29.626215 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:20:29.626215 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Aug 24 11:20:29.626215 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:20:29.626215 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:20:29.626215 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:20:29.626215 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:20:29.626215 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:20:29.626215 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:20:29.626215 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:20:29.626215 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:20:29.626215 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 11:20:29.627357 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 11:20:29.627357 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:20:29.627357 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Aug 24 11:20:29.633818 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 252/508] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 11:20:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:20:29.633818 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542bb5d2-a78f-4156-85ab-60b8a8d3053a None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:29.699458 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fc7c40-c7be-4ad5-a1f9-e2f08dfa2bdd None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:29.734117 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542bb5d2-a78f-4156-85ab-60b8a8d3053a None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:29.734503 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593a5293-be17-40cd-b020-106d09fd2fb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:29.735118 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593a5293-be17-40cd-b020-106d09fd2fb5 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:29.735381 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593a5293-be17-40cd-b020-106d09fd2fb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:29.735645 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593a5293-be17-40cd-b020-106d09fd2fb5 None admin] PATH_INFO: `/v3/domains` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:29.736349 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593a5293-be17-40cd-b020-106d09fd2fb5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:20:29.736662 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593a5293-be17-40cd-b020-106d09fd2fb5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:29.738096 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593a5293-be17-40cd-b020-106d09fd2fb5 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:29.740428 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:29.754700 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 257/509] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 24 11:20:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:29.754700 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593a5293-be17-40cd-b020-106d09fd2fb5 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:29.754965 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:29.772265 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9135cc0-594e-4426-a422-b67946d068ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:29.772998 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9135cc0-594e-4426-a422-b67946d068ad None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:29.773269 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9135cc0-594e-4426-a422-b67946d068ad None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:29.773537 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9135cc0-594e-4426-a422-b67946d068ad None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:29.781451 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9135cc0-594e-4426-a422-b67946d068ad None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:29.782958 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9135cc0-594e-4426-a422-b67946d068ad None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:29.795097 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-f9135cc0-594e-4426-a422-b67946d068ad None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 11:20:29.795097 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:20:29.795097 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:20:29.795097 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:20:29.795097 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:20:29.795097 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:20:29.795097 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:20:29.795097 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:20:29.795097 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:20:29.795097 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:20:29.795097 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:20:29.795097 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:20:29.795097 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 11:20:29.795097 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 11:20:29.795097 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 11:20:29.795097 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 11:20:29.796182 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:20:29.796182 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:20:29.796182 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 11:20:29.796182 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 11:20:29.796182 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 11:20:29.796182 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 11:20:29.796182 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:20:29.796182 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:20:29.796182 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:20:29.796182 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:20:29.796182 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:20:29.796182 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Aug 24 11:20:29.796182 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:20:29.796182 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:20:29.796182 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:20:29.796182 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:20:29.796182 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:20:29.796182 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:20:29.797278 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:20:29.797278 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:20:29.797278 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 11:20:29.797278 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 11:20:29.797278 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 11:20:29.797278 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 11:20:29.797278 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 11:20:29.797278 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 11:20:29.797278 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 11:20:29.797278 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Aug 24 11:20:29.798102 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 253/510] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Aug 24 11:20:29 2022] GET /identity/v3/users/neutron => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:20:29.798952 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9135cc0-594e-4426-a422-b67946d068ad None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:29.853265 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593a5293-be17-40cd-b020-106d09fd2fb5 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:29.888309 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef21dfb-f16c-40d7-a4c9-b44024afac78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:29.889167 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef21dfb-f16c-40d7-a4c9-b44024afac78 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:29.889875 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef21dfb-f16c-40d7-a4c9-b44024afac78 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:29.890210 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef21dfb-f16c-40d7-a4c9-b44024afac78 None admin] PATH_INFO: `/v3/domains` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:29.891161 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef21dfb-f16c-40d7-a4c9-b44024afac78 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:20:29.891526 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef21dfb-f16c-40d7-a4c9-b44024afac78 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:29.893352 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef21dfb-f16c-40d7-a4c9-b44024afac78 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:29.911133 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 258/511] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 24 11:20:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:29.911991 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef21dfb-f16c-40d7-a4c9-b44024afac78 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:29.917131 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9135cc0-594e-4426-a422-b67946d068ad None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:29.950568 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982ec710-a8bd-4c2d-b782-34bf5f6db913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:29.951169 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982ec710-a8bd-4c2d-b782-34bf5f6db913 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:29.951445 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982ec710-a8bd-4c2d-b782-34bf5f6db913 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:29.951708 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982ec710-a8bd-4c2d-b782-34bf5f6db913 None admin] PATH_INFO: `/v3/domains` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:29.952349 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982ec710-a8bd-4c2d-b782-34bf5f6db913 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:20:29.952647 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982ec710-a8bd-4c2d-b782-34bf5f6db913 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:29.954026 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982ec710-a8bd-4c2d-b782-34bf5f6db913 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:29.965795 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 254/512] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 24 11:20:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:29.966603 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982ec710-a8bd-4c2d-b782-34bf5f6db913 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:29.973119 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:30.005547 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:30.017220 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef21dfb-f16c-40d7-a4c9-b44024afac78 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:30.049693 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c9a0ea-4698-4e52-b245-b86796ef9e1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:30.050319 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c9a0ea-4698-4e52-b245-b86796ef9e1f None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:30.050743 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c9a0ea-4698-4e52-b245-b86796ef9e1f None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:30.051016 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c9a0ea-4698-4e52-b245-b86796ef9e1f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:30.061415 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c9a0ea-4698-4e52-b245-b86796ef9e1f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:30.062891 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c9a0ea-4698-4e52-b245-b86796ef9e1f None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:30.065857 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982ec710-a8bd-4c2d-b782-34bf5f6db913 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:30.077989 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-a4c9a0ea-4698-4e52-b245-b86796ef9e1f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:20:30.077989 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:20:30.077989 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:20:30.077989 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:20:30.077989 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:20:30.077989 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:20:30.077989 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:20:30.077989 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:20:30.077989 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:20:30.077989 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:20:30.077989 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:20:30.077989 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:20:30.077989 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 11:20:30.077989 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 11:20:30.077989 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 11:20:30.077989 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 11:20:30.079107 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:20:30.079107 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:20:30.079107 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:20:30.079107 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:20:30.079107 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:20:30.079107 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:20:30.079107 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:20:30.079107 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Aug 24 11:20:30.079107 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:20:30.079107 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:20:30.079107 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:20:30.079107 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:20:30.079107 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:20:30.079107 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:20:30.079107 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:20:30.079107 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:20:30.079107 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 11:20:30.085078 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 11:20:30.085078 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:20:30.085078 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:20:30.085078 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 259/513] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 11:20:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:20:30.085078 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c9a0ea-4698-4e52-b245-b86796ef9e1f None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:30.100386 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e773e887-e4fb-45ba-a716-fa97ed549f9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:30.101017 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e773e887-e4fb-45ba-a716-fa97ed549f9f None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:30.101295 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e773e887-e4fb-45ba-a716-fa97ed549f9f None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:30.101590 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e773e887-e4fb-45ba-a716-fa97ed549f9f None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:30.109514 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e773e887-e4fb-45ba-a716-fa97ed549f9f None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:30.111041 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e773e887-e4fb-45ba-a716-fa97ed549f9f None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:30.123534 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-e773e887-e4fb-45ba-a716-fa97ed549f9f None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 11:20:30.123534 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:20:30.123534 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:20:30.123534 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:20:30.123534 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:20:30.123534 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:20:30.123534 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:20:30.123534 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:20:30.123534 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:20:30.123534 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:20:30.123534 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:20:30.123534 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:20:30.123534 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 11:20:30.123534 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 11:20:30.123534 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 11:20:30.123534 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 11:20:30.124479 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:20:30.124479 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:20:30.124479 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 11:20:30.124479 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 11:20:30.124479 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 11:20:30.124479 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 11:20:30.124479 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:20:30.124479 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:20:30.124479 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:20:30.124479 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:20:30.124479 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:20:30.124479 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Aug 24 11:20:30.124479 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:20:30.124479 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:20:30.124479 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:20:30.124479 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:20:30.124479 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:20:30.124479 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:20:30.125374 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:20:30.125374 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:20:30.125374 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 11:20:30.125374 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 11:20:30.125374 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 11:20:30.125374 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 11:20:30.125374 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 11:20:30.125374 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 11:20:30.125374 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 11:20:30.125374 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Aug 24 11:20:30.125374 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 255/514] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 24 11:20:29 2022] GET /identity/v3/users/cinder => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:20:30.125374 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e773e887-e4fb-45ba-a716-fa97ed549f9f None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:30.191676 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c9a0ea-4698-4e52-b245-b86796ef9e1f None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:30.200470 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:30.226728 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:30.228444 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9974e4-62eb-45ac-8d4d-225ebd1de734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:30.229135 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9974e4-62eb-45ac-8d4d-225ebd1de734 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:30.229436 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9974e4-62eb-45ac-8d4d-225ebd1de734 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:30.229691 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9974e4-62eb-45ac-8d4d-225ebd1de734 None admin] PATH_INFO: `/v3/users` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:30.229994 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e773e887-e4fb-45ba-a716-fa97ed549f9f None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:30.230451 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9974e4-62eb-45ac-8d4d-225ebd1de734 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:20:30.230754 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9974e4-62eb-45ac-8d4d-225ebd1de734 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:30.232224 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9974e4-62eb-45ac-8d4d-225ebd1de734 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:30.268615 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f87ffe-f3bc-4725-afe4-d91fabf1c1e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:30.269390 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f87ffe-f3bc-4725-afe4-d91fabf1c1e7 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:30.269544 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 260/515] 10.222.0.27 () {56 vars in 1139 bytes} [Wed Aug 24 11:20:30 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:30.269653 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f87ffe-f3bc-4725-afe4-d91fabf1c1e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:30.269890 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f87ffe-f3bc-4725-afe4-d91fabf1c1e7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:30.270414 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9974e4-62eb-45ac-8d4d-225ebd1de734 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:30.280185 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f87ffe-f3bc-4725-afe4-d91fabf1c1e7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:30.281639 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f87ffe-f3bc-4725-afe4-d91fabf1c1e7 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:30.293985 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-29f87ffe-f3bc-4725-afe4-d91fabf1c1e7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 11:20:30.293985 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:20:30.293985 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:20:30.293985 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:20:30.293985 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:20:30.293985 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:20:30.293985 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:20:30.293985 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:20:30.293985 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:20:30.293985 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:20:30.293985 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:20:30.293985 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:20:30.293985 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 11:20:30.293985 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 11:20:30.293985 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 11:20:30.295028 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 11:20:30.295028 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:20:30.295028 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:20:30.295028 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:20:30.295028 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:20:30.295028 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:20:30.295028 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:20:30.295028 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:20:30.295028 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Aug 24 11:20:30.295028 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:20:30.295028 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:20:30.295028 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:20:30.295028 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:20:30.295028 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:20:30.295028 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:20:30.295028 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:20:30.295028 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:20:30.295895 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 11:20:30.295895 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 11:20:30.295895 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 11:20:30.295895 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 11:20:30.295895 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 11:20:30.295895 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 11:20:30.295895 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 11:20:30.295895 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Aug 24 11:20:30.295895 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 256/516] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Aug 24 11:20:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:20:30.295895 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f87ffe-f3bc-4725-afe4-d91fabf1c1e7 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:30.378367 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9974e4-62eb-45ac-8d4d-225ebd1de734 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:30.396959 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f87ffe-f3bc-4725-afe4-d91fabf1c1e7 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:30.413088 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce62cf7-c0aa-4089-a9f4-1edb39ff5042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:30.413717 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce62cf7-c0aa-4089-a9f4-1edb39ff5042 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:30.413991 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce62cf7-c0aa-4089-a9f4-1edb39ff5042 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:30.414259 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce62cf7-c0aa-4089-a9f4-1edb39ff5042 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:30.421064 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce62cf7-c0aa-4089-a9f4-1edb39ff5042 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:30.422570 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce62cf7-c0aa-4089-a9f4-1edb39ff5042 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:30.429882 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ec791e-75af-437e-b897-b2596f8279f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:30.430512 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ec791e-75af-437e-b897-b2596f8279f4 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:30.430792 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ec791e-75af-437e-b897-b2596f8279f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:30.431061 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ec791e-75af-437e-b897-b2596f8279f4 None admin] PATH_INFO: `/v3/domains` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:30.431703 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ec791e-75af-437e-b897-b2596f8279f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:20:30.432025 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ec791e-75af-437e-b897-b2596f8279f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:30.433437 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ec791e-75af-437e-b897-b2596f8279f4 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:30.433799 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-6ce62cf7-c0aa-4089-a9f4-1edb39ff5042 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 24 11:20:30.433799 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:20:30.433799 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:20:30.433799 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:20:30.433799 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:20:30.433799 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:20:30.433799 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:20:30.433799 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:20:30.433799 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:20:30.433799 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:20:30.433799 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:20:30.433799 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:20:30.433799 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 11:20:30.433799 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 11:20:30.433799 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 11:20:30.433799 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 11:20:30.434657 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:20:30.434657 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:20:30.434657 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 11:20:30.434657 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 11:20:30.434657 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 11:20:30.434657 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 11:20:30.434657 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:20:30.434657 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:20:30.434657 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:20:30.434657 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:20:30.434657 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:20:30.434657 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Aug 24 11:20:30.434657 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:20:30.434657 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:20:30.434657 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:20:30.434657 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:20:30.434657 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:20:30.434657 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:20:30.440443 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:20:30.440443 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:20:30.440443 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 11:20:30.440443 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 11:20:30.440443 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 11:20:30.440443 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 11:20:30.440443 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 11:20:30.440443 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 11:20:30.440443 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 24 11:20:30.440443 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:20:30.440443 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 261/517] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 24 11:20:30 2022] GET /identity/v3/users/glance => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:20:30.440443 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce62cf7-c0aa-4089-a9f4-1edb39ff5042 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:30.450735 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 257/518] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 24 11:20:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:30.450735 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ec791e-75af-437e-b897-b2596f8279f4 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:30.467815 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:30.469998 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:30.543358 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce62cf7-c0aa-4089-a9f4-1edb39ff5042 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:30.548778 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ec791e-75af-437e-b897-b2596f8279f4 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:30.588095 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b43b4b-0910-4b68-ac5a-af6e03ab86e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:30.588707 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b43b4b-0910-4b68-ac5a-af6e03ab86e8 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:30.588978 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b43b4b-0910-4b68-ac5a-af6e03ab86e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:30.589246 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b43b4b-0910-4b68-ac5a-af6e03ab86e8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:30.589497 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4236a360-092a-4f8b-9629-46ddb2ca550e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:30.590109 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4236a360-092a-4f8b-9629-46ddb2ca550e None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:30.590397 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4236a360-092a-4f8b-9629-46ddb2ca550e None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:30.590692 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4236a360-092a-4f8b-9629-46ddb2ca550e None admin] PATH_INFO: `/v3/users` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:30.591430 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4236a360-092a-4f8b-9629-46ddb2ca550e None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:20:30.591726 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4236a360-092a-4f8b-9629-46ddb2ca550e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:30.593275 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4236a360-092a-4f8b-9629-46ddb2ca550e None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:30.611698 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 262/519] 10.222.0.27 () {56 vars in 1137 bytes} [Wed Aug 24 11:20:30 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:30.612493 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4236a360-092a-4f8b-9629-46ddb2ca550e None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:30.663123 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b43b4b-0910-4b68-ac5a-af6e03ab86e8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:30.664592 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b43b4b-0910-4b68-ac5a-af6e03ab86e8 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:30.681993 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:30.694808 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:30.710551 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4236a360-092a-4f8b-9629-46ddb2ca550e None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:30.747766 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7028fbec-15d0-4dc6-a603-cf6f3f8c35b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:30.748369 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7028fbec-15d0-4dc6-a603-cf6f3f8c35b9 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:30.748649 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7028fbec-15d0-4dc6-a603-cf6f3f8c35b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:30.748923 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7028fbec-15d0-4dc6-a603-cf6f3f8c35b9 None admin] PATH_INFO: `/v3/projects` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:30.749619 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7028fbec-15d0-4dc6-a603-cf6f3f8c35b9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:20:30.749914 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7028fbec-15d0-4dc6-a603-cf6f3f8c35b9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:30.751404 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7028fbec-15d0-4dc6-a603-cf6f3f8c35b9 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:30.766953 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 258/520] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 24 11:20:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 11:20:30.766953 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b43b4b-0910-4b68-ac5a-af6e03ab86e8 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:30.769273 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 263/521] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Aug 24 11:20:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:30.770067 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7028fbec-15d0-4dc6-a603-cf6f3f8c35b9 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:30.861071 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b43b4b-0910-4b68-ac5a-af6e03ab86e8 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:30.868751 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7028fbec-15d0-4dc6-a603-cf6f3f8c35b9 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:30.879062 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:30.896340 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb058123-5ea3-4bd7-a131-686438516761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:30.896936 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb058123-5ea3-4bd7-a131-686438516761 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:30.897207 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb058123-5ea3-4bd7-a131-686438516761 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:30.897452 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb058123-5ea3-4bd7-a131-686438516761 None admin] PATH_INFO: `/v3/users` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:30.898169 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb058123-5ea3-4bd7-a131-686438516761 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:20:30.898500 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb058123-5ea3-4bd7-a131-686438516761 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:30.899933 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb058123-5ea3-4bd7-a131-686438516761 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:30.904517 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320246b1-0d07-458e-8628-b4603b7340a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:30.905122 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320246b1-0d07-458e-8628-b4603b7340a1 None admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:30.905399 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320246b1-0d07-458e-8628-b4603b7340a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:30.905666 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320246b1-0d07-458e-8628-b4603b7340a1 None admin] PATH_INFO: `/v3/users` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:30.906305 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320246b1-0d07-458e-8628-b4603b7340a1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:30.907773 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320246b1-0d07-458e-8628-b4603b7340a1 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:30.916975 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 259/522] 10.222.0.27 () {56 vars in 1137 bytes} [Wed Aug 24 11:20:30 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:30.918915 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb058123-5ea3-4bd7-a131-686438516761 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:30.925886 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:30.930377 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 264/523] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Aug 24 11:20:30 2022] POST /identity/v3/users => generated 247 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:20:30.931483 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320246b1-0d07-458e-8628-b4603b7340a1 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:31.040238 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb058123-5ea3-4bd7-a131-686438516761 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:31.045613 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320246b1-0d07-458e-8628-b4603b7340a1 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:31.080774 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30e5319-d1ef-42cf-b196-d972404a8aa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:31.081383 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30e5319-d1ef-42cf-b196-d972404a8aa3 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:31.081684 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30e5319-d1ef-42cf-b196-d972404a8aa3 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:31.081954 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30e5319-d1ef-42cf-b196-d972404a8aa3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:31.085048 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3618b6b0-c6ae-4d87-89a2-0527ed6ea054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:31.086601 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3618b6b0-c6ae-4d87-89a2-0527ed6ea054 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:31.086884 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3618b6b0-c6ae-4d87-89a2-0527ed6ea054 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:31.087154 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3618b6b0-c6ae-4d87-89a2-0527ed6ea054 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:31.100245 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3618b6b0-c6ae-4d87-89a2-0527ed6ea054 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:31.101733 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3618b6b0-c6ae-4d87-89a2-0527ed6ea054 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:31.119537 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-3618b6b0-c6ae-4d87-89a2-0527ed6ea054 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:20:31.119537 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:20:31.119537 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:20:31.119537 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:20:31.119537 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:20:31.119537 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:20:31.119537 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:20:31.119537 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:20:31.119537 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:20:31.119537 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:20:31.119537 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:20:31.119537 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:20:31.119537 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 11:20:31.119537 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 11:20:31.119537 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 11:20:31.119537 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 11:20:31.120576 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:20:31.120576 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:20:31.120576 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:20:31.120576 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:20:31.120576 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:20:31.120576 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:20:31.120576 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:20:31.120576 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Aug 24 11:20:31.120576 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:20:31.120576 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:20:31.120576 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:20:31.120576 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:20:31.120576 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:20:31.120576 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:20:31.120576 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:20:31.120576 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:20:31.120576 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 11:20:31.121416 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 11:20:31.121416 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:20:31.121416 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:20:31.121416 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 265/524] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 11:20:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:20:31.121416 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3618b6b0-c6ae-4d87-89a2-0527ed6ea054 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:31.133547 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:31.158367 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30e5319-d1ef-42cf-b196-d972404a8aa3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:31.159906 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30e5319-d1ef-42cf-b196-d972404a8aa3 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:31.183757 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:31.236685 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3618b6b0-c6ae-4d87-89a2-0527ed6ea054 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:31.262333 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 260/525] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 24 11:20:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 11:20:31.263024 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30e5319-d1ef-42cf-b196-d972404a8aa3 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:31.276208 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66587746-6779-4c32-ab4f-9d17f102c299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:31.277136 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66587746-6779-4c32-ab4f-9d17f102c299 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:31.277441 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66587746-6779-4c32-ab4f-9d17f102c299 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:31.277714 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66587746-6779-4c32-ab4f-9d17f102c299 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:31.278527 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66587746-6779-4c32-ab4f-9d17f102c299 None admin] RBAC: Adding query filter params (role.id=217baac59e08499ea2f1b1d84935df0b, scope.project.id=317f54a463cb48ab86648c6dcec5db0f, user.id=282ec32864d046b2bea170f6a3845cc0) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:20:31.278837 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66587746-6779-4c32-ab4f-9d17f102c299 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:31.280298 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66587746-6779-4c32-ab4f-9d17f102c299 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:31.286265 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 266/526] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Aug 24 11:20:31 2022] GET /identity/v3/role_assignments?user.id=282ec32864d046b2bea170f6a3845cc0&scope.project.id=317f54a463cb48ab86648c6dcec5db0f&role.id=217baac59e08499ea2f1b1d84935df0b => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:31.287352 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66587746-6779-4c32-ab4f-9d17f102c299 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:31.378164 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:31.409714 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66587746-6779-4c32-ab4f-9d17f102c299 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:31.413912 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30e5319-d1ef-42cf-b196-d972404a8aa3 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:31.441201 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:31.460226 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30ce448-9404-4726-9f29-59a9a35d7ab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:31.460970 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb0de2d-8422-43bc-afc7-f4deed2bdf3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:31.461373 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30ce448-9404-4726-9f29-59a9a35d7ab3 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:31.461581 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb0de2d-8422-43bc-afc7-f4deed2bdf3d None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:31.461861 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb0de2d-8422-43bc-afc7-f4deed2bdf3d None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:31.462132 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb0de2d-8422-43bc-afc7-f4deed2bdf3d None admin] PATH_INFO: `/v3/domains` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:31.462468 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30ce448-9404-4726-9f29-59a9a35d7ab3 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:31.462830 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb0de2d-8422-43bc-afc7-f4deed2bdf3d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:20:31.463078 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30ce448-9404-4726-9f29-59a9a35d7ab3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:31.463175 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb0de2d-8422-43bc-afc7-f4deed2bdf3d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:31.464514 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb0de2d-8422-43bc-afc7-f4deed2bdf3d None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:31.481682 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 267/527] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 24 11:20:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:31.482757 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb0de2d-8422-43bc-afc7-f4deed2bdf3d None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:31.553395 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30ce448-9404-4726-9f29-59a9a35d7ab3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:31.554919 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30ce448-9404-4726-9f29-59a9a35d7ab3 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:31.607684 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb0de2d-8422-43bc-afc7-f4deed2bdf3d None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:31.635766 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:31.655947 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb584666-d25a-4720-95ab-ba3243a6ca7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:31.656934 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb584666-d25a-4720-95ab-ba3243a6ca7a None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:31.657630 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb584666-d25a-4720-95ab-ba3243a6ca7a None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:31.658085 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb584666-d25a-4720-95ab-ba3243a6ca7a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:31.662568 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 261/528] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 24 11:20:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 11:20:31.663585 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30ce448-9404-4726-9f29-59a9a35d7ab3 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:31.674876 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb584666-d25a-4720-95ab-ba3243a6ca7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:31.677511 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb584666-d25a-4720-95ab-ba3243a6ca7a None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:31.698209 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-bb584666-d25a-4720-95ab-ba3243a6ca7a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:20:31.698209 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:20:31.698209 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:20:31.698209 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:20:31.698209 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:20:31.698209 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:20:31.698209 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:20:31.698209 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:20:31.698209 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:20:31.698209 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:20:31.698209 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:20:31.698209 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:20:31.698209 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 11:20:31.698209 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 11:20:31.698209 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 11:20:31.698209 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 11:20:31.699212 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:20:31.699212 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:20:31.699212 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:20:31.699212 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:20:31.699212 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:20:31.699212 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:20:31.699212 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:20:31.699212 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Aug 24 11:20:31.699212 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:20:31.699212 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:20:31.699212 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:20:31.699212 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:20:31.699212 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:20:31.699212 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:20:31.699212 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:20:31.699212 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:20:31.699212 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 11:20:31.700082 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 11:20:31.700082 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:20:31.700082 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:20:31.702296 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 268/529] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 11:20:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:20:31.703324 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb584666-d25a-4720-95ab-ba3243a6ca7a None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:31.741572 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:31.776150 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30ce448-9404-4726-9f29-59a9a35d7ab3 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:31.814164 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afe3a71-a790-4014-a411-834ee2374e29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:31.814742 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afe3a71-a790-4014-a411-834ee2374e29 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:31.815021 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afe3a71-a790-4014-a411-834ee2374e29 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:31.815326 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afe3a71-a790-4014-a411-834ee2374e29 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:31.822660 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afe3a71-a790-4014-a411-834ee2374e29 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:31.824176 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afe3a71-a790-4014-a411-834ee2374e29 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:31.836167 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb584666-d25a-4720-95ab-ba3243a6ca7a None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:31.836413 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-1afe3a71-a790-4014-a411-834ee2374e29 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 11:20:31.836413 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:20:31.836413 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:20:31.836413 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:20:31.836413 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:20:31.836413 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:20:31.836413 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:20:31.836413 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:20:31.836413 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:20:31.836413 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:20:31.836413 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:20:31.836413 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:20:31.836413 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 11:20:31.836413 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 11:20:31.836413 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 11:20:31.837241 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 11:20:31.837241 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:20:31.837241 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:20:31.837241 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:20:31.837241 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:20:31.837241 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:20:31.837241 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:20:31.837241 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:20:31.837241 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Aug 24 11:20:31.837241 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:20:31.837241 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:20:31.837241 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:20:31.837241 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:20:31.837241 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:20:31.837241 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:20:31.837241 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:20:31.837241 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:20:31.838098 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 11:20:31.838098 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 11:20:31.838098 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 11:20:31.838098 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 11:20:31.838098 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 11:20:31.838098 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 11:20:31.838098 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 11:20:31.838098 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Aug 24 11:20:31.838098 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 262/530] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Aug 24 11:20:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:20:31.839030 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afe3a71-a790-4014-a411-834ee2374e29 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:31.876908 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:31.888721 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd54992-f257-4e3b-b5e0-377658e5a8cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:31.889358 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd54992-f257-4e3b-b5e0-377658e5a8cf None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:31.889630 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd54992-f257-4e3b-b5e0-377658e5a8cf None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:31.889893 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd54992-f257-4e3b-b5e0-377658e5a8cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:31.902212 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd54992-f257-4e3b-b5e0-377658e5a8cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:31.903742 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd54992-f257-4e3b-b5e0-377658e5a8cf None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:31.922776 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-fbd54992-f257-4e3b-b5e0-377658e5a8cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:20:31.922776 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:20:31.922776 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:20:31.922776 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:20:31.922776 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:20:31.922776 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:20:31.922776 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:20:31.922776 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:20:31.922776 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:20:31.922776 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:20:31.922776 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:20:31.922776 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:20:31.922776 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 11:20:31.922776 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 11:20:31.922776 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 11:20:31.922776 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 11:20:31.923739 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:20:31.923739 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:20:31.923739 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:20:31.923739 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:20:31.923739 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:20:31.923739 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:20:31.923739 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:20:31.923739 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Aug 24 11:20:31.923739 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:20:31.923739 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:20:31.923739 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:20:31.923739 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:20:31.923739 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:20:31.923739 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:20:31.923739 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:20:31.923739 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:20:31.923739 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 11:20:31.924599 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 11:20:31.924599 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:20:31.924599 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:20:31.927217 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 269/531] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 11:20:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:20:31.928696 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd54992-f257-4e3b-b5e0-377658e5a8cf None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:31.957817 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afe3a71-a790-4014-a411-834ee2374e29 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:31.995588 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7120246-3152-475c-b0ef-c272e8c78a86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:31.996445 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7120246-3152-475c-b0ef-c272e8c78a86 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:31.996820 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7120246-3152-475c-b0ef-c272e8c78a86 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:31.997182 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7120246-3152-475c-b0ef-c272e8c78a86 None admin] PATH_INFO: `/v3/domains` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:31.997928 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7120246-3152-475c-b0ef-c272e8c78a86 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:20:31.998322 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7120246-3152-475c-b0ef-c272e8c78a86 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:32.000091 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7120246-3152-475c-b0ef-c272e8c78a86 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:32.012650 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 263/532] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 24 11:20:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:32.014810 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7120246-3152-475c-b0ef-c272e8c78a86 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:32.027382 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:32.056252 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd54992-f257-4e3b-b5e0-377658e5a8cf None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:32.099375 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de5c5b2-9d68-45bb-b8a5-f94198e364c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:32.100211 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de5c5b2-9d68-45bb-b8a5-f94198e364c4 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:32.100650 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de5c5b2-9d68-45bb-b8a5-f94198e364c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:32.101092 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de5c5b2-9d68-45bb-b8a5-f94198e364c4 None admin] PATH_INFO: `/v3/projects` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:32.101970 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de5c5b2-9d68-45bb-b8a5-f94198e364c4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:20:32.102912 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de5c5b2-9d68-45bb-b8a5-f94198e364c4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:32.105041 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de5c5b2-9d68-45bb-b8a5-f94198e364c4 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:32.121914 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 270/533] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Aug 24 11:20:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:32.123250 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de5c5b2-9d68-45bb-b8a5-f94198e364c4 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:32.123616 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:32.132091 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7120246-3152-475c-b0ef-c272e8c78a86 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:32.173422 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d363a1-f7aa-4cd8-b4eb-c450c730a123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:32.174226 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d363a1-f7aa-4cd8-b4eb-c450c730a123 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:32.174621 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d363a1-f7aa-4cd8-b4eb-c450c730a123 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:32.174986 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d363a1-f7aa-4cd8-b4eb-c450c730a123 None admin] PATH_INFO: `/v3/domains` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:32.175791 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d363a1-f7aa-4cd8-b4eb-c450c730a123 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:20:32.176184 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d363a1-f7aa-4cd8-b4eb-c450c730a123 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:32.177873 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d363a1-f7aa-4cd8-b4eb-c450c730a123 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:32.191400 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 264/534] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 24 11:20:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:32.192726 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d363a1-f7aa-4cd8-b4eb-c450c730a123 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:32.255520 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de5c5b2-9d68-45bb-b8a5-f94198e364c4 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:32.302273 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53cb30b-3524-4341-a569-43ce539ab742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:32.303277 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53cb30b-3524-4341-a569-43ce539ab742 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:32.303942 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53cb30b-3524-4341-a569-43ce539ab742 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:32.304383 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53cb30b-3524-4341-a569-43ce539ab742 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:32.307978 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d363a1-f7aa-4cd8-b4eb-c450c730a123 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:32.313769 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53cb30b-3524-4341-a569-43ce539ab742 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:32.315465 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53cb30b-3524-4341-a569-43ce539ab742 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:32.319519 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:32.333139 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-f53cb30b-3524-4341-a569-43ce539ab742 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 11:20:32.333139 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:20:32.333139 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:20:32.333139 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:20:32.333139 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:20:32.333139 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:20:32.333139 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:20:32.333139 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:20:32.333139 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:20:32.333139 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:20:32.333139 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:20:32.333139 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:20:32.333139 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 11:20:32.333139 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 11:20:32.333139 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 11:20:32.334202 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 11:20:32.334202 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:20:32.334202 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:20:32.334202 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:20:32.334202 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:20:32.334202 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:20:32.334202 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:20:32.334202 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:20:32.334202 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Aug 24 11:20:32.334202 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:20:32.334202 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:20:32.334202 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:20:32.334202 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:20:32.334202 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:20:32.334202 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:20:32.334202 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:20:32.334202 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:20:32.335283 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 11:20:32.335283 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 11:20:32.335283 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 11:20:32.335283 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 11:20:32.335283 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 11:20:32.335283 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 11:20:32.335283 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 11:20:32.335283 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:20:32.342574 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 271/535] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Aug 24 11:20:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:20:32.342574 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53cb30b-3524-4341-a569-43ce539ab742 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:32.355344 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c48672-5930-4c58-9bdf-d0498dd96b09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:32.356570 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c48672-5930-4c58-9bdf-d0498dd96b09 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:32.357049 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c48672-5930-4c58-9bdf-d0498dd96b09 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:32.357680 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c48672-5930-4c58-9bdf-d0498dd96b09 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:32.359144 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c48672-5930-4c58-9bdf-d0498dd96b09 None admin] RBAC: Adding query filter params (role.id=217baac59e08499ea2f1b1d84935df0b, scope.project.id=317f54a463cb48ab86648c6dcec5db0f, user.id=e2d061d25d83443c9232218c90792d51) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:20:32.359978 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c48672-5930-4c58-9bdf-d0498dd96b09 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:32.361921 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c48672-5930-4c58-9bdf-d0498dd96b09 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:32.371664 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 265/536] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Aug 24 11:20:32 2022] GET /identity/v3/role_assignments?user.id=e2d061d25d83443c9232218c90792d51&scope.project.id=317f54a463cb48ab86648c6dcec5db0f&role.id=217baac59e08499ea2f1b1d84935df0b => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:32.373139 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c48672-5930-4c58-9bdf-d0498dd96b09 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:32.405703 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:32.455893 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53cb30b-3524-4341-a569-43ce539ab742 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:32.521143 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97800827-007a-4e18-b432-54f878da0ad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:32.521730 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97800827-007a-4e18-b432-54f878da0ad2 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:32.522016 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97800827-007a-4e18-b432-54f878da0ad2 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:32.522299 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97800827-007a-4e18-b432-54f878da0ad2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:32.540337 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97800827-007a-4e18-b432-54f878da0ad2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:32.541840 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97800827-007a-4e18-b432-54f878da0ad2 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:32.544259 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c48672-5930-4c58-9bdf-d0498dd96b09 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:32.571541 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-97800827-007a-4e18-b432-54f878da0ad2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 11:20:32.571541 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:20:32.571541 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:20:32.571541 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:20:32.571541 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:20:32.571541 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:20:32.571541 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:20:32.571541 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:20:32.571541 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:20:32.571541 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:20:32.571541 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:20:32.571541 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:20:32.571541 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 11:20:32.571541 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 11:20:32.571541 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 11:20:32.572440 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 11:20:32.572440 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:20:32.572440 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:20:32.572440 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:20:32.572440 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:20:32.572440 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:20:32.572440 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:20:32.572440 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:20:32.572440 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Aug 24 11:20:32.572440 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:20:32.572440 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:20:32.572440 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:20:32.572440 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:20:32.572440 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:20:32.572440 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:20:32.572440 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:20:32.572440 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:20:32.573276 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 11:20:32.573276 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 11:20:32.573276 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 11:20:32.573276 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 11:20:32.573276 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 11:20:32.573276 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 11:20:32.573276 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 11:20:32.573276 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:20:32.575501 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 272/537] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Aug 24 11:20:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:20:32.578632 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97800827-007a-4e18-b432-54f878da0ad2 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:32.616404 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbd48f1-f1d7-4647-899a-bc612ed07f89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:32.617365 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbd48f1-f1d7-4647-899a-bc612ed07f89 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:32.618686 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbd48f1-f1d7-4647-899a-bc612ed07f89 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:32.619153 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbd48f1-f1d7-4647-899a-bc612ed07f89 None admin] PATH_INFO: `/v3/projects` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:32.621213 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbd48f1-f1d7-4647-899a-bc612ed07f89 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:20:32.621725 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbd48f1-f1d7-4647-899a-bc612ed07f89 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:32.623776 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbd48f1-f1d7-4647-899a-bc612ed07f89 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:32.671272 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 266/538] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Aug 24 11:20:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:32.683832 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbd48f1-f1d7-4647-899a-bc612ed07f89 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:32.735406 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:32.760963 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97800827-007a-4e18-b432-54f878da0ad2 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:32.797481 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5520f90f-8cc8-403c-be06-1c8ee8e5d5f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:32.798470 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5520f90f-8cc8-403c-be06-1c8ee8e5d5f8 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:32.798952 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5520f90f-8cc8-403c-be06-1c8ee8e5d5f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:32.799442 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5520f90f-8cc8-403c-be06-1c8ee8e5d5f8 None admin] PATH_INFO: `/v3/projects` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:32.800336 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5520f90f-8cc8-403c-be06-1c8ee8e5d5f8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:20:32.800899 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5520f90f-8cc8-403c-be06-1c8ee8e5d5f8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:32.802753 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5520f90f-8cc8-403c-be06-1c8ee8e5d5f8 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:32.817740 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 273/539] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Aug 24 11:20:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:32.823242 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5520f90f-8cc8-403c-be06-1c8ee8e5d5f8 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:32.876238 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:32.907840 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbd48f1-f1d7-4647-899a-bc612ed07f89 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:32.929415 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5520f90f-8cc8-403c-be06-1c8ee8e5d5f8 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:32.955343 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:32.964723 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e6246e-385b-488a-8efc-ad64be52b2fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:32.965353 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e6246e-385b-488a-8efc-ad64be52b2fc None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:32.965594 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e6246e-385b-488a-8efc-ad64be52b2fc None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:32.965885 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e6246e-385b-488a-8efc-ad64be52b2fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:32.966737 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e6246e-385b-488a-8efc-ad64be52b2fc None admin] RBAC: Adding query filter params (role.id=217baac59e08499ea2f1b1d84935df0b, scope.project.id=317f54a463cb48ab86648c6dcec5db0f, user.id=92862b76ba3b4513b5dc5b5c962faac9) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:20:32.967043 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e6246e-385b-488a-8efc-ad64be52b2fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:32.968588 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e6246e-385b-488a-8efc-ad64be52b2fc None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:32.972639 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c2d474-1b9c-40d0-aa27-cb3cc94444b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:32.973578 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c2d474-1b9c-40d0-aa27-cb3cc94444b1 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:32.974047 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c2d474-1b9c-40d0-aa27-cb3cc94444b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:32.977732 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 267/540] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Aug 24 11:20:32 2022] GET /identity/v3/role_assignments?user.id=92862b76ba3b4513b5dc5b5c962faac9&scope.project.id=317f54a463cb48ab86648c6dcec5db0f&role.id=217baac59e08499ea2f1b1d84935df0b => generated 259 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:32.977732 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b558ff4-683b-4fba-b1d0-9f5450578e23 None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:32.977732 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b558ff4-683b-4fba-b1d0-9f5450578e23 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:32.977732 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b558ff4-683b-4fba-b1d0-9f5450578e23 None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:32.977732 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 268/541] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:20:32 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:20:32.978713 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c2d474-1b9c-40d0-aa27-cb3cc94444b1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:32.979659 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c2d474-1b9c-40d0-aa27-cb3cc94444b1 None admin] RBAC: Adding query filter params (role.id=217baac59e08499ea2f1b1d84935df0b, scope.project.id=317f54a463cb48ab86648c6dcec5db0f, user.id=abffba24649e49d28a01cbee51924ce6) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:20:32.980096 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c2d474-1b9c-40d0-aa27-cb3cc94444b1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:32.981705 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c2d474-1b9c-40d0-aa27-cb3cc94444b1 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:32.989185 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 274/542] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Aug 24 11:20:32 2022] GET /identity/v3/role_assignments?user.id=abffba24649e49d28a01cbee51924ce6&scope.project.id=317f54a463cb48ab86648c6dcec5db0f&role.id=217baac59e08499ea2f1b1d84935df0b => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:33.006532 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7678c1-ea3f-4e26-88a0-9d52ea412bcc None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:33.006946 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7678c1-ea3f-4e26-88a0-9d52ea412bcc None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:33.007304 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7678c1-ea3f-4e26-88a0-9d52ea412bcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:33.039730 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-ad7678c1-ea3f-4e26-88a0-9d52ea412bcc None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:20:33.040990 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-ad7678c1-ea3f-4e26-88a0-9d52ea412bcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:20:33.157065 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 269/543] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:20:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 11:20:33.301503 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aec63e4-69c0-4074-943c-9df89fc10a12 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:33.302195 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aec63e4-69c0-4074-943c-9df89fc10a12 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:33.302691 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aec63e4-69c0-4074-943c-9df89fc10a12 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:33.304564 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 275/544] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:20:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:20:33.310775 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e21094-597c-40f3-9a78-dbb6a05cb6bf None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:33.311316 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e21094-597c-40f3-9a78-dbb6a05cb6bf None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:33.311814 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e21094-597c-40f3-9a78-dbb6a05cb6bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:33.335651 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-c3e21094-597c-40f3-9a78-dbb6a05cb6bf None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:20:33.337140 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-c3e21094-597c-40f3-9a78-dbb6a05cb6bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:20:33.428192 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 270/545] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:20:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 11:20:33.532063 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aec63e4-69c0-4074-943c-9df89fc10a12 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:33.667250 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aec63e4-69c0-4074-943c-9df89fc10a12 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:33.711299 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cffaf3-235c-4267-a966-b64e288b66c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:33.711847 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cffaf3-235c-4267-a966-b64e288b66c3 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:33.712124 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cffaf3-235c-4267-a966-b64e288b66c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:33.712391 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cffaf3-235c-4267-a966-b64e288b66c3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:33.722835 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cffaf3-235c-4267-a966-b64e288b66c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:20:33.732890 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-55cffaf3-235c-4267-a966-b64e288b66c3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 11:20:33.732890 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:20:33.732890 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:20:33.732890 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:20:33.732890 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:20:33.732890 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:20:33.732890 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:20:33.732890 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:20:33.732890 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:20:33.732890 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:20:33.732890 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:20:33.732890 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:20:33.732890 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:20:33.732890 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:20:33.732890 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:20:33.732890 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:20:33.733744 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:20:33.733744 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:20:33.733744 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:20:33.733744 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:20:33.733744 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:20:33.733744 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:20:33.733744 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:20:33.733744 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:20:33.733744 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:20:33.733744 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:20:33.733744 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:20:33.733744 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Aug 24 11:20:33.733744 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:20:33.733744 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:20:33.733744 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:20:33.733744 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:20:33.734571 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:20:33.734571 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:20:33.734571 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:20:33.734571 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:20:33.734571 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:20:33.734571 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:20:33.734571 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:20:33.734571 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:20:33.734571 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:20:33.734571 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:20:33.734571 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 11:20:33.734571 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:20:33.734571 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 276/546] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Aug 24 11:20:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:20:33.741564 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e21094-597c-40f3-9a78-dbb6a05cb6bf None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:33.745132 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:33.817498 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cffaf3-235c-4267-a966-b64e288b66c3 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:33.868807 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e21094-597c-40f3-9a78-dbb6a05cb6bf None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:33.906116 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0cd360-b5cc-465a-9a34-93ad9df45a3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:33.907209 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0cd360-b5cc-465a-9a34-93ad9df45a3f None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:33.907486 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0cd360-b5cc-465a-9a34-93ad9df45a3f None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:33.907755 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0cd360-b5cc-465a-9a34-93ad9df45a3f None admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:33.908424 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0cd360-b5cc-465a-9a34-93ad9df45a3f None admin] RBAC: Adding query filter params (name=service) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:20:33.908727 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0cd360-b5cc-465a-9a34-93ad9df45a3f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:33.910211 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0cd360-b5cc-465a-9a34-93ad9df45a3f None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:33.919493 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 271/547] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Aug 24 11:20:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:33.920394 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:33.926233 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0cd360-b5cc-465a-9a34-93ad9df45a3f None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:34.011464 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:34.061299 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0cd360-b5cc-465a-9a34-93ad9df45a3f None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:34.074249 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cffaf3-235c-4267-a966-b64e288b66c3 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:34.125820 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0c5546-9dca-40cc-98be-505fe7c0e478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:34.126503 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0c5546-9dca-40cc-98be-505fe7c0e478 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:34.126774 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0c5546-9dca-40cc-98be-505fe7c0e478 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:34.127040 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0c5546-9dca-40cc-98be-505fe7c0e478 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:34.139295 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1aaaae-f114-4743-be70-6e6463bc4b75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:34.139948 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1aaaae-f114-4743-be70-6e6463bc4b75 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:34.140224 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1aaaae-f114-4743-be70-6e6463bc4b75 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:34.140491 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1aaaae-f114-4743-be70-6e6463bc4b75 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:34.150620 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0c5546-9dca-40cc-98be-505fe7c0e478 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:34.152488 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0c5546-9dca-40cc-98be-505fe7c0e478 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:34.160837 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1aaaae-f114-4743-be70-6e6463bc4b75 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:20:34.166073 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-5d1aaaae-f114-4743-be70-6e6463bc4b75 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 11:20:34.166073 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:20:34.166073 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:20:34.166073 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:20:34.166073 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:20:34.166073 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:20:34.166073 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:20:34.166073 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:20:34.166073 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:20:34.166073 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:20:34.166073 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:20:34.166073 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:20:34.166073 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:20:34.166073 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:20:34.166073 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:20:34.166073 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:20:34.166996 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:20:34.166996 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:20:34.166996 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:20:34.166996 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:20:34.166996 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:20:34.166996 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:20:34.166996 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:20:34.166996 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:20:34.166996 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:20:34.166996 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:20:34.166996 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:20:34.166996 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Aug 24 11:20:34.166996 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:20:34.166996 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:20:34.166996 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:20:34.166996 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:20:34.167780 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:20:34.167780 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:20:34.167780 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:20:34.167780 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:20:34.167780 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:20:34.167780 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:20:34.167780 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:20:34.167780 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:20:34.167780 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:20:34.167780 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:20:34.167780 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 11:20:34.167780 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:20:34.167780 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 277/548] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Aug 24 11:20:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 350 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 11:20:34.175412 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1aaaae-f114-4743-be70-6e6463bc4b75 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:34.181069 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-ef0c5546-9dca-40cc-98be-505fe7c0e478 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:20:34.181069 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:20:34.181069 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:20:34.181069 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:20:34.181069 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:20:34.181069 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:20:34.181069 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:20:34.181069 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:20:34.181069 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:20:34.181069 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:20:34.181069 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:20:34.181069 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:20:34.181069 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 11:20:34.181069 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 11:20:34.181069 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 11:20:34.181069 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 11:20:34.181946 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:20:34.181946 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:20:34.181946 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:20:34.181946 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:20:34.181946 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:20:34.181946 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:20:34.181946 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:20:34.181946 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Aug 24 11:20:34.181946 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:20:34.181946 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:20:34.181946 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:20:34.181946 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:20:34.181946 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:20:34.181946 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:20:34.181946 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:20:34.181946 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:20:34.181946 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 11:20:34.183479 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 11:20:34.183479 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:20:34.183479 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Aug 24 11:20:34.185415 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 272/549] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 11:20:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:20:34.191330 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0c5546-9dca-40cc-98be-505fe7c0e478 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:34.350503 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1aaaae-f114-4743-be70-6e6463bc4b75 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:34.352790 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0c5546-9dca-40cc-98be-505fe7c0e478 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:34.357411 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:34.384901 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:34.416993 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a41cf10-e63b-429c-9b19-3f11bf37887b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:34.417601 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a41cf10-e63b-429c-9b19-3f11bf37887b None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:34.417867 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a41cf10-e63b-429c-9b19-3f11bf37887b None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:34.418450 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a41cf10-e63b-429c-9b19-3f11bf37887b None admin] PATH_INFO: `/v3/domains` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:34.419100 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a41cf10-e63b-429c-9b19-3f11bf37887b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:20:34.419396 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a41cf10-e63b-429c-9b19-3f11bf37887b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:34.420779 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a41cf10-e63b-429c-9b19-3f11bf37887b None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:34.422867 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82b90aa-2930-4e9e-9e5b-42f72ffb3a58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:34.423470 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82b90aa-2930-4e9e-9e5b-42f72ffb3a58 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:34.423737 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82b90aa-2930-4e9e-9e5b-42f72ffb3a58 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:34.424002 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82b90aa-2930-4e9e-9e5b-42f72ffb3a58 None admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:34.424658 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82b90aa-2930-4e9e-9e5b-42f72ffb3a58 None admin] RBAC: Adding query filter params (name=service) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:20:34.424949 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82b90aa-2930-4e9e-9e5b-42f72ffb3a58 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:34.426516 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82b90aa-2930-4e9e-9e5b-42f72ffb3a58 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:34.444360 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 278/550] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Aug 24 11:20:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:34.446052 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 273/551] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 24 11:20:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:20:34.448978 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82b90aa-2930-4e9e-9e5b-42f72ffb3a58 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:34.451273 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a41cf10-e63b-429c-9b19-3f11bf37887b None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:34.603878 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82b90aa-2930-4e9e-9e5b-42f72ffb3a58 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:34.625833 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a41cf10-e63b-429c-9b19-3f11bf37887b None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:34.638773 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ce5b7a-880d-4e49-a404-d024796fa368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:34.639473 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ce5b7a-880d-4e49-a404-d024796fa368 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:34.639817 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ce5b7a-880d-4e49-a404-d024796fa368 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:34.640093 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ce5b7a-880d-4e49-a404-d024796fa368 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:34.651215 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ce5b7a-880d-4e49-a404-d024796fa368 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:34.653053 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ce5b7a-880d-4e49-a404-d024796fa368 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:34.667609 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-23ce5b7a-880d-4e49-a404-d024796fa368 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:20:34.667609 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:20:34.667609 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:20:34.667609 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:20:34.667609 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:20:34.667609 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:20:34.667609 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:20:34.667609 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:20:34.667609 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:20:34.667609 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:20:34.667609 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:20:34.667609 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:20:34.667609 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 11:20:34.667609 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 11:20:34.667609 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 11:20:34.667609 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 11:20:34.668652 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:20:34.668652 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:20:34.668652 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:20:34.668652 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:20:34.668652 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:20:34.668652 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:20:34.668652 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:20:34.668652 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Aug 24 11:20:34.668652 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:20:34.668652 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:20:34.668652 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:20:34.668652 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:20:34.668652 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:20:34.668652 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:20:34.668652 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:20:34.668652 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:20:34.668652 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 11:20:34.669628 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 11:20:34.669628 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:20:34.669628 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:20:34.672077 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a971173-4265-49eb-8e6b-a0c1ce5b0c7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:34.672953 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a971173-4265-49eb-8e6b-a0c1ce5b0c7e None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:34.673487 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a971173-4265-49eb-8e6b-a0c1ce5b0c7e None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:34.673655 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 279/552] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 11:20:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:20:34.674118 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a971173-4265-49eb-8e6b-a0c1ce5b0c7e None admin] PATH_INFO: `/v3/users/swift` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:34.674961 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4058e5c-1483-4755-baf1-f557084df523 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:34.675294 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4058e5c-1483-4755-baf1-f557084df523 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:34.675620 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4058e5c-1483-4755-baf1-f557084df523 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:34.677126 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 280/553] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:20:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:20:34.681369 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4058e5c-1483-4755-baf1-f557084df523 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:34.688845 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a971173-4265-49eb-8e6b-a0c1ce5b0c7e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:34.690583 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a971173-4265-49eb-8e6b-a0c1ce5b0c7e None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:34.700092 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:34.708807 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-2a971173-4265-49eb-8e6b-a0c1ce5b0c7e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 11:20:34.708807 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:20:34.708807 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:20:34.708807 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:20:34.708807 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:20:34.708807 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:20:34.708807 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:20:34.708807 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:20:34.708807 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:20:34.708807 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:20:34.708807 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:20:34.708807 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:20:34.708807 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 11:20:34.708807 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 11:20:34.708807 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 11:20:34.708807 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 11:20:34.709791 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:20:34.709791 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:20:34.709791 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 11:20:34.709791 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 11:20:34.709791 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 11:20:34.709791 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 11:20:34.709791 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:20:34.709791 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:20:34.709791 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:20:34.709791 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:20:34.709791 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:20:34.709791 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Aug 24 11:20:34.709791 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:20:34.709791 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:20:34.709791 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:20:34.709791 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:20:34.709791 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:20:34.709791 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:20:34.710779 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:20:34.710779 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:20:34.710779 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 11:20:34.710779 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 11:20:34.710779 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 11:20:34.710779 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 11:20:34.710779 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 11:20:34.710779 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 11:20:34.710779 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 11:20:34.710779 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Aug 24 11:20:34.711382 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 274/554] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Aug 24 11:20:34 2022] GET /identity/v3/users/swift => generated 83 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 11:20:34.712494 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45894f00-54a2-4992-93a4-220060a139b5 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:34.713528 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45894f00-54a2-4992-93a4-220060a139b5 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:34.714898 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45894f00-54a2-4992-93a4-220060a139b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:34.738072 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-45894f00-54a2-4992-93a4-220060a139b5 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:20:34.740279 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-45894f00-54a2-4992-93a4-220060a139b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:20:34.783861 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:34.813548 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4058e5c-1483-4755-baf1-f557084df523 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:34.834381 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 275/555] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:20:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 11:20:34.834381 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45894f00-54a2-4992-93a4-220060a139b5 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:34.879229 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bcc41d-c2ab-41cc-9828-70ebb2e94895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:34.879753 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bcc41d-c2ab-41cc-9828-70ebb2e94895 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:34.880241 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bcc41d-c2ab-41cc-9828-70ebb2e94895 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:34.880511 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bcc41d-c2ab-41cc-9828-70ebb2e94895 None admin] PATH_INFO: `/v3/domains` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:34.881977 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bcc41d-c2ab-41cc-9828-70ebb2e94895 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:20:34.882281 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bcc41d-c2ab-41cc-9828-70ebb2e94895 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:34.883714 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bcc41d-c2ab-41cc-9828-70ebb2e94895 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:34.911347 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 281/556] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 24 11:20:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:34.916775 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bcc41d-c2ab-41cc-9828-70ebb2e94895 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:34.982504 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45894f00-54a2-4992-93a4-220060a139b5 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:35.022981 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0fbc9d-3aa9-442b-859e-33049f30440e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:35.026011 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0fbc9d-3aa9-442b-859e-33049f30440e None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:35.028579 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0fbc9d-3aa9-442b-859e-33049f30440e None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:35.029142 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0fbc9d-3aa9-442b-859e-33049f30440e None admin] PATH_INFO: `/v3/users` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:35.030216 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0fbc9d-3aa9-442b-859e-33049f30440e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:20:35.031597 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0fbc9d-3aa9-442b-859e-33049f30440e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:35.033913 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0fbc9d-3aa9-442b-859e-33049f30440e None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:35.062306 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 276/557] 10.222.0.27 () {56 vars in 1135 bytes} [Wed Aug 24 11:20:34 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:35.063929 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01c6ccb-16e2-4f10-9497-0f73665230bc None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:35.064403 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01c6ccb-16e2-4f10-9497-0f73665230bc None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:35.064896 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01c6ccb-16e2-4f10-9497-0f73665230bc None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:35.066629 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 277/558] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:20:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:20:35.070631 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:35.072482 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01c6ccb-16e2-4f10-9497-0f73665230bc None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:35.108299 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bcc41d-c2ab-41cc-9828-70ebb2e94895 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:35.110829 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:35.151637 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b530266-8295-49b5-9e81-a25bc3a33d27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:35.152552 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b530266-8295-49b5-9e81-a25bc3a33d27 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:35.152829 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b530266-8295-49b5-9e81-a25bc3a33d27 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:35.153088 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b530266-8295-49b5-9e81-a25bc3a33d27 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:35.160506 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b530266-8295-49b5-9e81-a25bc3a33d27 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:35.161975 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b530266-8295-49b5-9e81-a25bc3a33d27 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:35.173591 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-4b530266-8295-49b5-9e81-a25bc3a33d27 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 11:20:35.173591 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:20:35.173591 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:20:35.173591 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:20:35.173591 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:20:35.173591 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:20:35.173591 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:20:35.173591 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:20:35.173591 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:20:35.173591 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:20:35.173591 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:20:35.173591 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:20:35.173591 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 11:20:35.173591 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 11:20:35.173591 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 11:20:35.173591 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 11:20:35.175107 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:20:35.175107 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:20:35.175107 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 11:20:35.175107 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 11:20:35.175107 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 11:20:35.175107 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 11:20:35.175107 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:20:35.175107 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:20:35.175107 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:20:35.175107 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:20:35.175107 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:20:35.175107 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Aug 24 11:20:35.175107 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:20:35.175107 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:20:35.175107 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:20:35.175107 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:20:35.175107 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:20:35.175107 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:20:35.176147 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:20:35.176147 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:20:35.176147 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 11:20:35.176147 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 11:20:35.176147 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 11:20:35.176147 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 11:20:35.176147 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 11:20:35.176147 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 11:20:35.176147 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 11:20:35.176147 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:20:35.176147 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 282/559] 10.222.0.27 () {56 vars in 1093 bytes} [Wed Aug 24 11:20:34 2022] GET /identity/v3/users/nova => generated 82 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:20:35.176740 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8865cd4-862a-4749-a14a-5e30cbb839ad None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:35.176740 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8865cd4-862a-4749-a14a-5e30cbb839ad None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:35.176872 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8865cd4-862a-4749-a14a-5e30cbb839ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:35.194832 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-b8865cd4-862a-4749-a14a-5e30cbb839ad None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:20:35.196054 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-b8865cd4-862a-4749-a14a-5e30cbb839ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:20:35.200557 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01c6ccb-16e2-4f10-9497-0f73665230bc None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:35.237519 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935202f5-7d7f-4c19-a93b-5f61db81fbb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:35.238194 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935202f5-7d7f-4c19-a93b-5f61db81fbb2 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:35.238583 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935202f5-7d7f-4c19-a93b-5f61db81fbb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:35.238889 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935202f5-7d7f-4c19-a93b-5f61db81fbb2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:35.264713 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 283/560] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:20:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 11:20:35.265610 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8865cd4-862a-4749-a14a-5e30cbb839ad None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:35.329514 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935202f5-7d7f-4c19-a93b-5f61db81fbb2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:35.331760 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935202f5-7d7f-4c19-a93b-5f61db81fbb2 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:35.345990 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:35.364645 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:35.382941 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8865cd4-862a-4749-a14a-5e30cbb839ad None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:35.419390 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d52fd27-427a-44bd-934b-b3a62c11d496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:35.419947 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d52fd27-427a-44bd-934b-b3a62c11d496 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:35.420260 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d52fd27-427a-44bd-934b-b3a62c11d496 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:35.420491 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d52fd27-427a-44bd-934b-b3a62c11d496 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:35.430986 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d52fd27-427a-44bd-934b-b3a62c11d496 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:20:35.435711 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-4d52fd27-427a-44bd-934b-b3a62c11d496 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 11:20:35.435711 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:20:35.435711 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:20:35.435711 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:20:35.435711 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:20:35.435711 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:20:35.435711 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:20:35.435711 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:20:35.435711 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:20:35.435711 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:20:35.435711 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:20:35.435711 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:20:35.435711 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:20:35.435711 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:20:35.435711 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:20:35.435711 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:20:35.436625 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:20:35.436625 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:20:35.436625 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:20:35.436625 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:20:35.436625 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:20:35.436625 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:20:35.436625 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:20:35.436625 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:20:35.436625 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:20:35.436625 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:20:35.436625 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:20:35.436625 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Aug 24 11:20:35.436625 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:20:35.436625 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:20:35.436625 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:20:35.436625 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:20:35.437511 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:20:35.437511 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:20:35.437511 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:20:35.437511 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:20:35.437511 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:20:35.437511 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:20:35.437511 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:20:35.437511 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:20:35.437511 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:20:35.437511 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:20:35.437511 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 11:20:35.437511 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:20:35.437511 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 284/561] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Aug 24 11:20:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:20:35.438875 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d52fd27-427a-44bd-934b-b3a62c11d496 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:35.454229 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 278/562] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 24 11:20:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 11:20:35.455475 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002f32d9-b044-4d5f-a2d8-074ac558f174 None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:35.455766 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002f32d9-b044-4d5f-a2d8-074ac558f174 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:35.456034 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002f32d9-b044-4d5f-a2d8-074ac558f174 None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:35.461714 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 279/563] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:20:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:20:35.461714 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002f32d9-b044-4d5f-a2d8-074ac558f174 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:35.556646 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d52fd27-427a-44bd-934b-b3a62c11d496 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:35.567102 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002f32d9-b044-4d5f-a2d8-074ac558f174 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:35.583334 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:35.592031 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce000bea-5715-4fd0-b454-36e925e8305b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:35.592183 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:35.592720 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce000bea-5715-4fd0-b454-36e925e8305b None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:35.592939 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce000bea-5715-4fd0-b454-36e925e8305b None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:35.593272 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce000bea-5715-4fd0-b454-36e925e8305b None admin] PATH_INFO: `/v3/users` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:35.594062 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce000bea-5715-4fd0-b454-36e925e8305b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:20:35.594516 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce000bea-5715-4fd0-b454-36e925e8305b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:35.596004 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce000bea-5715-4fd0-b454-36e925e8305b None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:35.601141 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2922d6e-8c07-4ee2-a5a2-a78a6b640170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:35.601741 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2922d6e-8c07-4ee2-a5a2-a78a6b640170 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:35.602016 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2922d6e-8c07-4ee2-a5a2-a78a6b640170 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:35.602283 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2922d6e-8c07-4ee2-a5a2-a78a6b640170 None admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:35.602994 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2922d6e-8c07-4ee2-a5a2-a78a6b640170 None admin] RBAC: Adding query filter params (name=service) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:20:35.603320 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2922d6e-8c07-4ee2-a5a2-a78a6b640170 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:35.604698 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2922d6e-8c07-4ee2-a5a2-a78a6b640170 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:35.613052 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 285/564] 10.222.0.27 () {56 vars in 1133 bytes} [Wed Aug 24 11:20:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:35.613472 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 280/565] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Aug 24 11:20:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:35.614679 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8094907a-374e-4f75-9e1b-01616cdbc795 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:35.614956 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8094907a-374e-4f75-9e1b-01616cdbc795 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:35.615224 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8094907a-374e-4f75-9e1b-01616cdbc795 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:35.615818 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce000bea-5715-4fd0-b454-36e925e8305b None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:35.632816 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-8094907a-374e-4f75-9e1b-01616cdbc795 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:20:35.634012 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-8094907a-374e-4f75-9e1b-01616cdbc795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:20:35.700322 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 281/566] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:20:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 11:20:35.700837 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8094907a-374e-4f75-9e1b-01616cdbc795 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:35.716131 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce000bea-5715-4fd0-b454-36e925e8305b None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:35.752540 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d93353-9e3a-426a-b1ee-afffe6fa25a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:35.753408 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d93353-9e3a-426a-b1ee-afffe6fa25a8 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:35.753778 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d93353-9e3a-426a-b1ee-afffe6fa25a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:35.754050 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d93353-9e3a-426a-b1ee-afffe6fa25a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:35.764138 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d93353-9e3a-426a-b1ee-afffe6fa25a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:35.765581 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d93353-9e3a-426a-b1ee-afffe6fa25a8 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:35.780327 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-e5d93353-9e3a-426a-b1ee-afffe6fa25a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:20:35.780327 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:20:35.780327 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:20:35.780327 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:20:35.780327 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:20:35.780327 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:20:35.780327 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:20:35.780327 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:20:35.780327 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:20:35.780327 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:20:35.780327 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:20:35.780327 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:20:35.780327 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 11:20:35.780327 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 11:20:35.780327 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 11:20:35.780327 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 11:20:35.781284 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:20:35.781284 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:20:35.781284 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:20:35.781284 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:20:35.781284 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:20:35.781284 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:20:35.781284 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:20:35.781284 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Aug 24 11:20:35.781284 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:20:35.781284 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:20:35.781284 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:20:35.781284 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:20:35.781284 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:20:35.781284 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:20:35.781284 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:20:35.781284 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:20:35.781284 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 11:20:35.782167 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 11:20:35.782167 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:20:35.782167 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:20:35.782167 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 286/567] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 11:20:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:20:35.782888 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d93353-9e3a-426a-b1ee-afffe6fa25a8 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:35.812722 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8094907a-374e-4f75-9e1b-01616cdbc795 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:35.824975 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:35.831284 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:35.849071 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b79203-08b3-4299-b870-aef772d5c803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:35.849707 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b79203-08b3-4299-b870-aef772d5c803 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:35.849984 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b79203-08b3-4299-b870-aef772d5c803 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:35.850248 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b79203-08b3-4299-b870-aef772d5c803 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:35.860299 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b79203-08b3-4299-b870-aef772d5c803 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:20:35.864929 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-a5b79203-08b3-4299-b870-aef772d5c803 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 11:20:35.864929 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:20:35.864929 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:20:35.864929 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:20:35.864929 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:20:35.864929 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:20:35.864929 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:20:35.864929 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:20:35.864929 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:20:35.864929 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:20:35.864929 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:20:35.864929 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:20:35.864929 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:20:35.864929 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:20:35.864929 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:20:35.864929 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:20:35.865910 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:20:35.865910 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:20:35.865910 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:20:35.865910 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:20:35.865910 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:20:35.865910 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:20:35.865910 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:20:35.865910 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:20:35.865910 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:20:35.865910 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:20:35.865910 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:20:35.865910 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Aug 24 11:20:35.865910 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:20:35.865910 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:20:35.865910 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:20:35.865910 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:20:35.867389 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:20:35.867389 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:20:35.867389 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:20:35.867389 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:20:35.867389 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:20:35.867389 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:20:35.867389 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:20:35.867389 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:20:35.867389 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:20:35.867389 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:20:35.867389 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 11:20:35.867389 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Aug 24 11:20:35.867389 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 282/568] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Aug 24 11:20:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:20:35.867389 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b79203-08b3-4299-b870-aef772d5c803 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:35.897899 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d93353-9e3a-426a-b1ee-afffe6fa25a8 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:35.932176 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b1d2f2-5c7a-45f5-9534-949c25befa57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:35.932840 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b1d2f2-5c7a-45f5-9534-949c25befa57 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:35.933116 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b1d2f2-5c7a-45f5-9534-949c25befa57 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:35.933377 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b1d2f2-5c7a-45f5-9534-949c25befa57 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:35.943968 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b1d2f2-5c7a-45f5-9534-949c25befa57 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:35.945444 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b1d2f2-5c7a-45f5-9534-949c25befa57 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:35.960150 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-a0b1d2f2-5c7a-45f5-9534-949c25befa57 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:20:35.960150 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:20:35.960150 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:20:35.960150 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:20:35.960150 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:20:35.960150 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:20:35.960150 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:20:35.960150 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:20:35.960150 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:20:35.960150 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:20:35.960150 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:20:35.960150 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:20:35.960150 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 11:20:35.960150 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 11:20:35.960150 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 11:20:35.960150 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 11:20:35.961104 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:20:35.961104 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:20:35.961104 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:20:35.961104 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:20:35.961104 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:20:35.961104 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:20:35.961104 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:20:35.961104 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Aug 24 11:20:35.961104 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:20:35.961104 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:20:35.961104 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:20:35.961104 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:20:35.961104 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:20:35.961104 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:20:35.961104 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:20:35.961104 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:20:35.961104 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 11:20:35.962014 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 11:20:35.962014 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:20:35.962014 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:20:35.962014 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 287/569] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 11:20:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:20:35.962014 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b1d2f2-5c7a-45f5-9534-949c25befa57 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:35.981396 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b79203-08b3-4299-b870-aef772d5c803 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:36.014262 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabdf01d-dc72-47c0-87c6-8c4868d8d20b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:36.014930 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabdf01d-dc72-47c0-87c6-8c4868d8d20b None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:36.015208 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabdf01d-dc72-47c0-87c6-8c4868d8d20b None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:36.015480 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabdf01d-dc72-47c0-87c6-8c4868d8d20b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:36.025482 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabdf01d-dc72-47c0-87c6-8c4868d8d20b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:36.027365 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabdf01d-dc72-47c0-87c6-8c4868d8d20b None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:36.041649 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-dabdf01d-dc72-47c0-87c6-8c4868d8d20b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:20:36.041649 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:20:36.041649 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:20:36.041649 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:20:36.041649 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:20:36.041649 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:20:36.041649 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:20:36.041649 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:20:36.041649 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:20:36.041649 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:20:36.041649 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:20:36.041649 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:20:36.041649 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 11:20:36.041649 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 11:20:36.041649 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 11:20:36.041649 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 11:20:36.042671 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:20:36.042671 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:20:36.042671 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:20:36.042671 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:20:36.042671 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:20:36.042671 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:20:36.042671 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:20:36.042671 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Aug 24 11:20:36.042671 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:20:36.042671 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:20:36.042671 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:20:36.042671 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:20:36.042671 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:20:36.042671 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:20:36.042671 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:20:36.042671 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:20:36.042671 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 11:20:36.043558 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 11:20:36.043558 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:20:36.043558 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Aug 24 11:20:36.043558 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 283/570] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 11:20:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:20:36.043789 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabdf01d-dc72-47c0-87c6-8c4868d8d20b None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:36.058441 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:36.068635 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b1d2f2-5c7a-45f5-9534-949c25befa57 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:36.074285 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:36.103509 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0dcbec-075f-4330-87a9-2302a7e7f4a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:36.104645 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0dcbec-075f-4330-87a9-2302a7e7f4a5 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:36.104645 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0dcbec-075f-4330-87a9-2302a7e7f4a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:36.104645 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0dcbec-075f-4330-87a9-2302a7e7f4a5 None admin] PATH_INFO: `/v3/domains` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:36.105247 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0dcbec-075f-4330-87a9-2302a7e7f4a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:20:36.105542 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0dcbec-075f-4330-87a9-2302a7e7f4a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:36.106989 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0dcbec-075f-4330-87a9-2302a7e7f4a5 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:36.118671 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 288/571] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 24 11:20:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:36.119474 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0dcbec-075f-4330-87a9-2302a7e7f4a5 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:36.148996 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabdf01d-dc72-47c0-87c6-8c4868d8d20b None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:36.183747 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d030fcd4-3d94-4456-a320-40a75bd6d84e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:36.184355 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d030fcd4-3d94-4456-a320-40a75bd6d84e None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:36.184634 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d030fcd4-3d94-4456-a320-40a75bd6d84e None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:36.184906 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d030fcd4-3d94-4456-a320-40a75bd6d84e None admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:36.185577 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d030fcd4-3d94-4456-a320-40a75bd6d84e None admin] RBAC: Adding query filter params (name=service) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:20:36.185881 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d030fcd4-3d94-4456-a320-40a75bd6d84e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:36.187290 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d030fcd4-3d94-4456-a320-40a75bd6d84e None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:36.195455 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 284/572] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Aug 24 11:20:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:36.196065 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d030fcd4-3d94-4456-a320-40a75bd6d84e None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:36.219131 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0dcbec-075f-4330-87a9-2302a7e7f4a5 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:36.252060 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a695f1ea-c651-42de-a609-a0ec5976f7d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:36.252655 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a695f1ea-c651-42de-a609-a0ec5976f7d1 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:36.252927 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a695f1ea-c651-42de-a609-a0ec5976f7d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:36.253187 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a695f1ea-c651-42de-a609-a0ec5976f7d1 None admin] PATH_INFO: `/v3/domains` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:36.253937 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a695f1ea-c651-42de-a609-a0ec5976f7d1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:20:36.254253 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a695f1ea-c651-42de-a609-a0ec5976f7d1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:36.255723 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a695f1ea-c651-42de-a609-a0ec5976f7d1 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:36.267074 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 289/573] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 24 11:20:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:36.267883 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a695f1ea-c651-42de-a609-a0ec5976f7d1 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:36.280239 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:36.287332 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:36.296591 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d030fcd4-3d94-4456-a320-40a75bd6d84e None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:36.328611 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886d1114-3885-4c7c-87cb-052a34b6b583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:36.329230 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886d1114-3885-4c7c-87cb-052a34b6b583 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:36.329503 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886d1114-3885-4c7c-87cb-052a34b6b583 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:36.329789 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886d1114-3885-4c7c-87cb-052a34b6b583 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:36.339799 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886d1114-3885-4c7c-87cb-052a34b6b583 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:20:36.344831 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-886d1114-3885-4c7c-87cb-052a34b6b583 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 11:20:36.344831 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:20:36.344831 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:20:36.344831 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:20:36.344831 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:20:36.344831 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:20:36.344831 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:20:36.344831 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:20:36.344831 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:20:36.344831 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:20:36.344831 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:20:36.344831 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:20:36.344831 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:20:36.344831 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:20:36.344831 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:20:36.344831 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:20:36.345862 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:20:36.345862 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:20:36.345862 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:20:36.345862 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:20:36.345862 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:20:36.345862 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:20:36.345862 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:20:36.345862 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:20:36.345862 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:20:36.345862 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:20:36.345862 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:20:36.345862 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Aug 24 11:20:36.345862 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:20:36.345862 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:20:36.345862 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:20:36.345862 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:20:36.346757 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:20:36.346757 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:20:36.346757 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:20:36.346757 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:20:36.346757 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:20:36.346757 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:20:36.346757 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:20:36.346757 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:20:36.346757 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:20:36.346757 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:20:36.346757 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 11:20:36.346757 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Aug 24 11:20:36.346757 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 285/574] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Aug 24 11:20:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:20:36.346757 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886d1114-3885-4c7c-87cb-052a34b6b583 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:36.370697 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a695f1ea-c651-42de-a609-a0ec5976f7d1 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:36.406131 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39e712b-22a8-423f-984f-23d579c471d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:36.406767 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39e712b-22a8-423f-984f-23d579c471d1 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:36.407044 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39e712b-22a8-423f-984f-23d579c471d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:36.407341 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39e712b-22a8-423f-984f-23d579c471d1 None admin] PATH_INFO: `/v3/domains` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:36.408001 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39e712b-22a8-423f-984f-23d579c471d1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:20:36.408308 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39e712b-22a8-423f-984f-23d579c471d1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:36.409750 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39e712b-22a8-423f-984f-23d579c471d1 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:36.421228 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 290/575] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 24 11:20:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:36.422027 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39e712b-22a8-423f-984f-23d579c471d1 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:36.450176 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886d1114-3885-4c7c-87cb-052a34b6b583 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:36.483592 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cc8c4c-fe86-4e70-ad0e-8361592be1f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:36.484229 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cc8c4c-fe86-4e70-ad0e-8361592be1f9 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:36.484513 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cc8c4c-fe86-4e70-ad0e-8361592be1f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:36.484773 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cc8c4c-fe86-4e70-ad0e-8361592be1f9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:36.491348 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cc8c4c-fe86-4e70-ad0e-8361592be1f9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:36.491793 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:36.492808 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cc8c4c-fe86-4e70-ad0e-8361592be1f9 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:36.505000 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-08cc8c4c-fe86-4e70-ad0e-8361592be1f9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 11:20:36.505000 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:20:36.505000 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:20:36.505000 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:20:36.505000 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:20:36.505000 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:20:36.505000 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:20:36.505000 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:20:36.505000 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:20:36.505000 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:20:36.505000 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:20:36.505000 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:20:36.505000 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 11:20:36.505000 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 11:20:36.505000 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 11:20:36.505915 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 11:20:36.505915 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:20:36.505915 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:20:36.505915 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:20:36.505915 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:20:36.505915 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:20:36.505915 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:20:36.505915 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:20:36.505915 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Aug 24 11:20:36.505915 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:20:36.505915 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:20:36.505915 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:20:36.505915 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:20:36.505915 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:20:36.505915 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:20:36.505915 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:20:36.505915 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:20:36.507150 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 11:20:36.507150 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 11:20:36.507150 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 11:20:36.507150 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 11:20:36.507150 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 11:20:36.507150 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 11:20:36.507150 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 11:20:36.507150 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Aug 24 11:20:36.507150 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 286/576] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Aug 24 11:20:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:20:36.507674 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cc8c4c-fe86-4e70-ad0e-8361592be1f9 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:36.522109 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:36.529473 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39e712b-22a8-423f-984f-23d579c471d1 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:36.563708 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562fb010-f5a6-4302-99e5-fec2df934f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:36.564348 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562fb010-f5a6-4302-99e5-fec2df934f65 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:36.564619 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562fb010-f5a6-4302-99e5-fec2df934f65 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:36.564892 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562fb010-f5a6-4302-99e5-fec2df934f65 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:36.574779 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562fb010-f5a6-4302-99e5-fec2df934f65 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:36.576279 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562fb010-f5a6-4302-99e5-fec2df934f65 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:36.590870 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-562fb010-f5a6-4302-99e5-fec2df934f65 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:20:36.590870 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:20:36.590870 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:20:36.590870 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:20:36.590870 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:20:36.590870 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:20:36.590870 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:20:36.590870 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:20:36.590870 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:20:36.590870 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:20:36.590870 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:20:36.590870 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:20:36.590870 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 11:20:36.590870 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 11:20:36.590870 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 11:20:36.590870 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 11:20:36.591838 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:20:36.591838 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:20:36.591838 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:20:36.591838 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:20:36.591838 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:20:36.591838 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:20:36.591838 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:20:36.591838 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Aug 24 11:20:36.591838 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:20:36.591838 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:20:36.591838 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:20:36.591838 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:20:36.591838 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:20:36.591838 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:20:36.591838 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:20:36.591838 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:20:36.591838 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 11:20:36.592743 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 11:20:36.592743 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:20:36.592743 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:20:36.592743 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 291/577] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 11:20:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:20:36.592968 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562fb010-f5a6-4302-99e5-fec2df934f65 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:36.612086 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cc8c4c-fe86-4e70-ad0e-8361592be1f9 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:36.645585 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5fa248-5b58-44de-b2f7-0d50f80111f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:36.646230 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5fa248-5b58-44de-b2f7-0d50f80111f9 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:36.646537 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5fa248-5b58-44de-b2f7-0d50f80111f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:36.646809 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5fa248-5b58-44de-b2f7-0d50f80111f9 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:36.654671 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5fa248-5b58-44de-b2f7-0d50f80111f9 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:36.656177 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5fa248-5b58-44de-b2f7-0d50f80111f9 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:36.666942 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-1e5fa248-5b58-44de-b2f7-0d50f80111f9 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 11:20:36.666942 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:20:36.666942 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:20:36.666942 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:20:36.666942 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:20:36.666942 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:20:36.666942 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:20:36.666942 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:20:36.666942 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:20:36.666942 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:20:36.666942 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:20:36.666942 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:20:36.666942 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 11:20:36.666942 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 11:20:36.666942 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 11:20:36.666942 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 11:20:36.668058 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:20:36.668058 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:20:36.668058 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 11:20:36.668058 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 11:20:36.668058 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 11:20:36.668058 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 11:20:36.668058 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:20:36.668058 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:20:36.668058 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:20:36.668058 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:20:36.668058 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:20:36.668058 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Aug 24 11:20:36.668058 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:20:36.668058 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:20:36.668058 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:20:36.668058 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:20:36.668058 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:20:36.668058 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:20:36.669021 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:20:36.669021 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:20:36.669021 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 11:20:36.669021 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 11:20:36.669021 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 11:20:36.669021 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 11:20:36.669021 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 11:20:36.669021 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 11:20:36.669021 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 11:20:36.669021 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Aug 24 11:20:36.669021 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 287/578] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Aug 24 11:20:36 2022] GET /identity/v3/users/neutron => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:20:36.669021 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5fa248-5b58-44de-b2f7-0d50f80111f9 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:36.701019 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562fb010-f5a6-4302-99e5-fec2df934f65 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:36.723144 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:36.736146 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02744918-5467-43e8-80c5-0e0f5f66746d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:36.736704 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02744918-5467-43e8-80c5-0e0f5f66746d None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:36.736981 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02744918-5467-43e8-80c5-0e0f5f66746d None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:36.737248 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02744918-5467-43e8-80c5-0e0f5f66746d None admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:36.737993 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02744918-5467-43e8-80c5-0e0f5f66746d None admin] RBAC: Adding query filter params (name=service) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:20:36.738294 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02744918-5467-43e8-80c5-0e0f5f66746d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:36.739739 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02744918-5467-43e8-80c5-0e0f5f66746d None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:36.741067 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:36.749035 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 292/579] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Aug 24 11:20:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:36.749655 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02744918-5467-43e8-80c5-0e0f5f66746d None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:36.778011 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5fa248-5b58-44de-b2f7-0d50f80111f9 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:36.812598 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365118a7-f451-490d-a5c7-2ceff7d4373f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:36.813237 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365118a7-f451-490d-a5c7-2ceff7d4373f None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:36.813513 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365118a7-f451-490d-a5c7-2ceff7d4373f None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:36.813783 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365118a7-f451-490d-a5c7-2ceff7d4373f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:36.820498 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365118a7-f451-490d-a5c7-2ceff7d4373f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:36.821954 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365118a7-f451-490d-a5c7-2ceff7d4373f None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:36.833265 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-365118a7-f451-490d-a5c7-2ceff7d4373f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 11:20:36.833265 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:20:36.833265 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:20:36.833265 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:20:36.833265 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:20:36.833265 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:20:36.833265 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:20:36.833265 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:20:36.833265 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:20:36.833265 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:20:36.833265 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:20:36.833265 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:20:36.833265 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 11:20:36.833265 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 11:20:36.833265 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 11:20:36.834155 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 11:20:36.834155 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:20:36.834155 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:20:36.834155 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:20:36.834155 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:20:36.834155 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:20:36.834155 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:20:36.834155 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:20:36.834155 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Aug 24 11:20:36.834155 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:20:36.834155 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:20:36.834155 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:20:36.834155 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:20:36.834155 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:20:36.834155 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:20:36.834155 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:20:36.834155 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:20:36.835108 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 11:20:36.835108 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 11:20:36.835108 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 11:20:36.835108 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 11:20:36.835108 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 11:20:36.835108 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 11:20:36.835108 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 11:20:36.835108 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Aug 24 11:20:36.835108 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 288/580] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Aug 24 11:20:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:20:36.835612 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365118a7-f451-490d-a5c7-2ceff7d4373f None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:36.855570 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02744918-5467-43e8-80c5-0e0f5f66746d None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:36.890468 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d77e1f9-2292-497b-840d-3ddc97b0a5f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:36.891078 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d77e1f9-2292-497b-840d-3ddc97b0a5f4 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:36.891356 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d77e1f9-2292-497b-840d-3ddc97b0a5f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:36.891626 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d77e1f9-2292-497b-840d-3ddc97b0a5f4 None admin] PATH_INFO: `/v3/projects` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:36.892321 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d77e1f9-2292-497b-840d-3ddc97b0a5f4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:20:36.892620 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d77e1f9-2292-497b-840d-3ddc97b0a5f4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:36.894083 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d77e1f9-2292-497b-840d-3ddc97b0a5f4 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:36.907114 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 293/581] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Aug 24 11:20:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:36.907916 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d77e1f9-2292-497b-840d-3ddc97b0a5f4 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:36.937112 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365118a7-f451-490d-a5c7-2ceff7d4373f None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:36.953115 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:36.965400 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:36.971162 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745a1b8c-8700-4724-8d41-5485afbb4235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:36.971769 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745a1b8c-8700-4724-8d41-5485afbb4235 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:36.972047 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745a1b8c-8700-4724-8d41-5485afbb4235 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:36.972374 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745a1b8c-8700-4724-8d41-5485afbb4235 None admin] PATH_INFO: `/v3/domains` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:36.973017 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745a1b8c-8700-4724-8d41-5485afbb4235 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:20:36.973354 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745a1b8c-8700-4724-8d41-5485afbb4235 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:36.974769 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745a1b8c-8700-4724-8d41-5485afbb4235 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:36.986612 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 289/582] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 24 11:20:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:36.987338 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745a1b8c-8700-4724-8d41-5485afbb4235 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:37.008065 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d77e1f9-2292-497b-840d-3ddc97b0a5f4 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:37.044086 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3099d0-6bde-4fe8-aa7f-02cf36231325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:37.044704 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3099d0-6bde-4fe8-aa7f-02cf36231325 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:37.044978 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3099d0-6bde-4fe8-aa7f-02cf36231325 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:37.045251 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3099d0-6bde-4fe8-aa7f-02cf36231325 None admin] PATH_INFO: `/v3/users` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:37.045983 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3099d0-6bde-4fe8-aa7f-02cf36231325 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:20:37.046285 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3099d0-6bde-4fe8-aa7f-02cf36231325 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:37.047772 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3099d0-6bde-4fe8-aa7f-02cf36231325 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:37.064859 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 294/583] 10.222.0.27 () {56 vars in 1139 bytes} [Wed Aug 24 11:20:36 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:37.065660 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3099d0-6bde-4fe8-aa7f-02cf36231325 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:37.083563 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745a1b8c-8700-4724-8d41-5485afbb4235 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:37.121299 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31713da7-f25d-4998-b9c8-a300a9012816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:37.121929 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31713da7-f25d-4998-b9c8-a300a9012816 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:37.122227 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31713da7-f25d-4998-b9c8-a300a9012816 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:37.122486 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31713da7-f25d-4998-b9c8-a300a9012816 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:37.132864 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31713da7-f25d-4998-b9c8-a300a9012816 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:37.134345 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31713da7-f25d-4998-b9c8-a300a9012816 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:37.149582 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-31713da7-f25d-4998-b9c8-a300a9012816 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:20:37.149582 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:20:37.149582 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:20:37.149582 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:20:37.149582 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:20:37.149582 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:20:37.149582 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:20:37.149582 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:20:37.149582 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:20:37.149582 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:20:37.149582 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:20:37.149582 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:20:37.149582 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 11:20:37.149582 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 11:20:37.149582 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 11:20:37.149582 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 11:20:37.150746 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:20:37.150746 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:20:37.150746 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:20:37.150746 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:20:37.150746 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:20:37.150746 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:20:37.150746 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:20:37.150746 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Aug 24 11:20:37.150746 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:20:37.150746 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:20:37.150746 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:20:37.150746 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:20:37.150746 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:20:37.150746 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:20:37.150746 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:20:37.150746 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:20:37.150746 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 11:20:37.151658 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 11:20:37.151658 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:20:37.151658 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Aug 24 11:20:37.151658 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 290/584] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 11:20:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:20:37.151658 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31713da7-f25d-4998-b9c8-a300a9012816 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:37.171205 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3099d0-6bde-4fe8-aa7f-02cf36231325 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:37.173041 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:37.199099 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:37.207255 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f313b599-e676-4459-a0e4-8b4c4fb69202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:37.207867 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f313b599-e676-4459-a0e4-8b4c4fb69202 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:37.208140 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f313b599-e676-4459-a0e4-8b4c4fb69202 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:37.208415 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f313b599-e676-4459-a0e4-8b4c4fb69202 None admin] PATH_INFO: `/v3/projects` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:37.209106 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f313b599-e676-4459-a0e4-8b4c4fb69202 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:20:37.209404 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f313b599-e676-4459-a0e4-8b4c4fb69202 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:37.210873 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f313b599-e676-4459-a0e4-8b4c4fb69202 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:37.222060 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 295/585] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Aug 24 11:20:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:37.222921 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f313b599-e676-4459-a0e4-8b4c4fb69202 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:37.252666 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31713da7-f25d-4998-b9c8-a300a9012816 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:37.286422 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8386b2-1b3d-469d-9723-7d77618a7b16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:37.287301 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8386b2-1b3d-469d-9723-7d77618a7b16 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:37.287744 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8386b2-1b3d-469d-9723-7d77618a7b16 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:37.288001 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8386b2-1b3d-469d-9723-7d77618a7b16 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:37.288735 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8386b2-1b3d-469d-9723-7d77618a7b16 None admin] RBAC: Adding query filter params (role.id=217baac59e08499ea2f1b1d84935df0b, scope.project.id=317f54a463cb48ab86648c6dcec5db0f, user.id=f1069558c085449f9e4c9f06013b2a85) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:20:37.289035 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8386b2-1b3d-469d-9723-7d77618a7b16 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:37.290507 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8386b2-1b3d-469d-9723-7d77618a7b16 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:37.295769 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 291/586] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Aug 24 11:20:37 2022] GET /identity/v3/role_assignments?user.id=f1069558c085449f9e4c9f06013b2a85&scope.project.id=317f54a463cb48ab86648c6dcec5db0f&role.id=217baac59e08499ea2f1b1d84935df0b => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:37.296530 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8386b2-1b3d-469d-9723-7d77618a7b16 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:37.326813 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f313b599-e676-4459-a0e4-8b4c4fb69202 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:37.366192 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32bcdda-21d9-4e06-8bce-061039df5ebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:37.367137 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32bcdda-21d9-4e06-8bce-061039df5ebe None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:37.367580 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32bcdda-21d9-4e06-8bce-061039df5ebe None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:37.367990 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32bcdda-21d9-4e06-8bce-061039df5ebe None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:37.377871 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32bcdda-21d9-4e06-8bce-061039df5ebe None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:37.379628 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32bcdda-21d9-4e06-8bce-061039df5ebe None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:37.392759 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-d32bcdda-21d9-4e06-8bce-061039df5ebe None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 11:20:37.392759 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:20:37.392759 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:20:37.392759 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:20:37.392759 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:20:37.392759 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:20:37.392759 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:20:37.392759 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:20:37.392759 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:20:37.392759 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:20:37.392759 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:20:37.392759 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:20:37.392759 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 11:20:37.392759 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 11:20:37.392759 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 11:20:37.392759 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 11:20:37.393978 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:20:37.393978 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:20:37.393978 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 11:20:37.393978 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 11:20:37.393978 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 11:20:37.393978 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 11:20:37.393978 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:20:37.393978 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:20:37.393978 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:20:37.393978 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:20:37.393978 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:20:37.393978 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Aug 24 11:20:37.393978 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:20:37.393978 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:20:37.393978 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:20:37.393978 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:20:37.393978 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:20:37.393978 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:20:37.395075 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:20:37.395075 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:20:37.395075 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 11:20:37.395075 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 11:20:37.395075 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 11:20:37.395075 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 11:20:37.395075 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 11:20:37.395075 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 11:20:37.395075 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 11:20:37.395075 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:20:37.395075 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 296/587] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 24 11:20:37 2022] GET /identity/v3/users/cinder => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:20:37.395647 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32bcdda-21d9-4e06-8bce-061039df5ebe None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:37.407584 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8386b2-1b3d-469d-9723-7d77618a7b16 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:37.418640 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:37.431071 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:37.448030 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133759f7-ffbf-4888-bfc0-f27874262237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:37.449094 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133759f7-ffbf-4888-bfc0-f27874262237 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:37.449368 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133759f7-ffbf-4888-bfc0-f27874262237 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:37.449629 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133759f7-ffbf-4888-bfc0-f27874262237 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:37.464335 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133759f7-ffbf-4888-bfc0-f27874262237 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:37.465935 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133759f7-ffbf-4888-bfc0-f27874262237 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:37.480426 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-133759f7-ffbf-4888-bfc0-f27874262237 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:20:37.480426 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:20:37.480426 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:20:37.480426 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:20:37.480426 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:20:37.480426 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:20:37.480426 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:20:37.480426 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:20:37.480426 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:20:37.480426 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:20:37.480426 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:20:37.480426 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:20:37.480426 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 11:20:37.480426 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 11:20:37.480426 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 11:20:37.480426 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 11:20:37.481414 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:20:37.481414 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:20:37.481414 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:20:37.481414 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:20:37.481414 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:20:37.481414 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:20:37.481414 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:20:37.481414 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Aug 24 11:20:37.481414 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:20:37.481414 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:20:37.481414 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:20:37.481414 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:20:37.481414 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:20:37.481414 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:20:37.481414 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:20:37.481414 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:20:37.481414 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 11:20:37.482435 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 11:20:37.482435 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:20:37.482435 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Aug 24 11:20:37.482435 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 292/588] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 11:20:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:20:37.482680 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133759f7-ffbf-4888-bfc0-f27874262237 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:37.516595 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32bcdda-21d9-4e06-8bce-061039df5ebe None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:37.552663 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525f7b71-0530-4c4b-8ad3-51ece84a9c08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:37.553781 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525f7b71-0530-4c4b-8ad3-51ece84a9c08 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:37.554030 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525f7b71-0530-4c4b-8ad3-51ece84a9c08 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:37.554461 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525f7b71-0530-4c4b-8ad3-51ece84a9c08 None admin] PATH_INFO: `/v3/domains` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:37.555229 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525f7b71-0530-4c4b-8ad3-51ece84a9c08 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:20:37.555533 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525f7b71-0530-4c4b-8ad3-51ece84a9c08 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:37.557862 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525f7b71-0530-4c4b-8ad3-51ece84a9c08 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:37.576608 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 297/589] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 24 11:20:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:37.576608 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525f7b71-0530-4c4b-8ad3-51ece84a9c08 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:37.587758 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133759f7-ffbf-4888-bfc0-f27874262237 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:37.623277 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ddb203-c0c5-4124-b014-ec9eb39104c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:37.624050 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ddb203-c0c5-4124-b014-ec9eb39104c3 None admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:37.624220 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ddb203-c0c5-4124-b014-ec9eb39104c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:37.624492 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ddb203-c0c5-4124-b014-ec9eb39104c3 None admin] PATH_INFO: `/v3/projects/317f54a463cb48ab86648c6dcec5db0f/users/282ec32864d046b2bea170f6a3845cc0/roles/217baac59e08499ea2f1b1d84935df0b` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:37.639639 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ddb203-c0c5-4124-b014-ec9eb39104c3 None admin] RBAC: Authorizing `identity:create_grant(project_id=317f54a463cb48ab86648c6dcec5db0f, user_id=282ec32864d046b2bea170f6a3845cc0, role_id=217baac59e08499ea2f1b1d84935df0b)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:37.640864 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ddb203-c0c5-4124-b014-ec9eb39104c3 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:37.666387 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 293/590] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Aug 24 11:20:37 2022] PUT /identity/v3/projects/317f54a463cb48ab86648c6dcec5db0f/users/282ec32864d046b2bea170f6a3845cc0/roles/217baac59e08499ea2f1b1d84935df0b => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:20:37.666387 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ddb203-c0c5-4124-b014-ec9eb39104c3 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:37.670070 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:37.683945 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:37.717282 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525f7b71-0530-4c4b-8ad3-51ece84a9c08 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:37.759974 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e26e401-9070-43c0-af2e-9568b51574b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:37.760736 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e26e401-9070-43c0-af2e-9568b51574b2 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:37.761142 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e26e401-9070-43c0-af2e-9568b51574b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:37.761414 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e26e401-9070-43c0-af2e-9568b51574b2 None admin] PATH_INFO: `/v3/users` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:37.762158 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e26e401-9070-43c0-af2e-9568b51574b2 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:20:37.762783 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e26e401-9070-43c0-af2e-9568b51574b2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:37.764632 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e26e401-9070-43c0-af2e-9568b51574b2 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:37.786497 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 298/591] 10.222.0.27 () {56 vars in 1137 bytes} [Wed Aug 24 11:20:37 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:37.787329 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e26e401-9070-43c0-af2e-9568b51574b2 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:37.807320 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ddb203-c0c5-4124-b014-ec9eb39104c3 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:37.851075 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8563844-9c01-40ce-bc8f-8bb8c7a2e4af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:37.851288 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8563844-9c01-40ce-bc8f-8bb8c7a2e4af None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:37.851534 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8563844-9c01-40ce-bc8f-8bb8c7a2e4af None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:37.852053 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8563844-9c01-40ce-bc8f-8bb8c7a2e4af None admin] PATH_INFO: `/v3/domains` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:37.852711 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8563844-9c01-40ce-bc8f-8bb8c7a2e4af None admin] RBAC: Adding query filter params (name=Default) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:20:37.852996 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8563844-9c01-40ce-bc8f-8bb8c7a2e4af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:37.854422 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8563844-9c01-40ce-bc8f-8bb8c7a2e4af None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:37.867228 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 294/592] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 24 11:20:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:37.868143 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8563844-9c01-40ce-bc8f-8bb8c7a2e4af None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:37.899473 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e26e401-9070-43c0-af2e-9568b51574b2 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:37.935475 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a561101-313b-434f-81aa-45441aea5686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:37.936521 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a561101-313b-434f-81aa-45441aea5686 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:37.937058 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a561101-313b-434f-81aa-45441aea5686 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:37.937513 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a561101-313b-434f-81aa-45441aea5686 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:37.945248 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a561101-313b-434f-81aa-45441aea5686 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:37.946996 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a561101-313b-434f-81aa-45441aea5686 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:37.949773 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:37.953658 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:37.961148 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-8a561101-313b-434f-81aa-45441aea5686 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 24 11:20:37.961148 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:20:37.961148 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:20:37.961148 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:20:37.961148 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:20:37.961148 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:20:37.961148 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:20:37.961148 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:20:37.961148 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:20:37.961148 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:20:37.961148 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:20:37.961148 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:20:37.961148 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 11:20:37.961148 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 11:20:37.961148 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 11:20:37.961148 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 11:20:37.962131 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:20:37.962131 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:20:37.962131 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 11:20:37.962131 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 11:20:37.962131 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 11:20:37.962131 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 11:20:37.962131 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:20:37.962131 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:20:37.962131 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:20:37.962131 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:20:37.962131 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:20:37.962131 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Aug 24 11:20:37.962131 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:20:37.962131 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:20:37.962131 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:20:37.962131 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:20:37.962131 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:20:37.962131 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:20:37.963104 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:20:37.963104 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:20:37.963104 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 11:20:37.963104 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 11:20:37.963104 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 11:20:37.963104 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 11:20:37.963104 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 11:20:37.963104 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 11:20:37.963104 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 24 11:20:37.963104 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:20:37.965720 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 299/593] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 24 11:20:37 2022] GET /identity/v3/users/glance => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:20:37.971129 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a561101-313b-434f-81aa-45441aea5686 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:37.991426 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8563844-9c01-40ce-bc8f-8bb8c7a2e4af None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:38.043069 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bceabf-e797-4a95-840d-5c0e6e5d15a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:38.044108 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bceabf-e797-4a95-840d-5c0e6e5d15a9 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:38.044574 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bceabf-e797-4a95-840d-5c0e6e5d15a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:38.045052 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bceabf-e797-4a95-840d-5c0e6e5d15a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:38.061489 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bceabf-e797-4a95-840d-5c0e6e5d15a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:38.064031 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bceabf-e797-4a95-840d-5c0e6e5d15a9 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:38.088168 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-f6bceabf-e797-4a95-840d-5c0e6e5d15a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:20:38.088168 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:20:38.088168 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:20:38.088168 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:20:38.088168 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:20:38.088168 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:20:38.088168 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:20:38.088168 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:20:38.088168 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:20:38.088168 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:20:38.088168 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:20:38.088168 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:20:38.088168 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 11:20:38.088168 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 11:20:38.088168 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 11:20:38.088168 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 11:20:38.089611 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:20:38.089611 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:20:38.089611 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:20:38.089611 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:20:38.089611 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:20:38.089611 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:20:38.089611 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:20:38.089611 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Aug 24 11:20:38.089611 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:20:38.089611 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:20:38.089611 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:20:38.089611 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:20:38.089611 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:20:38.089611 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:20:38.089611 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:20:38.089611 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:20:38.089611 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 11:20:38.090512 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 11:20:38.090512 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:20:38.090512 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Aug 24 11:20:38.092731 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 295/594] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 11:20:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:20:38.093769 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bceabf-e797-4a95-840d-5c0e6e5d15a9 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:38.114142 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a561101-313b-434f-81aa-45441aea5686 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:38.161578 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f57aef7-a4be-4fe6-aa15-180f4a874f4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:38.162265 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f57aef7-a4be-4fe6-aa15-180f4a874f4e None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:38.162788 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f57aef7-a4be-4fe6-aa15-180f4a874f4e None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:38.163073 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f57aef7-a4be-4fe6-aa15-180f4a874f4e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:38.172075 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f57aef7-a4be-4fe6-aa15-180f4a874f4e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:38.174154 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f57aef7-a4be-4fe6-aa15-180f4a874f4e None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:38.188926 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-6f57aef7-a4be-4fe6-aa15-180f4a874f4e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 11:20:38.188926 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:20:38.188926 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:20:38.188926 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:20:38.188926 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:20:38.188926 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:20:38.188926 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:20:38.188926 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:20:38.188926 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:20:38.188926 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:20:38.188926 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:20:38.188926 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:20:38.188926 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 11:20:38.188926 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 11:20:38.188926 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 11:20:38.189889 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 11:20:38.189889 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:20:38.189889 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:20:38.189889 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:20:38.189889 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:20:38.189889 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:20:38.189889 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:20:38.189889 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:20:38.189889 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Aug 24 11:20:38.189889 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:20:38.189889 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:20:38.189889 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:20:38.189889 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:20:38.189889 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:20:38.189889 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:20:38.189889 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:20:38.189889 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:20:38.190806 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 11:20:38.190806 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 11:20:38.190806 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 11:20:38.190806 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 11:20:38.190806 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 11:20:38.190806 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 11:20:38.190806 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 11:20:38.190806 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:20:38.194419 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 300/595] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Aug 24 11:20:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:20:38.195468 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f57aef7-a4be-4fe6-aa15-180f4a874f4e None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:38.221687 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bceabf-e797-4a95-840d-5c0e6e5d15a9 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:38.251164 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:38.257249 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:38.267181 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a280a51d-a6ad-415b-84df-81841544d185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:38.267907 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a280a51d-a6ad-415b-84df-81841544d185 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:38.268285 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a280a51d-a6ad-415b-84df-81841544d185 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:38.268912 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a280a51d-a6ad-415b-84df-81841544d185 None admin] PATH_INFO: `/v3/users` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:38.269836 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a280a51d-a6ad-415b-84df-81841544d185 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:20:38.270264 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a280a51d-a6ad-415b-84df-81841544d185 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:38.272795 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a280a51d-a6ad-415b-84df-81841544d185 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:38.300168 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 296/596] 10.222.0.27 () {56 vars in 1137 bytes} [Wed Aug 24 11:20:38 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:38.300168 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a280a51d-a6ad-415b-84df-81841544d185 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:38.308260 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f57aef7-a4be-4fe6-aa15-180f4a874f4e None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:38.349427 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041ac5f0-be8e-4e77-825f-eb1bd2f45566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:38.350049 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041ac5f0-be8e-4e77-825f-eb1bd2f45566 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:38.350328 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041ac5f0-be8e-4e77-825f-eb1bd2f45566 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:38.350639 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041ac5f0-be8e-4e77-825f-eb1bd2f45566 None admin] PATH_INFO: `/v3/domains` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:38.351302 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041ac5f0-be8e-4e77-825f-eb1bd2f45566 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:20:38.351605 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041ac5f0-be8e-4e77-825f-eb1bd2f45566 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:38.353118 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041ac5f0-be8e-4e77-825f-eb1bd2f45566 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:38.366576 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 301/597] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 24 11:20:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:38.367551 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041ac5f0-be8e-4e77-825f-eb1bd2f45566 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:38.407256 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a280a51d-a6ad-415b-84df-81841544d185 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:38.444559 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2123b273-4220-4445-8b60-d980ecf01da0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:38.445167 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2123b273-4220-4445-8b60-d980ecf01da0 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:38.445443 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2123b273-4220-4445-8b60-d980ecf01da0 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:38.445713 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2123b273-4220-4445-8b60-d980ecf01da0 None admin] PATH_INFO: `/v3/projects` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:38.446424 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2123b273-4220-4445-8b60-d980ecf01da0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:20:38.446727 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2123b273-4220-4445-8b60-d980ecf01da0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:38.448175 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2123b273-4220-4445-8b60-d980ecf01da0 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:38.465537 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 297/598] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Aug 24 11:20:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:38.466530 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2123b273-4220-4445-8b60-d980ecf01da0 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:38.474171 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041ac5f0-be8e-4e77-825f-eb1bd2f45566 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:38.494766 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:38.510032 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3b64ef-d245-48b1-a8c7-7374935c4b5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:38.510800 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3b64ef-d245-48b1-a8c7-7374935c4b5e None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:38.510994 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3b64ef-d245-48b1-a8c7-7374935c4b5e None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:38.511265 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3b64ef-d245-48b1-a8c7-7374935c4b5e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:38.512986 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:38.522924 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3b64ef-d245-48b1-a8c7-7374935c4b5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:38.524522 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3b64ef-d245-48b1-a8c7-7374935c4b5e None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:38.539774 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-ec3b64ef-d245-48b1-a8c7-7374935c4b5e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:20:38.539774 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:20:38.539774 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:20:38.539774 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:20:38.539774 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:20:38.539774 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:20:38.539774 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:20:38.539774 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:20:38.539774 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:20:38.539774 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:20:38.539774 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:20:38.539774 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:20:38.539774 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 11:20:38.539774 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 11:20:38.539774 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 11:20:38.539774 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 11:20:38.540886 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:20:38.540886 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:20:38.540886 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:20:38.540886 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:20:38.540886 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:20:38.540886 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:20:38.540886 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:20:38.540886 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Aug 24 11:20:38.540886 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:20:38.540886 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:20:38.540886 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:20:38.540886 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:20:38.540886 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:20:38.540886 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:20:38.540886 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:20:38.540886 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:20:38.540886 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 11:20:38.542059 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 11:20:38.542059 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:20:38.542059 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:20:38.542059 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 302/599] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 11:20:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:20:38.542059 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3b64ef-d245-48b1-a8c7-7374935c4b5e None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:38.585345 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2123b273-4220-4445-8b60-d980ecf01da0 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:38.621889 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe09a94-199b-4e6e-9875-fe383707a10d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:38.622815 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe09a94-199b-4e6e-9875-fe383707a10d None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:38.623233 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe09a94-199b-4e6e-9875-fe383707a10d None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:38.623648 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe09a94-199b-4e6e-9875-fe383707a10d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:38.631402 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe09a94-199b-4e6e-9875-fe383707a10d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:38.633020 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe09a94-199b-4e6e-9875-fe383707a10d None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:38.643351 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3b64ef-d245-48b1-a8c7-7374935c4b5e None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:38.645528 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-afe09a94-199b-4e6e-9875-fe383707a10d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 11:20:38.645528 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:20:38.645528 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:20:38.645528 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:20:38.645528 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:20:38.645528 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:20:38.645528 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:20:38.645528 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:20:38.645528 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:20:38.645528 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:20:38.645528 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:20:38.645528 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:20:38.645528 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 11:20:38.645528 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 11:20:38.645528 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 11:20:38.646590 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 11:20:38.646590 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:20:38.646590 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:20:38.646590 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:20:38.646590 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:20:38.646590 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:20:38.646590 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:20:38.646590 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:20:38.646590 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Aug 24 11:20:38.646590 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:20:38.646590 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:20:38.646590 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:20:38.646590 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:20:38.646590 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:20:38.646590 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:20:38.646590 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:20:38.646590 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:20:38.647671 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 11:20:38.647671 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 11:20:38.647671 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 11:20:38.647671 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 11:20:38.647671 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 11:20:38.647671 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 11:20:38.647671 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 11:20:38.647671 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Aug 24 11:20:38.649630 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 298/600] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Aug 24 11:20:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:20:38.650779 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe09a94-199b-4e6e-9875-fe383707a10d None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:38.678320 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030773ef-67cd-4074-9fa2-a1be7fbb256c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:38.679023 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030773ef-67cd-4074-9fa2-a1be7fbb256c None admin] REQUEST_METHOD: `PUT` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:38.679301 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030773ef-67cd-4074-9fa2-a1be7fbb256c None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:38.679789 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030773ef-67cd-4074-9fa2-a1be7fbb256c None admin] PATH_INFO: `/v3/projects/317f54a463cb48ab86648c6dcec5db0f/users/e2d061d25d83443c9232218c90792d51/roles/217baac59e08499ea2f1b1d84935df0b` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:38.694910 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030773ef-67cd-4074-9fa2-a1be7fbb256c None admin] RBAC: Authorizing `identity:create_grant(project_id=317f54a463cb48ab86648c6dcec5db0f, user_id=e2d061d25d83443c9232218c90792d51, role_id=217baac59e08499ea2f1b1d84935df0b)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:38.696385 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030773ef-67cd-4074-9fa2-a1be7fbb256c None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:38.718551 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 303/601] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Aug 24 11:20:38 2022] PUT /identity/v3/projects/317f54a463cb48ab86648c6dcec5db0f/users/e2d061d25d83443c9232218c90792d51/roles/217baac59e08499ea2f1b1d84935df0b => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:20:38.718551 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030773ef-67cd-4074-9fa2-a1be7fbb256c None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:38.770754 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:38.847098 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:38.851669 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe09a94-199b-4e6e-9875-fe383707a10d None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:38.870294 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030773ef-67cd-4074-9fa2-a1be7fbb256c None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:38.913128 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302e381d-c498-458a-94f1-c9ada31023bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:38.913999 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302e381d-c498-458a-94f1-c9ada31023bd None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:38.914453 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302e381d-c498-458a-94f1-c9ada31023bd None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:38.914888 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302e381d-c498-458a-94f1-c9ada31023bd None admin] PATH_INFO: `/v3/projects` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:38.915615 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba95b25-f0ba-49e6-8e7a-7cb360c4d505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:38.915935 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302e381d-c498-458a-94f1-c9ada31023bd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:20:38.916262 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba95b25-f0ba-49e6-8e7a-7cb360c4d505 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:38.916536 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302e381d-c498-458a-94f1-c9ada31023bd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:38.916667 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba95b25-f0ba-49e6-8e7a-7cb360c4d505 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:38.916807 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba95b25-f0ba-49e6-8e7a-7cb360c4d505 None admin] PATH_INFO: `/v3/domains` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:38.917459 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba95b25-f0ba-49e6-8e7a-7cb360c4d505 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:20:38.917764 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba95b25-f0ba-49e6-8e7a-7cb360c4d505 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:38.918701 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302e381d-c498-458a-94f1-c9ada31023bd None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:38.919200 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba95b25-f0ba-49e6-8e7a-7cb360c4d505 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:38.934056 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 304/602] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Aug 24 11:20:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:38.937306 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 299/603] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 24 11:20:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:38.939515 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302e381d-c498-458a-94f1-c9ada31023bd None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:38.941804 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba95b25-f0ba-49e6-8e7a-7cb360c4d505 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:39.044820 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:39.066199 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302e381d-c498-458a-94f1-c9ada31023bd None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:39.083744 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba95b25-f0ba-49e6-8e7a-7cb360c4d505 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:39.109714 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e65a31-0ce8-4c0f-8d8c-dfdf880f5518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:39.110613 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e65a31-0ce8-4c0f-8d8c-dfdf880f5518 None admin] REQUEST_METHOD: `PUT` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:39.111062 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e65a31-0ce8-4c0f-8d8c-dfdf880f5518 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:39.111478 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e65a31-0ce8-4c0f-8d8c-dfdf880f5518 None admin] PATH_INFO: `/v3/projects/317f54a463cb48ab86648c6dcec5db0f/users/92862b76ba3b4513b5dc5b5c962faac9/roles/217baac59e08499ea2f1b1d84935df0b` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:39.130637 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e65a31-0ce8-4c0f-8d8c-dfdf880f5518 None admin] RBAC: Authorizing `identity:create_grant(project_id=317f54a463cb48ab86648c6dcec5db0f, user_id=92862b76ba3b4513b5dc5b5c962faac9, role_id=217baac59e08499ea2f1b1d84935df0b)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:39.132630 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e65a31-0ce8-4c0f-8d8c-dfdf880f5518 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:39.151276 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 305/604] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Aug 24 11:20:38 2022] PUT /identity/v3/projects/317f54a463cb48ab86648c6dcec5db0f/users/92862b76ba3b4513b5dc5b5c962faac9/roles/217baac59e08499ea2f1b1d84935df0b => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:20:39.168407 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc9e845-d11a-4823-a5a9-a4d984cc1f8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:39.169067 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc9e845-d11a-4823-a5a9-a4d984cc1f8c None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:39.169358 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc9e845-d11a-4823-a5a9-a4d984cc1f8c None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:39.169674 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc9e845-d11a-4823-a5a9-a4d984cc1f8c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:39.177745 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc9e845-d11a-4823-a5a9-a4d984cc1f8c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:39.179291 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc9e845-d11a-4823-a5a9-a4d984cc1f8c None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:39.192607 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-7cc9e845-d11a-4823-a5a9-a4d984cc1f8c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 11:20:39.192607 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:20:39.192607 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:20:39.192607 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:20:39.192607 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:20:39.192607 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:20:39.192607 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:20:39.192607 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:20:39.192607 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:20:39.192607 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:20:39.192607 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:20:39.192607 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:20:39.192607 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 11:20:39.192607 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 11:20:39.192607 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 11:20:39.193565 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 11:20:39.193565 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:20:39.193565 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:20:39.193565 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:20:39.193565 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:20:39.193565 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:20:39.193565 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:20:39.193565 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:20:39.193565 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Aug 24 11:20:39.193565 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:20:39.193565 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:20:39.193565 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:20:39.193565 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:20:39.193565 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:20:39.193565 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:20:39.193565 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:20:39.193565 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:20:39.194494 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 11:20:39.194494 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 11:20:39.194494 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 11:20:39.194494 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 11:20:39.194494 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 11:20:39.194494 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 11:20:39.194494 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 11:20:39.194494 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Aug 24 11:20:39.198427 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 300/605] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Aug 24 11:20:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 11:20:39.200510 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e65a31-0ce8-4c0f-8d8c-dfdf880f5518 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:39.337912 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e65a31-0ce8-4c0f-8d8c-dfdf880f5518 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:39.355493 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17d06b9-15b0-4dfa-a919-2cd6438321e4 None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:39.355691 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17d06b9-15b0-4dfa-a919-2cd6438321e4 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:39.355964 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17d06b9-15b0-4dfa-a919-2cd6438321e4 None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:39.357544 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 301/606] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:20:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 11:20:39.363685 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a89f37-802e-4491-9f5a-aed1949fbf49 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:39.363967 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a89f37-802e-4491-9f5a-aed1949fbf49 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:39.364243 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a89f37-802e-4491-9f5a-aed1949fbf49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:39.377107 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:39.381938 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1028070-6858-4db7-8fea-8b66bbf912bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:39.382596 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1028070-6858-4db7-8fea-8b66bbf912bc None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:39.382996 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1028070-6858-4db7-8fea-8b66bbf912bc None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:39.383185 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1028070-6858-4db7-8fea-8b66bbf912bc None admin] PATH_INFO: `/v3/projects` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:39.383891 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1028070-6858-4db7-8fea-8b66bbf912bc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:20:39.384772 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1028070-6858-4db7-8fea-8b66bbf912bc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:39.387662 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1028070-6858-4db7-8fea-8b66bbf912bc None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:39.410869 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-10a89f37-802e-4491-9f5a-aed1949fbf49 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:20:39.418385 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 306/607] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Aug 24 11:20:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:39.418555 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-10a89f37-802e-4491-9f5a-aed1949fbf49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:20:39.418642 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1028070-6858-4db7-8fea-8b66bbf912bc None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:39.450743 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:39.558484 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 302/608] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:20:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 11:20:39.574707 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1028070-6858-4db7-8fea-8b66bbf912bc None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:39.614000 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abdc626-a0c4-4c76-8df5-1b42982e3a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:39.614665 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abdc626-a0c4-4c76-8df5-1b42982e3a2d None admin] REQUEST_METHOD: `PUT` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:39.614939 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abdc626-a0c4-4c76-8df5-1b42982e3a2d None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:39.615209 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abdc626-a0c4-4c76-8df5-1b42982e3a2d None admin] PATH_INFO: `/v3/projects/317f54a463cb48ab86648c6dcec5db0f/users/abffba24649e49d28a01cbee51924ce6/roles/217baac59e08499ea2f1b1d84935df0b` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:39.639621 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abdc626-a0c4-4c76-8df5-1b42982e3a2d None admin] RBAC: Authorizing `identity:create_grant(project_id=317f54a463cb48ab86648c6dcec5db0f, user_id=abffba24649e49d28a01cbee51924ce6, role_id=217baac59e08499ea2f1b1d84935df0b)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:39.641069 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abdc626-a0c4-4c76-8df5-1b42982e3a2d None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:39.660011 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 307/609] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Aug 24 11:20:39 2022] PUT /identity/v3/projects/317f54a463cb48ab86648c6dcec5db0f/users/abffba24649e49d28a01cbee51924ce6/roles/217baac59e08499ea2f1b1d84935df0b => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:20:39.853622 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878fe888-7b29-4cb4-aab1-365b823ba4cb None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:39.854267 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878fe888-7b29-4cb4-aab1-365b823ba4cb None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:39.854820 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878fe888-7b29-4cb4-aab1-365b823ba4cb None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:39.856642 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 303/610] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:20:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:20:39.861923 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cdbbc2-7af8-40b3-bc66-d06f9e60ff93 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:39.862203 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cdbbc2-7af8-40b3-bc66-d06f9e60ff93 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:39.862557 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cdbbc2-7af8-40b3-bc66-d06f9e60ff93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:39.886756 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-08cdbbc2-7af8-40b3-bc66-d06f9e60ff93 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:20:39.887889 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-08cdbbc2-7af8-40b3-bc66-d06f9e60ff93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:20:39.928385 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:39.976253 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 308/611] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:20:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 11:20:39.981037 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878fe888-7b29-4cb4-aab1-365b823ba4cb None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:40.120231 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878fe888-7b29-4cb4-aab1-365b823ba4cb None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:40.174634 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97a8e66-1253-43f0-9085-e09bdcb6fcac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:40.175286 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97a8e66-1253-43f0-9085-e09bdcb6fcac None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:40.175491 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97a8e66-1253-43f0-9085-e09bdcb6fcac None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:40.175765 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97a8e66-1253-43f0-9085-e09bdcb6fcac None admin] PATH_INFO: `/v3/roles/service` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:40.191753 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97a8e66-1253-43f0-9085-e09bdcb6fcac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:20:40.196507 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-b97a8e66-1253-43f0-9085-e09bdcb6fcac None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 11:20:40.196507 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:20:40.196507 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:20:40.196507 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:20:40.196507 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:20:40.196507 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:20:40.196507 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:20:40.196507 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:20:40.196507 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:20:40.196507 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:20:40.196507 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:20:40.196507 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:20:40.196507 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:20:40.196507 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:20:40.196507 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:20:40.196507 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:20:40.197487 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:20:40.197487 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:20:40.197487 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:20:40.197487 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:20:40.197487 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:20:40.197487 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:20:40.197487 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:20:40.197487 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:20:40.197487 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:20:40.197487 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:20:40.197487 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:20:40.197487 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Aug 24 11:20:40.197487 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:20:40.197487 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:20:40.197487 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:20:40.197487 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:20:40.198380 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:20:40.198380 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:20:40.198380 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:20:40.198380 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:20:40.198380 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:20:40.198380 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:20:40.198380 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:20:40.198380 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:20:40.198380 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:20:40.198380 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:20:40.198380 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 11:20:40.198380 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Aug 24 11:20:40.198380 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 304/612] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Aug 24 11:20:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:20:40.203849 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cdbbc2-7af8-40b3-bc66-d06f9e60ff93 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:40.327049 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cdbbc2-7af8-40b3-bc66-d06f9e60ff93 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:40.365999 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25a8ff5-3f69-4d02-af5d-510e6dbe7aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:40.366982 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25a8ff5-3f69-4d02-af5d-510e6dbe7aa6 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:40.367451 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25a8ff5-3f69-4d02-af5d-510e6dbe7aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:40.367929 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25a8ff5-3f69-4d02-af5d-510e6dbe7aa6 None admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:40.368832 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25a8ff5-3f69-4d02-af5d-510e6dbe7aa6 None admin] RBAC: Adding query filter params (name=service) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:20:40.369326 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25a8ff5-3f69-4d02-af5d-510e6dbe7aa6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:40.370932 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25a8ff5-3f69-4d02-af5d-510e6dbe7aa6 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:40.386997 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 309/613] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Aug 24 11:20:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:40.395499 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97a8e66-1253-43f0-9085-e09bdcb6fcac None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:40.402189 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25a8ff5-3f69-4d02-af5d-510e6dbe7aa6 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:40.414736 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:40.447058 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:40.511948 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97a8e66-1253-43f0-9085-e09bdcb6fcac None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:40.549184 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e4c2ef-0bfb-4c37-a85d-066f178c235d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:40.549819 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e4c2ef-0bfb-4c37-a85d-066f178c235d None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:40.550098 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e4c2ef-0bfb-4c37-a85d-066f178c235d None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:40.550484 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e4c2ef-0bfb-4c37-a85d-066f178c235d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:40.564402 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e4c2ef-0bfb-4c37-a85d-066f178c235d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:40.565867 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e4c2ef-0bfb-4c37-a85d-066f178c235d None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:40.572721 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25a8ff5-3f69-4d02-af5d-510e6dbe7aa6 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:40.594773 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-18e4c2ef-0bfb-4c37-a85d-066f178c235d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:20:40.594773 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:20:40.594773 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:20:40.594773 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:20:40.594773 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:20:40.594773 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:20:40.594773 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:20:40.594773 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:20:40.594773 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:20:40.594773 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:20:40.594773 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:20:40.594773 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:20:40.594773 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 11:20:40.594773 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 11:20:40.594773 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 11:20:40.594773 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 11:20:40.595781 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:20:40.595781 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:20:40.595781 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:20:40.595781 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:20:40.595781 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:20:40.595781 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:20:40.595781 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:20:40.595781 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Aug 24 11:20:40.595781 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:20:40.595781 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:20:40.595781 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:20:40.595781 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:20:40.595781 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:20:40.595781 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:20:40.595781 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:20:40.595781 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:20:40.595781 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 11:20:40.596673 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 11:20:40.596673 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:20:40.596673 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Aug 24 11:20:40.597501 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 305/614] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 11:20:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:20:40.607366 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e4c2ef-0bfb-4c37-a85d-066f178c235d None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:40.643659 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cb76a1-4883-47c7-90c1-f00a2162967f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:40.644353 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cb76a1-4883-47c7-90c1-f00a2162967f None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:40.644640 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cb76a1-4883-47c7-90c1-f00a2162967f None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:40.644917 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cb76a1-4883-47c7-90c1-f00a2162967f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:40.671385 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cb76a1-4883-47c7-90c1-f00a2162967f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:20:40.676938 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-d9cb76a1-4883-47c7-90c1-f00a2162967f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 11:20:40.676938 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:20:40.676938 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:20:40.676938 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:20:40.676938 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:20:40.676938 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:20:40.676938 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:20:40.676938 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:20:40.676938 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:20:40.676938 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:20:40.676938 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:20:40.676938 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:20:40.676938 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:20:40.676938 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:20:40.676938 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:20:40.676938 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:20:40.677905 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:20:40.677905 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:20:40.677905 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:20:40.677905 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:20:40.677905 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:20:40.677905 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:20:40.677905 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:20:40.677905 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:20:40.677905 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:20:40.677905 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:20:40.677905 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:20:40.677905 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Aug 24 11:20:40.677905 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:20:40.677905 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:20:40.677905 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:20:40.677905 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:20:40.678811 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:20:40.678811 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:20:40.678811 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:20:40.678811 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:20:40.678811 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:20:40.678811 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:20:40.678811 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:20:40.678811 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:20:40.678811 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:20:40.678811 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:20:40.678811 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 11:20:40.678811 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:20:40.686841 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 310/615] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Aug 24 11:20:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 11:20:40.690757 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:40.692825 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cb76a1-4883-47c7-90c1-f00a2162967f None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:40.716548 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e4c2ef-0bfb-4c37-a85d-066f178c235d None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:40.749909 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718b6f44-d516-4b8c-87e4-bab7fd187c30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:40.750554 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718b6f44-d516-4b8c-87e4-bab7fd187c30 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:40.750831 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718b6f44-d516-4b8c-87e4-bab7fd187c30 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:40.751099 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718b6f44-d516-4b8c-87e4-bab7fd187c30 None admin] PATH_INFO: `/v3/domains` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:40.751742 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718b6f44-d516-4b8c-87e4-bab7fd187c30 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:20:40.752039 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718b6f44-d516-4b8c-87e4-bab7fd187c30 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:40.753438 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718b6f44-d516-4b8c-87e4-bab7fd187c30 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:40.769991 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 306/616] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 24 11:20:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:40.771313 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718b6f44-d516-4b8c-87e4-bab7fd187c30 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:40.867573 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cb76a1-4883-47c7-90c1-f00a2162967f None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:40.870704 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:40.881941 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718b6f44-d516-4b8c-87e4-bab7fd187c30 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:40.905361 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:40.926633 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176b7fc3-8000-4518-912d-51434f095662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:40.927263 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176b7fc3-8000-4518-912d-51434f095662 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:40.927536 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176b7fc3-8000-4518-912d-51434f095662 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:40.927800 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176b7fc3-8000-4518-912d-51434f095662 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:40.939580 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49452c66-206a-472e-9a6d-e415f1834b45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:40.940038 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176b7fc3-8000-4518-912d-51434f095662 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:40.940162 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49452c66-206a-472e-9a6d-e415f1834b45 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:40.940445 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49452c66-206a-472e-9a6d-e415f1834b45 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:40.940716 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49452c66-206a-472e-9a6d-e415f1834b45 None admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:40.941454 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49452c66-206a-472e-9a6d-e415f1834b45 None admin] RBAC: Adding query filter params (name=service) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:20:40.941751 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49452c66-206a-472e-9a6d-e415f1834b45 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:40.942721 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176b7fc3-8000-4518-912d-51434f095662 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:40.944335 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49452c66-206a-472e-9a6d-e415f1834b45 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:40.952248 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 311/617] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Aug 24 11:20:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:20:40.959409 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49452c66-206a-472e-9a6d-e415f1834b45 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:40.963842 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-176b7fc3-8000-4518-912d-51434f095662 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 11:20:40.963842 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:20:40.963842 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:20:40.963842 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:20:40.963842 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:20:40.963842 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:20:40.963842 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:20:40.963842 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:20:40.963842 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:20:40.963842 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:20:40.963842 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:20:40.963842 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:20:40.963842 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 11:20:40.963842 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 11:20:40.963842 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 11:20:40.963842 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 11:20:40.964769 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:20:40.964769 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:20:40.964769 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 11:20:40.964769 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 11:20:40.964769 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 11:20:40.964769 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 11:20:40.964769 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:20:40.964769 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:20:40.964769 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:20:40.964769 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:20:40.964769 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:20:40.964769 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Aug 24 11:20:40.964769 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:20:40.964769 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:20:40.964769 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:20:40.964769 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:20:40.964769 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:20:40.964769 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:20:40.965796 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:20:40.965796 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:20:40.965796 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 11:20:40.965796 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 11:20:40.965796 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 11:20:40.965796 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 11:20:40.965796 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 11:20:40.965796 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 11:20:40.965796 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 11:20:40.965796 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Aug 24 11:20:40.968445 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 307/618] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Aug 24 11:20:40 2022] GET /identity/v3/users/swift => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 11:20:40.978948 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176b7fc3-8000-4518-912d-51434f095662 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:41.091114 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49452c66-206a-472e-9a6d-e415f1834b45 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:41.116346 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176b7fc3-8000-4518-912d-51434f095662 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:41.137898 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5a4fb9-e5d4-46d2-adbd-45bfd5f6009f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:41.138646 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5a4fb9-e5d4-46d2-adbd-45bfd5f6009f None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:41.138925 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5a4fb9-e5d4-46d2-adbd-45bfd5f6009f None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:41.139197 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5a4fb9-e5d4-46d2-adbd-45bfd5f6009f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:41.154285 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5a4fb9-e5d4-46d2-adbd-45bfd5f6009f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:41.155841 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5a4fb9-e5d4-46d2-adbd-45bfd5f6009f None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:41.156496 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ad682c-143b-4ca9-935b-a556c581167c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:41.157106 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ad682c-143b-4ca9-935b-a556c581167c None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:41.157376 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ad682c-143b-4ca9-935b-a556c581167c None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:41.157806 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ad682c-143b-4ca9-935b-a556c581167c None admin] PATH_INFO: `/v3/users` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:41.158873 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ad682c-143b-4ca9-935b-a556c581167c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:20:41.159174 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ad682c-143b-4ca9-935b-a556c581167c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:41.160648 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ad682c-143b-4ca9-935b-a556c581167c None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:41.173173 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-9b5a4fb9-e5d4-46d2-adbd-45bfd5f6009f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:20:41.173173 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:20:41.173173 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:20:41.173173 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:20:41.173173 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:20:41.173173 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:20:41.173173 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:20:41.173173 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:20:41.173173 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:20:41.173173 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:20:41.173173 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:20:41.173173 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:20:41.173173 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 11:20:41.173173 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 11:20:41.173173 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 11:20:41.173173 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 11:20:41.174298 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:20:41.174298 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:20:41.174298 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:20:41.174298 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:20:41.174298 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:20:41.174298 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:20:41.174298 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:20:41.174298 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Aug 24 11:20:41.174298 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:20:41.174298 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:20:41.174298 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:20:41.174298 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:20:41.174298 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:20:41.174298 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:20:41.174298 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:20:41.174298 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:20:41.174298 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 11:20:41.175232 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 11:20:41.175232 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:20:41.175232 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:20:41.179292 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 312/619] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 11:20:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:20:41.180606 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c19ca5-5039-43e6-9c7d-bf9297b8b44f None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:41.180893 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c19ca5-5039-43e6-9c7d-bf9297b8b44f None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:41.181173 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c19ca5-5039-43e6-9c7d-bf9297b8b44f None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:41.182496 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 308/620] 10.222.0.27 () {56 vars in 1135 bytes} [Wed Aug 24 11:20:40 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:41.182965 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 313/621] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:20:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:20:41.186516 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ad682c-143b-4ca9-935b-a556c581167c None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:41.189943 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c19ca5-5039-43e6-9c7d-bf9297b8b44f None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:41.204569 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:41.232308 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:41.292810 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ad682c-143b-4ca9-935b-a556c581167c None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:41.311142 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c19ca5-5039-43e6-9c7d-bf9297b8b44f None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:41.327368 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946b3669-6f6e-44ef-8ef5-ac3740cf6ff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:41.328043 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946b3669-6f6e-44ef-8ef5-ac3740cf6ff3 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:41.328247 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946b3669-6f6e-44ef-8ef5-ac3740cf6ff3 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:41.328518 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946b3669-6f6e-44ef-8ef5-ac3740cf6ff3 None admin] PATH_INFO: `/v3/domains` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:41.329167 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946b3669-6f6e-44ef-8ef5-ac3740cf6ff3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:20:41.329467 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946b3669-6f6e-44ef-8ef5-ac3740cf6ff3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:41.330930 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946b3669-6f6e-44ef-8ef5-ac3740cf6ff3 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:41.347128 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 309/622] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 24 11:20:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:41.348500 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ca8431-a6ea-4b7e-b1d6-abaa81b9de83 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:41.348788 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ca8431-a6ea-4b7e-b1d6-abaa81b9de83 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:41.349064 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ca8431-a6ea-4b7e-b1d6-abaa81b9de83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:41.350158 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3382ebc2-cd42-4ed8-8a3f-de8c9e01e9db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:41.351074 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3382ebc2-cd42-4ed8-8a3f-de8c9e01e9db None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:41.351553 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3382ebc2-cd42-4ed8-8a3f-de8c9e01e9db None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:41.352096 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3382ebc2-cd42-4ed8-8a3f-de8c9e01e9db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:41.363949 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3382ebc2-cd42-4ed8-8a3f-de8c9e01e9db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:41.365684 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3382ebc2-cd42-4ed8-8a3f-de8c9e01e9db None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:41.366856 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-d6ca8431-a6ea-4b7e-b1d6-abaa81b9de83 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:20:41.368051 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-d6ca8431-a6ea-4b7e-b1d6-abaa81b9de83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:20:41.381626 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-3382ebc2-cd42-4ed8-8a3f-de8c9e01e9db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:20:41.381626 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:20:41.381626 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:20:41.381626 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:20:41.381626 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:20:41.381626 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:20:41.381626 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:20:41.381626 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:20:41.381626 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:20:41.381626 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:20:41.381626 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:20:41.381626 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:20:41.381626 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 11:20:41.381626 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 11:20:41.381626 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 11:20:41.381626 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 11:20:41.382615 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:20:41.382615 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:20:41.382615 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:20:41.382615 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:20:41.382615 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:20:41.382615 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:20:41.382615 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:20:41.382615 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Aug 24 11:20:41.382615 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:20:41.382615 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:20:41.382615 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:20:41.382615 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:20:41.382615 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:20:41.382615 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:20:41.382615 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:20:41.382615 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:20:41.382615 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 11:20:41.383744 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 11:20:41.383744 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:20:41.383744 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:20:41.385451 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 314/623] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 11:20:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:20:41.386467 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3382ebc2-cd42-4ed8-8a3f-de8c9e01e9db None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:41.437763 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 310/624] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:20:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 11:20:41.446640 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ca8431-a6ea-4b7e-b1d6-abaa81b9de83 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:41.460109 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:41.471550 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:41.510665 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3382ebc2-cd42-4ed8-8a3f-de8c9e01e9db None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:41.547464 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ca8431-a6ea-4b7e-b1d6-abaa81b9de83 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:41.558273 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11b7918-2e91-491d-8f80-c90f30365aac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:41.559430 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11b7918-2e91-491d-8f80-c90f30365aac None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:41.559982 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11b7918-2e91-491d-8f80-c90f30365aac None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:41.560256 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11b7918-2e91-491d-8f80-c90f30365aac None admin] PATH_INFO: `/v3/users/nova` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:41.570648 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11b7918-2e91-491d-8f80-c90f30365aac None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:41.573093 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11b7918-2e91-491d-8f80-c90f30365aac None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:41.582946 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60e5694-f948-4eb4-ba88-d7356b817cf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:41.583610 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60e5694-f948-4eb4-ba88-d7356b817cf9 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:41.583891 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60e5694-f948-4eb4-ba88-d7356b817cf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:41.584160 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60e5694-f948-4eb4-ba88-d7356b817cf9 None admin] PATH_INFO: `/v3/domains` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:41.584861 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60e5694-f948-4eb4-ba88-d7356b817cf9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:20:41.585160 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60e5694-f948-4eb4-ba88-d7356b817cf9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:41.586572 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-e11b7918-2e91-491d-8f80-c90f30365aac None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 11:20:41.586572 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:20:41.586572 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:20:41.586572 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:20:41.586572 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:20:41.586572 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:20:41.586572 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:20:41.586572 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:20:41.586572 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:20:41.586572 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:20:41.586572 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:20:41.586572 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:20:41.586572 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 11:20:41.586572 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 11:20:41.586572 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 11:20:41.586572 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 11:20:41.587485 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:20:41.587485 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:20:41.587485 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 11:20:41.587485 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 11:20:41.587485 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 11:20:41.587485 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 11:20:41.587485 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:20:41.587485 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:20:41.587485 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:20:41.587485 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:20:41.587485 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:20:41.587485 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Aug 24 11:20:41.587485 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:20:41.587485 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:20:41.587485 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:20:41.587485 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:20:41.587485 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:20:41.587485 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:20:41.588430 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:20:41.588430 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:20:41.588430 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 11:20:41.588430 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 11:20:41.588430 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 11:20:41.588430 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 11:20:41.588430 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 11:20:41.588430 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 11:20:41.588430 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 11:20:41.588430 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:20:41.589472 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60e5694-f948-4eb4-ba88-d7356b817cf9 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:41.589546 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 315/625] 10.222.0.27 () {56 vars in 1093 bytes} [Wed Aug 24 11:20:41 2022] GET /identity/v3/users/nova => generated 82 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:20:41.589546 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf500d3-c16c-406b-b477-db5e2826f0eb None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:41.591772 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf500d3-c16c-406b-b477-db5e2826f0eb None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:41.591772 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf500d3-c16c-406b-b477-db5e2826f0eb None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:41.594443 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 316/626] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:20:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:20:41.595299 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf500d3-c16c-406b-b477-db5e2826f0eb None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:41.606498 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 311/627] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 24 11:20:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:41.607770 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3708e5-5b94-49a5-bb83-8a535d4e15cc None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:41.608057 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3708e5-5b94-49a5-bb83-8a535d4e15cc None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:41.608330 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3708e5-5b94-49a5-bb83-8a535d4e15cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:41.627125 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-6d3708e5-5b94-49a5-bb83-8a535d4e15cc None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:20:41.628323 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-6d3708e5-5b94-49a5-bb83-8a535d4e15cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:20:41.714473 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 312/628] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:20:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 11:20:41.715381 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3708e5-5b94-49a5-bb83-8a535d4e15cc None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:41.738178 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf500d3-c16c-406b-b477-db5e2826f0eb None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:41.757137 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:41.768975 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:41.787608 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9924c750-79f4-4769-b137-9b36728e7e7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:41.788834 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9924c750-79f4-4769-b137-9b36728e7e7e None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:41.789223 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9924c750-79f4-4769-b137-9b36728e7e7e None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:41.789795 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9924c750-79f4-4769-b137-9b36728e7e7e None admin] PATH_INFO: `/v3/users` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:41.790634 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9924c750-79f4-4769-b137-9b36728e7e7e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:20:41.791061 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9924c750-79f4-4769-b137-9b36728e7e7e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:41.793376 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9924c750-79f4-4769-b137-9b36728e7e7e None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:41.823355 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 317/629] 10.222.0.27 () {56 vars in 1133 bytes} [Wed Aug 24 11:20:41 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:41.823355 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9924c750-79f4-4769-b137-9b36728e7e7e None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:41.864817 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3708e5-5b94-49a5-bb83-8a535d4e15cc None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:41.912547 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b227ab04-f03b-47c0-a020-2562669e5f91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:41.913136 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b227ab04-f03b-47c0-a020-2562669e5f91 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:41.913406 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b227ab04-f03b-47c0-a020-2562669e5f91 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:41.913667 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b227ab04-f03b-47c0-a020-2562669e5f91 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:41.922026 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b227ab04-f03b-47c0-a020-2562669e5f91 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:41.924524 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b227ab04-f03b-47c0-a020-2562669e5f91 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:41.940232 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-b227ab04-f03b-47c0-a020-2562669e5f91 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 11:20:41.940232 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:20:41.940232 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:20:41.940232 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:20:41.940232 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:20:41.940232 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:20:41.940232 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:20:41.940232 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:20:41.940232 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:20:41.940232 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:20:41.940232 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:20:41.940232 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:20:41.940232 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 11:20:41.940232 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 11:20:41.940232 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 11:20:41.941209 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 11:20:41.941209 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:20:41.941209 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:20:41.941209 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:20:41.941209 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:20:41.941209 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:20:41.941209 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:20:41.941209 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:20:41.941209 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Aug 24 11:20:41.941209 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:20:41.941209 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:20:41.941209 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:20:41.941209 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:20:41.941209 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:20:41.941209 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:20:41.941209 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:20:41.941209 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:20:41.942125 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 11:20:41.942125 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 11:20:41.942125 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 11:20:41.942125 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 11:20:41.942125 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 11:20:41.942125 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 11:20:41.942125 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 11:20:41.942125 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Aug 24 11:20:41.948739 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 313/630] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Aug 24 11:20:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:20:41.948739 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b227ab04-f03b-47c0-a020-2562669e5f91 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:41.960156 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9924c750-79f4-4769-b137-9b36728e7e7e None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:41.997931 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac90cc9c-3c9a-476e-9e32-e30988e84434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:41.998598 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac90cc9c-3c9a-476e-9e32-e30988e84434 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:41.998878 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac90cc9c-3c9a-476e-9e32-e30988e84434 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:41.999146 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac90cc9c-3c9a-476e-9e32-e30988e84434 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:42.009832 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac90cc9c-3c9a-476e-9e32-e30988e84434 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:20:42.014647 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-ac90cc9c-3c9a-476e-9e32-e30988e84434 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 11:20:42.014647 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:20:42.014647 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:20:42.014647 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:20:42.014647 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:20:42.014647 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:20:42.014647 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:20:42.014647 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:20:42.014647 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:20:42.014647 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:20:42.014647 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:20:42.014647 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:20:42.014647 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:20:42.014647 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:20:42.014647 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:20:42.014647 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:20:42.015552 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:20:42.015552 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:20:42.015552 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:20:42.015552 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:20:42.015552 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:20:42.015552 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:20:42.015552 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:20:42.015552 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:20:42.015552 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:20:42.015552 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:20:42.015552 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:20:42.015552 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Aug 24 11:20:42.015552 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:20:42.015552 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:20:42.015552 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:20:42.015552 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:20:42.016389 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:20:42.016389 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:20:42.016389 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:20:42.016389 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:20:42.016389 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:20:42.016389 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:20:42.016389 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:20:42.016389 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:20:42.016389 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:20:42.016389 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:20:42.016389 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 11:20:42.016389 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:20:42.016389 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 318/631] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Aug 24 11:20:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:20:42.017684 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac90cc9c-3c9a-476e-9e32-e30988e84434 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:42.040687 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:42.062131 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:42.062554 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b227ab04-f03b-47c0-a020-2562669e5f91 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:42.098244 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b25f5c-6adc-4e1f-b28c-54bc44992c4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:42.098893 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b25f5c-6adc-4e1f-b28c-54bc44992c4c None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:42.099166 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b25f5c-6adc-4e1f-b28c-54bc44992c4c None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:42.102136 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b25f5c-6adc-4e1f-b28c-54bc44992c4c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:42.125481 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac90cc9c-3c9a-476e-9e32-e30988e84434 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:42.158922 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba55aef-604b-40f6-a20a-7cfdc5fbf5a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:42.159544 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba55aef-604b-40f6-a20a-7cfdc5fbf5a7 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:42.159898 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba55aef-604b-40f6-a20a-7cfdc5fbf5a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:42.160284 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba55aef-604b-40f6-a20a-7cfdc5fbf5a7 None admin] PATH_INFO: `/v3/projects` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:42.161253 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba55aef-604b-40f6-a20a-7cfdc5fbf5a7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:20:42.161559 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba55aef-604b-40f6-a20a-7cfdc5fbf5a7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:42.163042 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba55aef-604b-40f6-a20a-7cfdc5fbf5a7 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:42.167820 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b25f5c-6adc-4e1f-b28c-54bc44992c4c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:42.169276 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b25f5c-6adc-4e1f-b28c-54bc44992c4c None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:42.174653 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 319/632] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Aug 24 11:20:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:42.175519 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba55aef-604b-40f6-a20a-7cfdc5fbf5a7 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:42.254501 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:42.270800 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:42.274993 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 314/633] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 24 11:20:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 11:20:42.275160 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba55aef-604b-40f6-a20a-7cfdc5fbf5a7 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:42.275818 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b25f5c-6adc-4e1f-b28c-54bc44992c4c None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:42.309381 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b04e84-4e81-4855-8211-b25c406e0572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:42.309944 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b04e84-4e81-4855-8211-b25c406e0572 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:42.310220 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b04e84-4e81-4855-8211-b25c406e0572 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:42.310522 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b04e84-4e81-4855-8211-b25c406e0572 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:42.320579 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b04e84-4e81-4855-8211-b25c406e0572 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:20:42.325836 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-c3b04e84-4e81-4855-8211-b25c406e0572 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 11:20:42.325836 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:20:42.325836 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:20:42.325836 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:20:42.325836 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:20:42.325836 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:20:42.325836 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:20:42.325836 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:20:42.325836 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:20:42.325836 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:20:42.325836 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:20:42.325836 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:20:42.325836 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:20:42.325836 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:20:42.325836 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:20:42.325836 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:20:42.326845 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:20:42.326845 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:20:42.326845 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:20:42.326845 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:20:42.326845 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:20:42.326845 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:20:42.326845 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:20:42.326845 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:20:42.326845 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:20:42.326845 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:20:42.326845 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:20:42.326845 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Aug 24 11:20:42.326845 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:20:42.326845 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:20:42.326845 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:20:42.326845 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:20:42.327673 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:20:42.327673 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:20:42.327673 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:20:42.327673 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:20:42.327673 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:20:42.327673 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:20:42.327673 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:20:42.327673 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:20:42.327673 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:20:42.327673 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:20:42.327673 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 11:20:42.327673 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:20:42.327673 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 320/634] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Aug 24 11:20:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:20:42.328386 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aea051-561c-43c2-a159-b1fb1d36f7fd None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:42.328520 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aea051-561c-43c2-a159-b1fb1d36f7fd None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:42.328847 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aea051-561c-43c2-a159-b1fb1d36f7fd None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:42.330131 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 321/635] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:20:42 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:20:42.330699 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19aea051-561c-43c2-a159-b1fb1d36f7fd None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:42.378682 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b25f5c-6adc-4e1f-b28c-54bc44992c4c None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:42.413032 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2bf1f7-1ffc-4670-a953-b4c3b71dabdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:42.413632 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2bf1f7-1ffc-4670-a953-b4c3b71dabdf None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:42.413906 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2bf1f7-1ffc-4670-a953-b4c3b71dabdf None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:42.414171 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2bf1f7-1ffc-4670-a953-b4c3b71dabdf None admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:42.414864 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2bf1f7-1ffc-4670-a953-b4c3b71dabdf None admin] RBAC: Adding query filter params (name=service) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:20:42.415168 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2bf1f7-1ffc-4670-a953-b4c3b71dabdf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:42.416559 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2bf1f7-1ffc-4670-a953-b4c3b71dabdf None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:42.424643 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 315/636] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Aug 24 11:20:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:42.429738 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2bf1f7-1ffc-4670-a953-b4c3b71dabdf None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:42.431026 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19aea051-561c-43c2-a159-b1fb1d36f7fd None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:42.463432 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b2896c-c130-4ad3-a3ea-e4f8c0525446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:42.464096 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b2896c-c130-4ad3-a3ea-e4f8c0525446 None admin] REQUEST_METHOD: `PUT` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:42.464376 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b2896c-c130-4ad3-a3ea-e4f8c0525446 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:42.464651 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b2896c-c130-4ad3-a3ea-e4f8c0525446 None admin] PATH_INFO: `/v3/projects/317f54a463cb48ab86648c6dcec5db0f/users/f1069558c085449f9e4c9f06013b2a85/roles/217baac59e08499ea2f1b1d84935df0b` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:42.473704 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:42.479598 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b2896c-c130-4ad3-a3ea-e4f8c0525446 None admin] RBAC: Authorizing `identity:create_grant(project_id=317f54a463cb48ab86648c6dcec5db0f, user_id=f1069558c085449f9e4c9f06013b2a85, role_id=217baac59e08499ea2f1b1d84935df0b)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:42.481075 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b2896c-c130-4ad3-a3ea-e4f8c0525446 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:42.493648 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 322/637] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Aug 24 11:20:42 2022] PUT /identity/v3/projects/317f54a463cb48ab86648c6dcec5db0f/users/f1069558c085449f9e4c9f06013b2a85/roles/217baac59e08499ea2f1b1d84935df0b => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:20:42.494875 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3426cec8-5e22-4de3-b258-3e0cf19d6c48 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:42.495175 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3426cec8-5e22-4de3-b258-3e0cf19d6c48 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:42.495419 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3426cec8-5e22-4de3-b258-3e0cf19d6c48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:42.517222 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-3426cec8-5e22-4de3-b258-3e0cf19d6c48 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:20:42.518501 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-3426cec8-5e22-4de3-b258-3e0cf19d6c48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:20:42.520934 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:42.537844 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2bf1f7-1ffc-4670-a953-b4c3b71dabdf None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:42.574718 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bf691c-b433-4daf-83c8-5ea6c5053168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:42.575279 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bf691c-b433-4daf-83c8-5ea6c5053168 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:42.575564 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bf691c-b433-4daf-83c8-5ea6c5053168 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:42.575834 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bf691c-b433-4daf-83c8-5ea6c5053168 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:42.587382 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bf691c-b433-4daf-83c8-5ea6c5053168 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:42.589021 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bf691c-b433-4daf-83c8-5ea6c5053168 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:42.596032 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 323/638] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:20:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 11:20:42.597231 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3426cec8-5e22-4de3-b258-3e0cf19d6c48 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:42.611164 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-60bf691c-b433-4daf-83c8-5ea6c5053168 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:20:42.611164 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:20:42.611164 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:20:42.611164 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:20:42.611164 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:20:42.611164 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:20:42.611164 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:20:42.611164 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:20:42.611164 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:20:42.611164 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:20:42.611164 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:20:42.611164 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:20:42.611164 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 11:20:42.611164 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 11:20:42.611164 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 11:20:42.611164 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 11:20:42.612225 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:20:42.612225 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:20:42.612225 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:20:42.612225 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:20:42.612225 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:20:42.612225 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:20:42.612225 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:20:42.612225 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Aug 24 11:20:42.612225 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:20:42.612225 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:20:42.612225 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:20:42.612225 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:20:42.612225 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:20:42.612225 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:20:42.612225 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:20:42.612225 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:20:42.612225 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 11:20:42.613292 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 11:20:42.613292 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:20:42.613292 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Aug 24 11:20:42.613292 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 316/639] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 11:20:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:20:42.613292 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bf691c-b433-4daf-83c8-5ea6c5053168 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:42.737285 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:42.746049 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bf691c-b433-4daf-83c8-5ea6c5053168 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:42.747453 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3426cec8-5e22-4de3-b258-3e0cf19d6c48 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:42.784352 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24372cd3-ecee-4046-b9b4-31681f631169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:42.785597 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24372cd3-ecee-4046-b9b4-31681f631169 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:42.786082 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24372cd3-ecee-4046-b9b4-31681f631169 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:42.786641 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24372cd3-ecee-4046-b9b4-31681f631169 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:42.792153 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5629c4-e6e3-4091-a831-0c4aad84f005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:42.792763 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5629c4-e6e3-4091-a831-0c4aad84f005 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:42.793037 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5629c4-e6e3-4091-a831-0c4aad84f005 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:42.793304 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5629c4-e6e3-4091-a831-0c4aad84f005 None admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:42.793986 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5629c4-e6e3-4091-a831-0c4aad84f005 None admin] RBAC: Adding query filter params (name=service) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:20:42.794282 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5629c4-e6e3-4091-a831-0c4aad84f005 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:42.795815 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5629c4-e6e3-4091-a831-0c4aad84f005 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:42.803328 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:42.804992 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24372cd3-ecee-4046-b9b4-31681f631169 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:42.806673 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24372cd3-ecee-4046-b9b4-31681f631169 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:42.807886 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 324/640] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Aug 24 11:20:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:42.808944 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5629c4-e6e3-4091-a831-0c4aad84f005 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:42.827444 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-24372cd3-ecee-4046-b9b4-31681f631169 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:20:42.827444 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:20:42.827444 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:20:42.827444 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:20:42.827444 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:20:42.827444 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:20:42.827444 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:20:42.827444 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:20:42.827444 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:20:42.827444 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:20:42.827444 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:20:42.827444 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:20:42.827444 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 11:20:42.827444 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 11:20:42.827444 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 11:20:42.827444 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 11:20:42.828448 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:20:42.828448 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:20:42.828448 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:20:42.828448 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:20:42.828448 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:20:42.828448 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:20:42.828448 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:20:42.828448 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Aug 24 11:20:42.828448 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:20:42.828448 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:20:42.828448 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:20:42.828448 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:20:42.828448 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:20:42.828448 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:20:42.828448 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:20:42.828448 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:20:42.828448 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 11:20:42.829359 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 11:20:42.829359 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:20:42.829359 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Aug 24 11:20:42.829359 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 317/641] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 11:20:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:20:42.830013 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24372cd3-ecee-4046-b9b4-31681f631169 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:42.920061 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5629c4-e6e3-4091-a831-0c4aad84f005 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:42.945664 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24372cd3-ecee-4046-b9b4-31681f631169 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:42.953775 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501ccc21-31b7-440c-8126-2ff3e6c45f13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:42.954541 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501ccc21-31b7-440c-8126-2ff3e6c45f13 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:42.954817 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501ccc21-31b7-440c-8126-2ff3e6c45f13 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:42.955084 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501ccc21-31b7-440c-8126-2ff3e6c45f13 None admin] PATH_INFO: `/v3/domains` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:42.955742 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501ccc21-31b7-440c-8126-2ff3e6c45f13 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:20:42.956042 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501ccc21-31b7-440c-8126-2ff3e6c45f13 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:42.957482 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501ccc21-31b7-440c-8126-2ff3e6c45f13 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:42.974836 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 325/642] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 24 11:20:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:42.975591 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501ccc21-31b7-440c-8126-2ff3e6c45f13 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:42.984105 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2968b74-5250-4cb5-9785-4e63b0b022fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:42.984766 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2968b74-5250-4cb5-9785-4e63b0b022fd None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:42.985044 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2968b74-5250-4cb5-9785-4e63b0b022fd None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:42.985310 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2968b74-5250-4cb5-9785-4e63b0b022fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:42.996332 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2968b74-5250-4cb5-9785-4e63b0b022fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:42.997803 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2968b74-5250-4cb5-9785-4e63b0b022fd None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:43.004362 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:43.012274 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-d2968b74-5250-4cb5-9785-4e63b0b022fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:20:43.012274 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:20:43.012274 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:20:43.012274 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:20:43.012274 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:20:43.012274 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:20:43.012274 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:20:43.012274 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:20:43.012274 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:20:43.012274 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:20:43.012274 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:20:43.012274 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:20:43.012274 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 11:20:43.012274 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 11:20:43.012274 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 11:20:43.012274 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 11:20:43.013523 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:20:43.013523 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:20:43.013523 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:20:43.013523 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:20:43.013523 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:20:43.013523 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:20:43.013523 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:20:43.013523 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Aug 24 11:20:43.013523 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:20:43.013523 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:20:43.013523 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:20:43.013523 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:20:43.013523 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:20:43.013523 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:20:43.013523 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:20:43.013523 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:20:43.013523 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 11:20:43.014707 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 11:20:43.014707 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:20:43.014707 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Aug 24 11:20:43.021033 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 318/643] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 11:20:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:20:43.022149 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2968b74-5250-4cb5-9785-4e63b0b022fd None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:43.044332 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:43.086177 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501ccc21-31b7-440c-8126-2ff3e6c45f13 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:43.125647 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2968b74-5250-4cb5-9785-4e63b0b022fd None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:43.128066 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6231fe85-aeed-4b6c-bbc2-048aeeca9ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:43.128832 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6231fe85-aeed-4b6c-bbc2-048aeeca9ba0 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:43.129110 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6231fe85-aeed-4b6c-bbc2-048aeeca9ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:43.129380 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6231fe85-aeed-4b6c-bbc2-048aeeca9ba0 None admin] PATH_INFO: `/v3/domains` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:43.130029 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6231fe85-aeed-4b6c-bbc2-048aeeca9ba0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:20:43.130329 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6231fe85-aeed-4b6c-bbc2-048aeeca9ba0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:43.131762 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6231fe85-aeed-4b6c-bbc2-048aeeca9ba0 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:43.147797 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 326/644] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 24 11:20:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:43.147797 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6231fe85-aeed-4b6c-bbc2-048aeeca9ba0 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:43.166741 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7120dd4-cbfe-41fb-9b4a-a913cdff6324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:43.167376 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7120dd4-cbfe-41fb-9b4a-a913cdff6324 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:43.167651 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7120dd4-cbfe-41fb-9b4a-a913cdff6324 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:43.167922 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7120dd4-cbfe-41fb-9b4a-a913cdff6324 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:43.178937 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7120dd4-cbfe-41fb-9b4a-a913cdff6324 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:20:43.184038 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-f7120dd4-cbfe-41fb-9b4a-a913cdff6324 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 11:20:43.184038 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:20:43.184038 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:20:43.184038 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:20:43.184038 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:20:43.184038 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:20:43.184038 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:20:43.184038 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:20:43.184038 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:20:43.184038 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:20:43.184038 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:20:43.184038 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:20:43.184038 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:20:43.184038 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:20:43.184038 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:20:43.184038 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:20:43.185003 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:20:43.185003 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:20:43.185003 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:20:43.185003 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:20:43.185003 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:20:43.185003 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:20:43.185003 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:20:43.185003 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:20:43.185003 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:20:43.185003 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:20:43.185003 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:20:43.185003 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Aug 24 11:20:43.185003 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:20:43.185003 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:20:43.185003 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:20:43.185003 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:20:43.186000 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:20:43.186000 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:20:43.186000 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:20:43.186000 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:20:43.186000 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:20:43.186000 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:20:43.186000 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:20:43.186000 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:20:43.186000 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:20:43.186000 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:20:43.186000 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 11:20:43.186000 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Aug 24 11:20:43.186000 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 319/645] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Aug 24 11:20:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:20:43.186816 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7120dd4-cbfe-41fb-9b4a-a913cdff6324 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:43.246400 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:43.256306 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6231fe85-aeed-4b6c-bbc2-048aeeca9ba0 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:43.282566 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:43.290074 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7120dd4-cbfe-41fb-9b4a-a913cdff6324 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:43.300977 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4193f9ea-b5c7-4f75-ab87-ae13b340f0db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:43.301764 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4193f9ea-b5c7-4f75-ab87-ae13b340f0db None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:43.302044 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4193f9ea-b5c7-4f75-ab87-ae13b340f0db None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:43.302314 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4193f9ea-b5c7-4f75-ab87-ae13b340f0db None admin] PATH_INFO: `/v3/projects/service` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:43.309133 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4193f9ea-b5c7-4f75-ab87-ae13b340f0db None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:43.310642 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4193f9ea-b5c7-4f75-ab87-ae13b340f0db None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:43.321813 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-4193f9ea-b5c7-4f75-ab87-ae13b340f0db None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 11:20:43.321813 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:20:43.321813 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:20:43.321813 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:20:43.321813 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:20:43.321813 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:20:43.321813 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:20:43.321813 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:20:43.321813 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:20:43.321813 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:20:43.321813 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:20:43.321813 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:20:43.321813 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 11:20:43.321813 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 11:20:43.321813 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 11:20:43.322701 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 11:20:43.322701 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:20:43.322701 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:20:43.322701 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:20:43.322701 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:20:43.322701 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:20:43.322701 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:20:43.322701 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:20:43.322701 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Aug 24 11:20:43.322701 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:20:43.322701 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:20:43.322701 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:20:43.322701 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:20:43.322701 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:20:43.322701 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:20:43.322701 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:20:43.322701 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:20:43.323602 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 11:20:43.323602 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 11:20:43.323602 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 11:20:43.323602 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 11:20:43.323602 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 11:20:43.323602 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 11:20:43.323602 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 11:20:43.323602 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:20:43.323602 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 327/646] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Aug 24 11:20:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:20:43.324678 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4193f9ea-b5c7-4f75-ab87-ae13b340f0db None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:43.328786 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd232b4-92c4-44ec-be72-8de44592d799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:43.329390 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd232b4-92c4-44ec-be72-8de44592d799 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:43.329667 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd232b4-92c4-44ec-be72-8de44592d799 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:43.329937 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd232b4-92c4-44ec-be72-8de44592d799 None admin] PATH_INFO: `/v3/domains` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:43.330620 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd232b4-92c4-44ec-be72-8de44592d799 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:20:43.330924 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd232b4-92c4-44ec-be72-8de44592d799 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:43.332370 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd232b4-92c4-44ec-be72-8de44592d799 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:43.349167 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 320/647] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 24 11:20:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:43.349167 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd232b4-92c4-44ec-be72-8de44592d799 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:43.437204 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4193f9ea-b5c7-4f75-ab87-ae13b340f0db None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:43.445135 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd232b4-92c4-44ec-be72-8de44592d799 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:43.466304 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:43.475408 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04301984-699c-441e-94b6-457b5a30097d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:43.476076 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04301984-699c-441e-94b6-457b5a30097d None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:43.476330 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04301984-699c-441e-94b6-457b5a30097d None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:43.476614 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04301984-699c-441e-94b6-457b5a30097d None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:43.484529 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04301984-699c-441e-94b6-457b5a30097d None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:43.485384 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940cade3-61c1-4098-9053-9baef8a02e05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:43.485976 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04301984-699c-441e-94b6-457b5a30097d None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:43.486079 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940cade3-61c1-4098-9053-9baef8a02e05 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:43.486269 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940cade3-61c1-4098-9053-9baef8a02e05 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:43.486571 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940cade3-61c1-4098-9053-9baef8a02e05 None admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:43.487246 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940cade3-61c1-4098-9053-9baef8a02e05 None admin] RBAC: Adding query filter params (name=service) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:20:43.487548 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940cade3-61c1-4098-9053-9baef8a02e05 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:43.489019 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940cade3-61c1-4098-9053-9baef8a02e05 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:43.501959 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 321/648] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Aug 24 11:20:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:43.502131 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-04301984-699c-441e-94b6-457b5a30097d None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 11:20:43.502131 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:20:43.502131 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:20:43.502131 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:20:43.502131 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:20:43.502131 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:20:43.502131 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:20:43.502131 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:20:43.502131 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:20:43.502131 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:20:43.502131 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:20:43.502131 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:20:43.502131 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 11:20:43.502131 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 11:20:43.502131 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 11:20:43.502131 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 11:20:43.503920 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:20:43.503920 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:20:43.503920 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 11:20:43.503920 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 11:20:43.503920 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 11:20:43.503920 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 11:20:43.503920 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:20:43.503920 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:20:43.503920 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:20:43.503920 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:20:43.503920 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:20:43.503920 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Aug 24 11:20:43.503920 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:20:43.503920 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:20:43.503920 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:20:43.503920 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:20:43.503920 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:20:43.503920 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:20:43.504859 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:20:43.504859 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:20:43.504859 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 11:20:43.504859 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 11:20:43.504859 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 11:20:43.504859 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 11:20:43.504859 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 11:20:43.504859 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 11:20:43.504859 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 11:20:43.504859 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:20:43.505431 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940cade3-61c1-4098-9053-9baef8a02e05 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:43.505516 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 328/649] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Aug 24 11:20:43 2022] GET /identity/v3/users/neutron => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:20:43.505516 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04301984-699c-441e-94b6-457b5a30097d None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:43.547662 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:43.608196 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940cade3-61c1-4098-9053-9baef8a02e05 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:43.610970 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04301984-699c-441e-94b6-457b5a30097d None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:43.643322 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc07006-6c6f-4235-a926-9a5150a28fc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:43.643917 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc07006-6c6f-4235-a926-9a5150a28fc7 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:43.644224 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc07006-6c6f-4235-a926-9a5150a28fc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:43.644490 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc07006-6c6f-4235-a926-9a5150a28fc7 None admin] PATH_INFO: `/v3/projects` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:43.645178 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc07006-6c6f-4235-a926-9a5150a28fc7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:20:43.645479 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc07006-6c6f-4235-a926-9a5150a28fc7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:43.646874 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83508cc3-9c0c-44ab-af75-2f03b89d5bd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:43.646990 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc07006-6c6f-4235-a926-9a5150a28fc7 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:43.647494 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83508cc3-9c0c-44ab-af75-2f03b89d5bd4 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:43.647767 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83508cc3-9c0c-44ab-af75-2f03b89d5bd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:43.648032 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83508cc3-9c0c-44ab-af75-2f03b89d5bd4 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:43.656263 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83508cc3-9c0c-44ab-af75-2f03b89d5bd4 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:43.657708 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83508cc3-9c0c-44ab-af75-2f03b89d5bd4 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:43.664271 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 322/650] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Aug 24 11:20:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:43.665224 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc07006-6c6f-4235-a926-9a5150a28fc7 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:43.669462 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-83508cc3-9c0c-44ab-af75-2f03b89d5bd4 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 11:20:43.669462 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:20:43.669462 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:20:43.669462 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:20:43.669462 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:20:43.669462 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:20:43.669462 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:20:43.669462 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:20:43.669462 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:20:43.669462 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:20:43.669462 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:20:43.669462 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:20:43.669462 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 11:20:43.669462 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 11:20:43.669462 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 11:20:43.669462 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 11:20:43.670398 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:20:43.670398 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:20:43.670398 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 11:20:43.670398 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 11:20:43.670398 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 11:20:43.670398 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 11:20:43.670398 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:20:43.670398 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:20:43.670398 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:20:43.670398 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:20:43.670398 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:20:43.670398 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Aug 24 11:20:43.670398 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:20:43.670398 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:20:43.670398 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:20:43.670398 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:20:43.670398 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:20:43.670398 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:20:43.671358 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:20:43.671358 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:20:43.671358 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 11:20:43.671358 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 11:20:43.671358 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 11:20:43.671358 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 11:20:43.671358 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 11:20:43.671358 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 11:20:43.671358 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 11:20:43.671358 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:20:43.671358 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 329/651] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 24 11:20:43 2022] GET /identity/v3/users/cinder => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:20:43.671963 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83508cc3-9c0c-44ab-af75-2f03b89d5bd4 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:43.710906 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:43.770900 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc07006-6c6f-4235-a926-9a5150a28fc7 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:43.772029 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:43.775057 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83508cc3-9c0c-44ab-af75-2f03b89d5bd4 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:43.813458 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c7a1c7-bf89-4d28-8f35-5a5a03f26d39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:43.813867 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c5d7ae-5bbb-4a0b-99b6-c2e9e190ff30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:43.814087 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c7a1c7-bf89-4d28-8f35-5a5a03f26d39 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:43.814331 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c7a1c7-bf89-4d28-8f35-5a5a03f26d39 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:43.814518 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c5d7ae-5bbb-4a0b-99b6-c2e9e190ff30 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:43.814671 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c7a1c7-bf89-4d28-8f35-5a5a03f26d39 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:43.814762 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c5d7ae-5bbb-4a0b-99b6-c2e9e190ff30 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:43.814991 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c5d7ae-5bbb-4a0b-99b6-c2e9e190ff30 None admin] PATH_INFO: `/v3/users` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:43.815729 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c5d7ae-5bbb-4a0b-99b6-c2e9e190ff30 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:20:43.816081 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c5d7ae-5bbb-4a0b-99b6-c2e9e190ff30 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:43.818005 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c5d7ae-5bbb-4a0b-99b6-c2e9e190ff30 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:43.825306 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c7a1c7-bf89-4d28-8f35-5a5a03f26d39 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:43.826795 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c7a1c7-bf89-4d28-8f35-5a5a03f26d39 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:43.837814 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 323/652] 10.222.0.27 () {56 vars in 1139 bytes} [Wed Aug 24 11:20:43 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:43.838954 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c5d7ae-5bbb-4a0b-99b6-c2e9e190ff30 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:43.841038 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-89c7a1c7-bf89-4d28-8f35-5a5a03f26d39 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:20:43.841038 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:20:43.841038 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:20:43.841038 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:20:43.841038 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:20:43.841038 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:20:43.841038 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:20:43.841038 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:20:43.841038 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:20:43.841038 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:20:43.841038 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:20:43.841038 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:20:43.841038 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 11:20:43.841038 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 11:20:43.841038 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 11:20:43.841038 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 11:20:43.841986 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:20:43.841986 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:20:43.841986 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:20:43.841986 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:20:43.841986 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:20:43.841986 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:20:43.841986 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:20:43.841986 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Aug 24 11:20:43.841986 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:20:43.841986 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:20:43.841986 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:20:43.841986 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:20:43.841986 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:20:43.841986 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:20:43.841986 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:20:43.841986 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:20:43.841986 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 11:20:43.843352 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 11:20:43.843352 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:20:43.843352 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:20:43.843352 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 330/653] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 11:20:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:20:43.843352 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c7a1c7-bf89-4d28-8f35-5a5a03f26d39 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:43.953768 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c7a1c7-bf89-4d28-8f35-5a5a03f26d39 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:43.954684 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:43.959329 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c5d7ae-5bbb-4a0b-99b6-c2e9e190ff30 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:43.989213 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edca2dc-3993-4391-98f5-d84729c61ed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:43.989828 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edca2dc-3993-4391-98f5-d84729c61ed3 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:43.990103 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edca2dc-3993-4391-98f5-d84729c61ed3 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:43.990380 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edca2dc-3993-4391-98f5-d84729c61ed3 None admin] PATH_INFO: `/v3/users` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:43.991127 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edca2dc-3993-4391-98f5-d84729c61ed3 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:20:43.991439 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edca2dc-3993-4391-98f5-d84729c61ed3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:43.992888 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edca2dc-3993-4391-98f5-d84729c61ed3 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:44.004177 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6423c7f8-189e-4bf6-a77e-9bb764aa1c85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:44.005002 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6423c7f8-189e-4bf6-a77e-9bb764aa1c85 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:44.005419 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6423c7f8-189e-4bf6-a77e-9bb764aa1c85 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:44.005848 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6423c7f8-189e-4bf6-a77e-9bb764aa1c85 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:44.006790 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6423c7f8-189e-4bf6-a77e-9bb764aa1c85 None admin] RBAC: Adding query filter params (role.id=217baac59e08499ea2f1b1d84935df0b, scope.project.id=317f54a463cb48ab86648c6dcec5db0f, user.id=282ec32864d046b2bea170f6a3845cc0) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:20:44.007782 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6423c7f8-189e-4bf6-a77e-9bb764aa1c85 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:44.009738 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6423c7f8-189e-4bf6-a77e-9bb764aa1c85 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:44.010533 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 331/654] 10.222.0.27 () {56 vars in 1137 bytes} [Wed Aug 24 11:20:43 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:44.011435 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edca2dc-3993-4391-98f5-d84729c61ed3 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:44.020125 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 324/655] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Aug 24 11:20:43 2022] GET /identity/v3/role_assignments?user.id=282ec32864d046b2bea170f6a3845cc0&scope.project.id=317f54a463cb48ab86648c6dcec5db0f&role.id=217baac59e08499ea2f1b1d84935df0b => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:44.020969 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6423c7f8-189e-4bf6-a77e-9bb764aa1c85 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:44.041313 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:44.161453 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edca2dc-3993-4391-98f5-d84729c61ed3 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:44.161955 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6423c7f8-189e-4bf6-a77e-9bb764aa1c85 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:44.209443 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f11a5cd-7496-4d8d-9926-59324a3e3b78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:44.209986 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f11a5cd-7496-4d8d-9926-59324a3e3b78 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:44.210258 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f11a5cd-7496-4d8d-9926-59324a3e3b78 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:44.210567 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f11a5cd-7496-4d8d-9926-59324a3e3b78 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:44.217635 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dc1217-58e7-46fd-a6a8-fbc0b454eb78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:44.218256 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dc1217-58e7-46fd-a6a8-fbc0b454eb78 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:44.218564 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dc1217-58e7-46fd-a6a8-fbc0b454eb78 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:44.218832 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dc1217-58e7-46fd-a6a8-fbc0b454eb78 None admin] PATH_INFO: `/v3/domains` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:44.219482 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dc1217-58e7-46fd-a6a8-fbc0b454eb78 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:20:44.219778 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dc1217-58e7-46fd-a6a8-fbc0b454eb78 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:44.221157 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dc1217-58e7-46fd-a6a8-fbc0b454eb78 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:44.239573 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 325/656] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 24 11:20:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:44.240875 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dc1217-58e7-46fd-a6a8-fbc0b454eb78 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:44.273360 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:44.295142 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f11a5cd-7496-4d8d-9926-59324a3e3b78 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:44.297332 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f11a5cd-7496-4d8d-9926-59324a3e3b78 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:44.312947 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:44.369139 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dc1217-58e7-46fd-a6a8-fbc0b454eb78 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:44.416167 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363948f0-a6ba-487c-99f4-7b033ff8b248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:44.416774 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363948f0-a6ba-487c-99f4-7b033ff8b248 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:44.416949 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 332/657] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 24 11:20:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 11:20:44.417060 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363948f0-a6ba-487c-99f4-7b033ff8b248 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:44.417293 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363948f0-a6ba-487c-99f4-7b033ff8b248 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:44.417775 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f11a5cd-7496-4d8d-9926-59324a3e3b78 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:44.493075 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363948f0-a6ba-487c-99f4-7b033ff8b248 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:44.494942 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363948f0-a6ba-487c-99f4-7b033ff8b248 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:44.516829 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f11a5cd-7496-4d8d-9926-59324a3e3b78 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:44.521155 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:44.531074 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:44.555388 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88e4191-8c54-47f4-bad1-a9f013c8c15d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:44.556017 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88e4191-8c54-47f4-bad1-a9f013c8c15d None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:44.556288 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88e4191-8c54-47f4-bad1-a9f013c8c15d None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:44.556550 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88e4191-8c54-47f4-bad1-a9f013c8c15d None admin] PATH_INFO: `/v3/users/glance` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:44.563470 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88e4191-8c54-47f4-bad1-a9f013c8c15d None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:44.564914 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88e4191-8c54-47f4-bad1-a9f013c8c15d None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:44.576301 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-c88e4191-8c54-47f4-bad1-a9f013c8c15d None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 24 11:20:44.576301 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:20:44.576301 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:20:44.576301 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:20:44.576301 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:20:44.576301 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:20:44.576301 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:20:44.576301 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:20:44.576301 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:20:44.576301 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:20:44.576301 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:20:44.576301 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:20:44.576301 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 11:20:44.576301 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 11:20:44.576301 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 11:20:44.576301 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 11:20:44.577257 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:20:44.577257 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:20:44.577257 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 11:20:44.577257 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 11:20:44.577257 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 11:20:44.577257 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 11:20:44.577257 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:20:44.577257 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:20:44.577257 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:20:44.577257 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:20:44.577257 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:20:44.577257 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Aug 24 11:20:44.577257 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:20:44.577257 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:20:44.577257 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:20:44.577257 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:20:44.577257 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:20:44.577257 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:20:44.578206 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:20:44.578206 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:20:44.578206 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 11:20:44.578206 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 11:20:44.578206 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 11:20:44.578206 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 11:20:44.578206 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 11:20:44.578206 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 11:20:44.578206 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 24 11:20:44.578206 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:20:44.578206 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 333/658] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 24 11:20:44 2022] GET /identity/v3/users/glance => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:20:44.578206 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88e4191-8c54-47f4-bad1-a9f013c8c15d None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:44.613460 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 326/659] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 24 11:20:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 11:20:44.613460 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad1084f-87c6-4cae-be90-45c482203b14 None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:44.613460 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad1084f-87c6-4cae-be90-45c482203b14 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:44.613460 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad1084f-87c6-4cae-be90-45c482203b14 None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:44.613460 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 327/660] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:20:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:20:44.613460 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad1084f-87c6-4cae-be90-45c482203b14 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:44.681298 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88e4191-8c54-47f4-bad1-a9f013c8c15d None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:44.715904 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d0414e-f4d4-4d1a-b5ec-3dadae5dbfab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:44.716740 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d0414e-f4d4-4d1a-b5ec-3dadae5dbfab None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:44.717020 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d0414e-f4d4-4d1a-b5ec-3dadae5dbfab None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:44.717287 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d0414e-f4d4-4d1a-b5ec-3dadae5dbfab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:44.717783 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad1084f-87c6-4cae-be90-45c482203b14 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:44.728591 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d0414e-f4d4-4d1a-b5ec-3dadae5dbfab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:44.730396 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d0414e-f4d4-4d1a-b5ec-3dadae5dbfab None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:44.744027 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:44.744799 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-29d0414e-f4d4-4d1a-b5ec-3dadae5dbfab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:20:44.744799 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:20:44.744799 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:20:44.744799 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:20:44.744799 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:20:44.744799 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:20:44.744799 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:20:44.744799 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:20:44.744799 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:20:44.744799 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:20:44.744799 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:20:44.744799 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:20:44.744799 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 11:20:44.744799 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 11:20:44.744799 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 11:20:44.744799 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 11:20:44.745736 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:20:44.745736 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:20:44.745736 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:20:44.745736 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:20:44.745736 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:20:44.745736 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:20:44.745736 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:20:44.745736 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Aug 24 11:20:44.745736 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:20:44.745736 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:20:44.745736 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:20:44.745736 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:20:44.745736 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:20:44.745736 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:20:44.745736 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:20:44.745736 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:20:44.745736 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 11:20:44.746672 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 11:20:44.746672 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:20:44.746672 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:20:44.746672 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 334/661] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 11:20:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:20:44.750310 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d0414e-f4d4-4d1a-b5ec-3dadae5dbfab None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:44.762531 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4151e1d3-440d-4bde-9f1e-54d7269d9858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:44.763216 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4151e1d3-440d-4bde-9f1e-54d7269d9858 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:44.763493 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4151e1d3-440d-4bde-9f1e-54d7269d9858 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:44.763779 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4151e1d3-440d-4bde-9f1e-54d7269d9858 None admin] PATH_INFO: `/v3/users` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:44.764482 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4151e1d3-440d-4bde-9f1e-54d7269d9858 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:20:44.764798 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4151e1d3-440d-4bde-9f1e-54d7269d9858 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:44.766244 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4151e1d3-440d-4bde-9f1e-54d7269d9858 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:44.772742 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:44.785410 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 328/662] 10.222.0.27 () {56 vars in 1137 bytes} [Wed Aug 24 11:20:44 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:44.791321 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23efa8b6-6284-45ae-beb0-00753a952f22 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:44.791602 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23efa8b6-6284-45ae-beb0-00753a952f22 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:44.791874 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23efa8b6-6284-45ae-beb0-00753a952f22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:44.810021 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-23efa8b6-6284-45ae-beb0-00753a952f22 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:20:44.811264 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-23efa8b6-6284-45ae-beb0-00753a952f22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:20:44.854273 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d0414e-f4d4-4d1a-b5ec-3dadae5dbfab None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:44.880683 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 329/663] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:20:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 11:20:44.881552 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23efa8b6-6284-45ae-beb0-00753a952f22 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:44.898403 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfab3d6-aa56-4b87-bf44-458eef6b45c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:44.899350 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfab3d6-aa56-4b87-bf44-458eef6b45c7 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:44.899853 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfab3d6-aa56-4b87-bf44-458eef6b45c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:44.900317 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfab3d6-aa56-4b87-bf44-458eef6b45c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:44.911566 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfab3d6-aa56-4b87-bf44-458eef6b45c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:44.913268 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfab3d6-aa56-4b87-bf44-458eef6b45c7 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:44.927723 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-5bfab3d6-aa56-4b87-bf44-458eef6b45c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:20:44.927723 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:20:44.927723 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:20:44.927723 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:20:44.927723 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:20:44.927723 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:20:44.927723 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:20:44.927723 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:20:44.927723 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:20:44.927723 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:20:44.927723 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:20:44.927723 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:20:44.927723 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 11:20:44.927723 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 11:20:44.927723 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 11:20:44.927723 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 11:20:44.928681 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:20:44.928681 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:20:44.928681 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:20:44.928681 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:20:44.928681 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:20:44.928681 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:20:44.928681 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:20:44.928681 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Aug 24 11:20:44.928681 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:20:44.928681 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:20:44.928681 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:20:44.928681 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:20:44.928681 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:20:44.928681 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:20:44.928681 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:20:44.928681 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:20:44.928681 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 11:20:44.929590 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 11:20:44.929590 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:20:44.929590 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:20:44.931316 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 335/664] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 11:20:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:20:44.932285 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfab3d6-aa56-4b87-bf44-458eef6b45c7 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:44.999992 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23efa8b6-6284-45ae-beb0-00753a952f22 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:45.012063 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:45.016084 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:45.042106 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ba56d0-fab2-45cf-9d46-1e498b86c1d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:45.043145 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ba56d0-fab2-45cf-9d46-1e498b86c1d7 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:45.043662 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ba56d0-fab2-45cf-9d46-1e498b86c1d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:45.044127 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ba56d0-fab2-45cf-9d46-1e498b86c1d7 None admin] PATH_INFO: `/v3/domains` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:45.045549 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ba56d0-fab2-45cf-9d46-1e498b86c1d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:20:45.046043 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ba56d0-fab2-45cf-9d46-1e498b86c1d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:45.046148 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfab3d6-aa56-4b87-bf44-458eef6b45c7 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:45.047856 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ba56d0-fab2-45cf-9d46-1e498b86c1d7 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:45.060281 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 330/665] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 24 11:20:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:45.061512 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ba56d0-fab2-45cf-9d46-1e498b86c1d7 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:45.081934 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df1fef2-8cdd-4a9d-a004-258f051ca322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:45.082594 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df1fef2-8cdd-4a9d-a004-258f051ca322 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:45.082874 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df1fef2-8cdd-4a9d-a004-258f051ca322 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:45.083143 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df1fef2-8cdd-4a9d-a004-258f051ca322 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:45.168200 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df1fef2-8cdd-4a9d-a004-258f051ca322 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:45.169870 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df1fef2-8cdd-4a9d-a004-258f051ca322 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:45.176269 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ba56d0-fab2-45cf-9d46-1e498b86c1d7 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:45.212310 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e00c7c-8923-4d65-8b8f-451c0652d764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:45.212783 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e00c7c-8923-4d65-8b8f-451c0652d764 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:45.213058 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e00c7c-8923-4d65-8b8f-451c0652d764 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:45.213321 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e00c7c-8923-4d65-8b8f-451c0652d764 None admin] PATH_INFO: `/v3/domains` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:45.213957 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e00c7c-8923-4d65-8b8f-451c0652d764 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:20:45.214252 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e00c7c-8923-4d65-8b8f-451c0652d764 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:45.215669 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e00c7c-8923-4d65-8b8f-451c0652d764 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:45.228226 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 331/666] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 24 11:20:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:45.228961 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e00c7c-8923-4d65-8b8f-451c0652d764 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:45.252635 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:45.260766 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:45.281627 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 336/667] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 24 11:20:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 11:20:45.282293 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df1fef2-8cdd-4a9d-a004-258f051ca322 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:45.336947 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e00c7c-8923-4d65-8b8f-451c0652d764 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:45.373352 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8881b0ae-6507-46d3-bbef-9fe2e2669375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:45.374243 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8881b0ae-6507-46d3-bbef-9fe2e2669375 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:45.374548 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8881b0ae-6507-46d3-bbef-9fe2e2669375 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:45.374821 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8881b0ae-6507-46d3-bbef-9fe2e2669375 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:45.382570 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8881b0ae-6507-46d3-bbef-9fe2e2669375 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:45.384032 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8881b0ae-6507-46d3-bbef-9fe2e2669375 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:45.384145 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df1fef2-8cdd-4a9d-a004-258f051ca322 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:45.396106 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-8881b0ae-6507-46d3-bbef-9fe2e2669375 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 11:20:45.396106 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:20:45.396106 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:20:45.396106 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:20:45.396106 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:20:45.396106 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:20:45.396106 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:20:45.396106 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:20:45.396106 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:20:45.396106 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:20:45.396106 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:20:45.396106 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:20:45.396106 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 11:20:45.396106 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 11:20:45.396106 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 11:20:45.396985 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 11:20:45.396985 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:20:45.396985 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:20:45.396985 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:20:45.396985 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:20:45.396985 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:20:45.396985 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:20:45.396985 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:20:45.396985 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Aug 24 11:20:45.396985 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:20:45.396985 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:20:45.396985 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:20:45.396985 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:20:45.396985 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:20:45.396985 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:20:45.396985 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:20:45.396985 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:20:45.397864 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 11:20:45.397864 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 11:20:45.397864 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 11:20:45.397864 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 11:20:45.397864 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 11:20:45.397864 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 11:20:45.397864 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 11:20:45.397864 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Aug 24 11:20:45.397864 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 332/668] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Aug 24 11:20:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:20:45.398338 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8881b0ae-6507-46d3-bbef-9fe2e2669375 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:45.424440 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c173769c-f1fb-491d-83cf-f45d9503a6a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:45.425411 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c173769c-f1fb-491d-83cf-f45d9503a6a9 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:45.425692 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c173769c-f1fb-491d-83cf-f45d9503a6a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:45.426222 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c173769c-f1fb-491d-83cf-f45d9503a6a9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:45.438788 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c173769c-f1fb-491d-83cf-f45d9503a6a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:20:45.445054 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-c173769c-f1fb-491d-83cf-f45d9503a6a9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 11:20:45.445054 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:20:45.445054 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:20:45.445054 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:20:45.445054 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:20:45.445054 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:20:45.445054 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:20:45.445054 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:20:45.445054 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:20:45.445054 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:20:45.445054 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:20:45.445054 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:20:45.445054 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:20:45.445054 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:20:45.445054 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:20:45.445054 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:20:45.445973 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:20:45.445973 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:20:45.445973 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:20:45.445973 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:20:45.445973 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:20:45.445973 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:20:45.445973 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:20:45.445973 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:20:45.445973 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:20:45.445973 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:20:45.445973 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:20:45.445973 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Aug 24 11:20:45.445973 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:20:45.445973 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:20:45.445973 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:20:45.445973 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:20:45.446889 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:20:45.446889 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:20:45.446889 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:20:45.446889 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:20:45.446889 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:20:45.446889 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:20:45.446889 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:20:45.446889 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:20:45.446889 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:20:45.446889 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:20:45.446889 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 11:20:45.446889 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:20:45.447522 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 337/669] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Aug 24 11:20:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:20:45.448161 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c173769c-f1fb-491d-83cf-f45d9503a6a9 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:45.484364 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:45.495307 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:45.506914 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8881b0ae-6507-46d3-bbef-9fe2e2669375 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:45.542205 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68864c6b-cd6e-4137-94c9-eed754f82e5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:45.542619 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68864c6b-cd6e-4137-94c9-eed754f82e5d None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:45.542891 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68864c6b-cd6e-4137-94c9-eed754f82e5d None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:45.543257 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68864c6b-cd6e-4137-94c9-eed754f82e5d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:45.550967 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68864c6b-cd6e-4137-94c9-eed754f82e5d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:45.552563 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68864c6b-cd6e-4137-94c9-eed754f82e5d None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:45.560910 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c173769c-f1fb-491d-83cf-f45d9503a6a9 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:45.563931 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-68864c6b-cd6e-4137-94c9-eed754f82e5d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 11:20:45.563931 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:20:45.563931 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:20:45.563931 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:20:45.563931 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:20:45.563931 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:20:45.563931 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:20:45.563931 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:20:45.563931 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:20:45.563931 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:20:45.563931 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:20:45.563931 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:20:45.563931 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 11:20:45.563931 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 11:20:45.563931 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 11:20:45.565018 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 11:20:45.565018 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:20:45.565018 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:20:45.565018 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:20:45.565018 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:20:45.565018 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:20:45.565018 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:20:45.565018 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:20:45.565018 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Aug 24 11:20:45.565018 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:20:45.565018 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:20:45.565018 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:20:45.565018 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:20:45.565018 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:20:45.565018 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:20:45.565018 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:20:45.565018 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:20:45.565985 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 11:20:45.565985 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 11:20:45.565985 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 11:20:45.565985 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 11:20:45.565985 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 11:20:45.565985 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 11:20:45.565985 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 11:20:45.565985 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Aug 24 11:20:45.565985 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 333/670] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Aug 24 11:20:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:20:45.566508 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68864c6b-cd6e-4137-94c9-eed754f82e5d None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:45.606201 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076bd93b-02d3-48ff-a09c-dd838fb5ac51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:45.606865 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076bd93b-02d3-48ff-a09c-dd838fb5ac51 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:45.607588 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076bd93b-02d3-48ff-a09c-dd838fb5ac51 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:45.607868 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076bd93b-02d3-48ff-a09c-dd838fb5ac51 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:45.624264 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076bd93b-02d3-48ff-a09c-dd838fb5ac51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:45.626988 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076bd93b-02d3-48ff-a09c-dd838fb5ac51 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:45.643676 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-076bd93b-02d3-48ff-a09c-dd838fb5ac51 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:20:45.643676 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:20:45.643676 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:20:45.643676 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:20:45.643676 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:20:45.643676 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:20:45.643676 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:20:45.643676 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:20:45.643676 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:20:45.643676 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:20:45.643676 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:20:45.643676 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:20:45.643676 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 11:20:45.643676 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 11:20:45.643676 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 11:20:45.643676 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 11:20:45.644777 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:20:45.644777 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:20:45.644777 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:20:45.644777 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:20:45.644777 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:20:45.644777 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:20:45.644777 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:20:45.644777 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Aug 24 11:20:45.644777 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:20:45.644777 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:20:45.644777 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:20:45.644777 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:20:45.644777 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:20:45.644777 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:20:45.644777 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:20:45.644777 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:20:45.644777 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 11:20:45.645670 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 11:20:45.645670 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:20:45.645670 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:20:45.645670 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 338/671] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 11:20:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:20:45.645670 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076bd93b-02d3-48ff-a09c-dd838fb5ac51 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:45.676975 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68864c6b-cd6e-4137-94c9-eed754f82e5d None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:45.712181 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce06c884-9cf1-44a5-88bd-f92fdad2c7d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:45.712779 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce06c884-9cf1-44a5-88bd-f92fdad2c7d3 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:45.713067 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce06c884-9cf1-44a5-88bd-f92fdad2c7d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:45.713320 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce06c884-9cf1-44a5-88bd-f92fdad2c7d3 None admin] PATH_INFO: `/v3/projects` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:45.714014 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce06c884-9cf1-44a5-88bd-f92fdad2c7d3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:20:45.714316 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce06c884-9cf1-44a5-88bd-f92fdad2c7d3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:45.715868 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce06c884-9cf1-44a5-88bd-f92fdad2c7d3 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:45.728272 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 334/672] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Aug 24 11:20:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:45.728912 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce06c884-9cf1-44a5-88bd-f92fdad2c7d3 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:45.741986 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:45.742851 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:45.759674 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076bd93b-02d3-48ff-a09c-dd838fb5ac51 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:45.796938 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-face12ef-75a4-48fe-a863-967707086c18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:45.797547 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-face12ef-75a4-48fe-a863-967707086c18 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:45.797823 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-face12ef-75a4-48fe-a863-967707086c18 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:45.798092 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-face12ef-75a4-48fe-a863-967707086c18 None admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:45.798780 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-face12ef-75a4-48fe-a863-967707086c18 None admin] RBAC: Adding query filter params (name=service) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:20:45.799081 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-face12ef-75a4-48fe-a863-967707086c18 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:45.800514 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-face12ef-75a4-48fe-a863-967707086c18 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:45.808636 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 339/673] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Aug 24 11:20:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:45.809257 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-face12ef-75a4-48fe-a863-967707086c18 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:45.843239 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce06c884-9cf1-44a5-88bd-f92fdad2c7d3 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:45.878248 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852f1c55-476e-4596-9380-1fd7d36846c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:45.878939 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852f1c55-476e-4596-9380-1fd7d36846c4 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:45.879214 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852f1c55-476e-4596-9380-1fd7d36846c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:45.879475 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852f1c55-476e-4596-9380-1fd7d36846c4 None admin] PATH_INFO: `/v3/projects` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:45.880164 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852f1c55-476e-4596-9380-1fd7d36846c4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:20:45.880463 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852f1c55-476e-4596-9380-1fd7d36846c4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:45.881990 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852f1c55-476e-4596-9380-1fd7d36846c4 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:45.899006 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 335/674] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Aug 24 11:20:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:45.899006 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852f1c55-476e-4596-9380-1fd7d36846c4 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:45.933633 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-face12ef-75a4-48fe-a863-967707086c18 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:45.974189 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c727661-2e0c-41c4-8869-f71bcf346d4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:45.974833 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c727661-2e0c-41c4-8869-f71bcf346d4c None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:45.975112 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c727661-2e0c-41c4-8869-f71bcf346d4c None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:45.975382 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c727661-2e0c-41c4-8869-f71bcf346d4c None admin] PATH_INFO: `/v3/domains` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:45.976037 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c727661-2e0c-41c4-8869-f71bcf346d4c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:20:45.976338 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c727661-2e0c-41c4-8869-f71bcf346d4c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:45.977746 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c727661-2e0c-41c4-8869-f71bcf346d4c None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:45.990065 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:45.995209 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 340/675] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 24 11:20:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:45.996405 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c727661-2e0c-41c4-8869-f71bcf346d4c None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:46.009216 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:46.022977 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852f1c55-476e-4596-9380-1fd7d36846c4 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:46.056505 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41a867e-25c1-4b8a-b437-4d6761ae93e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:46.057113 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41a867e-25c1-4b8a-b437-4d6761ae93e4 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:46.057387 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41a867e-25c1-4b8a-b437-4d6761ae93e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:46.057659 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41a867e-25c1-4b8a-b437-4d6761ae93e4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:46.058410 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41a867e-25c1-4b8a-b437-4d6761ae93e4 None admin] RBAC: Adding query filter params (role.id=217baac59e08499ea2f1b1d84935df0b, scope.project.id=317f54a463cb48ab86648c6dcec5db0f, user.id=e2d061d25d83443c9232218c90792d51) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:20:46.058719 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41a867e-25c1-4b8a-b437-4d6761ae93e4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:46.060211 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41a867e-25c1-4b8a-b437-4d6761ae93e4 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:46.066066 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 336/676] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Aug 24 11:20:45 2022] GET /identity/v3/role_assignments?user.id=e2d061d25d83443c9232218c90792d51&scope.project.id=317f54a463cb48ab86648c6dcec5db0f&role.id=217baac59e08499ea2f1b1d84935df0b => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:46.066879 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41a867e-25c1-4b8a-b437-4d6761ae93e4 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:46.115449 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c727661-2e0c-41c4-8869-f71bcf346d4c None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:46.154985 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c340bca7-7e8d-425a-a8e5-267543de7c23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:46.155799 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c340bca7-7e8d-425a-a8e5-267543de7c23 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:46.156079 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c340bca7-7e8d-425a-a8e5-267543de7c23 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:46.156679 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c340bca7-7e8d-425a-a8e5-267543de7c23 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:46.169066 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c340bca7-7e8d-425a-a8e5-267543de7c23 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:46.170594 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c340bca7-7e8d-425a-a8e5-267543de7c23 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:46.187615 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-c340bca7-7e8d-425a-a8e5-267543de7c23 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:20:46.187615 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:20:46.187615 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:20:46.187615 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:20:46.187615 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:20:46.187615 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:20:46.187615 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:20:46.187615 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:20:46.187615 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:20:46.187615 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:20:46.187615 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:20:46.187615 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:20:46.187615 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 11:20:46.187615 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 11:20:46.187615 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 11:20:46.187615 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 11:20:46.189124 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:20:46.189124 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:20:46.189124 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:20:46.189124 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:20:46.189124 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:20:46.189124 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:20:46.189124 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:20:46.189124 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Aug 24 11:20:46.189124 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:20:46.189124 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:20:46.189124 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:20:46.189124 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:20:46.189124 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:20:46.189124 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:20:46.189124 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:20:46.189124 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:20:46.189124 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 11:20:46.190342 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 11:20:46.190342 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:20:46.190342 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:20:46.190342 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 341/677] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 11:20:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:20:46.190342 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c340bca7-7e8d-425a-a8e5-267543de7c23 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:46.214710 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41a867e-25c1-4b8a-b437-4d6761ae93e4 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:46.252886 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:46.255211 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f3e548-2201-48c9-be74-440a3fd8dc94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:46.255968 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f3e548-2201-48c9-be74-440a3fd8dc94 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:46.256323 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f3e548-2201-48c9-be74-440a3fd8dc94 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:46.256694 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f3e548-2201-48c9-be74-440a3fd8dc94 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:46.257799 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f3e548-2201-48c9-be74-440a3fd8dc94 None admin] RBAC: Adding query filter params (role.id=217baac59e08499ea2f1b1d84935df0b, scope.project.id=317f54a463cb48ab86648c6dcec5db0f, user.id=92862b76ba3b4513b5dc5b5c962faac9) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:20:46.258242 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f3e548-2201-48c9-be74-440a3fd8dc94 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:46.259909 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f3e548-2201-48c9-be74-440a3fd8dc94 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:46.263062 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:46.269264 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 337/678] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Aug 24 11:20:46 2022] GET /identity/v3/role_assignments?user.id=92862b76ba3b4513b5dc5b5c962faac9&scope.project.id=317f54a463cb48ab86648c6dcec5db0f&role.id=217baac59e08499ea2f1b1d84935df0b => generated 608 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:46.270931 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4043fed5-a552-48fe-8478-600e9a2c93b4 None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:46.271216 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4043fed5-a552-48fe-8478-600e9a2c93b4 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:46.271488 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4043fed5-a552-48fe-8478-600e9a2c93b4 None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:46.273169 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 338/679] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:20:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:20:46.273721 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4043fed5-a552-48fe-8478-600e9a2c93b4 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:46.318857 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c340bca7-7e8d-425a-a8e5-267543de7c23 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:46.370443 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420e602d-660b-42a2-89af-f4f699790cac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:46.371713 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420e602d-660b-42a2-89af-f4f699790cac None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:46.372219 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420e602d-660b-42a2-89af-f4f699790cac None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:46.372950 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420e602d-660b-42a2-89af-f4f699790cac None admin] PATH_INFO: `/v3/projects/service` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:46.383145 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420e602d-660b-42a2-89af-f4f699790cac None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:46.384677 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420e602d-660b-42a2-89af-f4f699790cac None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:46.398010 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4043fed5-a552-48fe-8478-600e9a2c93b4 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:46.404348 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-420e602d-660b-42a2-89af-f4f699790cac None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 11:20:46.404348 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:20:46.404348 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:20:46.404348 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:20:46.404348 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:20:46.404348 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:20:46.404348 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:20:46.404348 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:20:46.404348 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:20:46.404348 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:20:46.404348 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:20:46.404348 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:20:46.404348 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 11:20:46.404348 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 11:20:46.404348 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 11:20:46.405323 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 11:20:46.405323 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:20:46.405323 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:20:46.405323 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:20:46.405323 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:20:46.405323 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:20:46.405323 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:20:46.405323 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:20:46.405323 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Aug 24 11:20:46.405323 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:20:46.405323 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:20:46.405323 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:20:46.405323 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:20:46.405323 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:20:46.405323 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:20:46.405323 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:20:46.405323 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:20:46.406249 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 11:20:46.406249 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 11:20:46.406249 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 11:20:46.406249 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 11:20:46.406249 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 11:20:46.406249 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 11:20:46.406249 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 11:20:46.406249 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:20:46.413849 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 342/680] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Aug 24 11:20:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:20:46.413849 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8293ce4-b137-4d3c-b066-c773589b9cc6 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:46.413849 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8293ce4-b137-4d3c-b066-c773589b9cc6 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:46.413849 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8293ce4-b137-4d3c-b066-c773589b9cc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:46.438915 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-f8293ce4-b137-4d3c-b066-c773589b9cc6 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:20:46.440109 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-f8293ce4-b137-4d3c-b066-c773589b9cc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:20:46.445214 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b8c396-576e-455c-8d02-2fab39cf3047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:46.445823 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b8c396-576e-455c-8d02-2fab39cf3047 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:46.446101 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b8c396-576e-455c-8d02-2fab39cf3047 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:46.446397 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b8c396-576e-455c-8d02-2fab39cf3047 None admin] PATH_INFO: `/v3/domains` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:46.447097 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b8c396-576e-455c-8d02-2fab39cf3047 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:20:46.447395 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b8c396-576e-455c-8d02-2fab39cf3047 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:46.448955 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b8c396-576e-455c-8d02-2fab39cf3047 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:46.463352 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 339/681] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 24 11:20:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:46.464209 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b8c396-576e-455c-8d02-2fab39cf3047 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:46.519896 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 343/682] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:20:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 11:20:46.520865 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8293ce4-b137-4d3c-b066-c773589b9cc6 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:46.557919 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:46.608232 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:46.623376 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b8c396-576e-455c-8d02-2fab39cf3047 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:46.686992 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8293ce4-b137-4d3c-b066-c773589b9cc6 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:46.697302 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20889c1b-f545-43bb-b003-2f67f37a7d92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:46.697918 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20889c1b-f545-43bb-b003-2f67f37a7d92 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:46.698246 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20889c1b-f545-43bb-b003-2f67f37a7d92 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:46.698542 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20889c1b-f545-43bb-b003-2f67f37a7d92 None admin] PATH_INFO: `/v3/projects` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:46.699297 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20889c1b-f545-43bb-b003-2f67f37a7d92 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:20:46.699599 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20889c1b-f545-43bb-b003-2f67f37a7d92 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:46.701091 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20889c1b-f545-43bb-b003-2f67f37a7d92 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:46.724712 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 340/683] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Aug 24 11:20:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:46.727871 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20889c1b-f545-43bb-b003-2f67f37a7d92 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:46.752316 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c868bd72-8519-4682-99ab-e3b9d8930638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:46.752958 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c868bd72-8519-4682-99ab-e3b9d8930638 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:46.753234 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c868bd72-8519-4682-99ab-e3b9d8930638 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:46.753571 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c868bd72-8519-4682-99ab-e3b9d8930638 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:46.767472 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c868bd72-8519-4682-99ab-e3b9d8930638 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:46.770837 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c868bd72-8519-4682-99ab-e3b9d8930638 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:46.783709 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-c868bd72-8519-4682-99ab-e3b9d8930638 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 11:20:46.783709 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:20:46.783709 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:20:46.783709 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:20:46.783709 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:20:46.783709 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:20:46.783709 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:20:46.783709 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:20:46.783709 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:20:46.783709 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:20:46.783709 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:20:46.783709 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:20:46.783709 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 11:20:46.783709 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 11:20:46.783709 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 11:20:46.783709 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 11:20:46.784764 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:20:46.784764 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:20:46.784764 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 11:20:46.784764 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 11:20:46.784764 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 11:20:46.784764 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 11:20:46.784764 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:20:46.784764 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:20:46.784764 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:20:46.784764 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:20:46.784764 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:20:46.784764 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Aug 24 11:20:46.784764 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:20:46.784764 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:20:46.784764 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:20:46.784764 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:20:46.784764 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:20:46.784764 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:20:46.785778 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:20:46.785778 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:20:46.785778 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 11:20:46.785778 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 11:20:46.785778 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 11:20:46.785778 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 11:20:46.785778 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 11:20:46.785778 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 11:20:46.785778 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 11:20:46.785778 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:20:46.785778 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 344/684] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Aug 24 11:20:46 2022] GET /identity/v3/users/swift => generated 83 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:20:46.795318 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c868bd72-8519-4682-99ab-e3b9d8930638 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:46.866666 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20889c1b-f545-43bb-b003-2f67f37a7d92 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:46.886070 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:46.905693 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d102aa1e-e582-484a-b093-da8d69cc1114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:46.906752 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d102aa1e-e582-484a-b093-da8d69cc1114 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:46.907336 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d102aa1e-e582-484a-b093-da8d69cc1114 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:46.907858 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d102aa1e-e582-484a-b093-da8d69cc1114 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:46.908842 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d102aa1e-e582-484a-b093-da8d69cc1114 None admin] RBAC: Adding query filter params (role.id=217baac59e08499ea2f1b1d84935df0b, scope.project.id=317f54a463cb48ab86648c6dcec5db0f, user.id=abffba24649e49d28a01cbee51924ce6) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:20:46.909365 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d102aa1e-e582-484a-b093-da8d69cc1114 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:46.911295 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d102aa1e-e582-484a-b093-da8d69cc1114 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:46.913752 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c868bd72-8519-4682-99ab-e3b9d8930638 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:46.918255 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 341/685] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Aug 24 11:20:46 2022] GET /identity/v3/role_assignments?user.id=abffba24649e49d28a01cbee51924ce6&scope.project.id=317f54a463cb48ab86648c6dcec5db0f&role.id=217baac59e08499ea2f1b1d84935df0b => generated 608 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:20:46.919308 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d102aa1e-e582-484a-b093-da8d69cc1114 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:46.926402 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:46.951347 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bdaaca-38ca-461c-b387-04a62d812211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:46.951968 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bdaaca-38ca-461c-b387-04a62d812211 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:46.952239 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bdaaca-38ca-461c-b387-04a62d812211 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:46.952567 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bdaaca-38ca-461c-b387-04a62d812211 None admin] PATH_INFO: `/v3/users` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:46.953322 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bdaaca-38ca-461c-b387-04a62d812211 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:20:46.953623 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bdaaca-38ca-461c-b387-04a62d812211 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:46.955410 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bdaaca-38ca-461c-b387-04a62d812211 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:46.979059 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 345/686] 10.222.0.27 () {56 vars in 1135 bytes} [Wed Aug 24 11:20:46 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:46.980414 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bdaaca-38ca-461c-b387-04a62d812211 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:47.038497 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d102aa1e-e582-484a-b093-da8d69cc1114 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:47.078199 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fafc2c-6514-44aa-9275-b12509122759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:47.079341 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fafc2c-6514-44aa-9275-b12509122759 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:47.079892 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fafc2c-6514-44aa-9275-b12509122759 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:47.080376 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fafc2c-6514-44aa-9275-b12509122759 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:47.088868 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bdaaca-38ca-461c-b387-04a62d812211 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:47.093939 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fafc2c-6514-44aa-9275-b12509122759 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:20:47.100029 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-62fafc2c-6514-44aa-9275-b12509122759 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 11:20:47.100029 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:20:47.100029 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:20:47.100029 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:20:47.100029 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:20:47.100029 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:20:47.100029 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:20:47.100029 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:20:47.100029 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:20:47.100029 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:20:47.100029 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:20:47.100029 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:20:47.100029 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:20:47.100029 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:20:47.100029 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:20:47.100029 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:20:47.101047 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:20:47.101047 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:20:47.101047 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:20:47.101047 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:20:47.101047 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:20:47.101047 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:20:47.101047 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:20:47.101047 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:20:47.101047 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:20:47.101047 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:20:47.101047 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:20:47.101047 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Aug 24 11:20:47.101047 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:20:47.101047 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:20:47.101047 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:20:47.101047 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:20:47.101921 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:20:47.101921 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:20:47.101921 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:20:47.101921 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:20:47.101921 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:20:47.101921 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:20:47.101921 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:20:47.101921 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:20:47.101921 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:20:47.101921 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:20:47.101921 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 11:20:47.101921 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Aug 24 11:20:47.104861 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 342/687] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Aug 24 11:20:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:20:47.114430 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fafc2c-6514-44aa-9275-b12509122759 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:47.135231 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b734206-f333-45f4-bfa1-d522bf74d5dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:47.135780 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b734206-f333-45f4-bfa1-d522bf74d5dc None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:47.136050 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b734206-f333-45f4-bfa1-d522bf74d5dc None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:47.136317 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b734206-f333-45f4-bfa1-d522bf74d5dc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:47.169826 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:47.176528 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:47.218611 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b734206-f333-45f4-bfa1-d522bf74d5dc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:47.220450 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b734206-f333-45f4-bfa1-d522bf74d5dc None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:47.261418 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fafc2c-6514-44aa-9275-b12509122759 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:47.300349 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6f3cb8-4943-41db-943d-3b04686d0c34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:47.300966 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6f3cb8-4943-41db-943d-3b04686d0c34 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:47.301240 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6f3cb8-4943-41db-943d-3b04686d0c34 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:47.301503 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6f3cb8-4943-41db-943d-3b04686d0c34 None admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:47.302166 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6f3cb8-4943-41db-943d-3b04686d0c34 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:20:47.302502 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6f3cb8-4943-41db-943d-3b04686d0c34 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:47.304441 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6f3cb8-4943-41db-943d-3b04686d0c34 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:47.319042 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 343/688] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 24 11:20:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:20:47.319239 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6f3cb8-4943-41db-943d-3b04686d0c34 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:47.338957 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 346/689] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 24 11:20:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 11:20:47.352595 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b734206-f333-45f4-bfa1-d522bf74d5dc None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:47.435390 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6f3cb8-4943-41db-943d-3b04686d0c34 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:47.438420 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:47.441129 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:47.475240 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bead7bf2-6008-48f6-a9c7-509b80a3bed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:47.475877 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bead7bf2-6008-48f6-a9c7-509b80a3bed3 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:47.476145 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bead7bf2-6008-48f6-a9c7-509b80a3bed3 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:47.476406 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bead7bf2-6008-48f6-a9c7-509b80a3bed3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:47.482619 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b734206-f333-45f4-bfa1-d522bf74d5dc None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:47.486804 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bead7bf2-6008-48f6-a9c7-509b80a3bed3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:47.488230 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bead7bf2-6008-48f6-a9c7-509b80a3bed3 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:47.505098 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-bead7bf2-6008-48f6-a9c7-509b80a3bed3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:20:47.505098 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:20:47.505098 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:20:47.505098 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:20:47.505098 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:20:47.505098 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:20:47.505098 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:20:47.505098 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:20:47.505098 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:20:47.505098 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:20:47.505098 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:20:47.505098 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:20:47.505098 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 11:20:47.505098 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 11:20:47.505098 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 11:20:47.505098 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 11:20:47.506104 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:20:47.506104 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:20:47.506104 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:20:47.506104 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:20:47.506104 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:20:47.506104 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:20:47.506104 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:20:47.506104 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Aug 24 11:20:47.506104 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:20:47.506104 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:20:47.506104 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:20:47.506104 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:20:47.506104 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:20:47.506104 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:20:47.506104 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:20:47.506104 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:20:47.506104 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 11:20:47.507042 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 11:20:47.507042 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:20:47.507042 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Aug 24 11:20:47.510663 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 344/690] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 11:20:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:20:47.512840 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bead7bf2-6008-48f6-a9c7-509b80a3bed3 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:47.527037 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5d6b3d-410a-4577-a224-17438f95e301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:47.528317 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5d6b3d-410a-4577-a224-17438f95e301 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:47.528961 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5d6b3d-410a-4577-a224-17438f95e301 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:47.529437 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5d6b3d-410a-4577-a224-17438f95e301 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:47.542914 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5d6b3d-410a-4577-a224-17438f95e301 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:47.545343 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5d6b3d-410a-4577-a224-17438f95e301 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:47.566288 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-cc5d6b3d-410a-4577-a224-17438f95e301 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:20:47.566288 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:20:47.566288 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:20:47.566288 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:20:47.566288 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:20:47.566288 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:20:47.566288 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:20:47.566288 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:20:47.566288 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:20:47.566288 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:20:47.566288 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:20:47.566288 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:20:47.566288 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 11:20:47.566288 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 11:20:47.566288 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 11:20:47.566288 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 11:20:47.567400 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:20:47.567400 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:20:47.567400 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:20:47.567400 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:20:47.567400 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:20:47.567400 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:20:47.567400 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:20:47.567400 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Aug 24 11:20:47.567400 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:20:47.567400 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:20:47.567400 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:20:47.567400 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:20:47.567400 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:20:47.567400 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:20:47.567400 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:20:47.567400 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:20:47.567400 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 11:20:47.568360 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 11:20:47.568360 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:20:47.568360 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:20:47.570864 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 347/691] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 11:20:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:20:47.579111 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5d6b3d-410a-4577-a224-17438f95e301 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:47.682471 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bead7bf2-6008-48f6-a9c7-509b80a3bed3 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:47.753263 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a494f181-44f4-4883-ba8c-ff89ac6484ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:47.753984 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a494f181-44f4-4883-ba8c-ff89ac6484ea None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:47.754265 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a494f181-44f4-4883-ba8c-ff89ac6484ea None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:47.754560 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a494f181-44f4-4883-ba8c-ff89ac6484ea None admin] PATH_INFO: `/v3/domains` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:47.755214 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a494f181-44f4-4883-ba8c-ff89ac6484ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:20:47.755512 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a494f181-44f4-4883-ba8c-ff89ac6484ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:47.756917 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a494f181-44f4-4883-ba8c-ff89ac6484ea None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:47.760254 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5d6b3d-410a-4577-a224-17438f95e301 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:47.784432 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 345/692] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 24 11:20:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:20:47.791324 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a494f181-44f4-4883-ba8c-ff89ac6484ea None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:47.795935 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:47.818791 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df78c37-c5cb-4d08-bac9-4f5890387e7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:47.819402 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df78c37-c5cb-4d08-bac9-4f5890387e7b None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:47.819674 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df78c37-c5cb-4d08-bac9-4f5890387e7b None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:47.819942 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df78c37-c5cb-4d08-bac9-4f5890387e7b None admin] PATH_INFO: `/v3/domains` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:47.820586 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df78c37-c5cb-4d08-bac9-4f5890387e7b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:20:47.820885 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df78c37-c5cb-4d08-bac9-4f5890387e7b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:47.822276 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df78c37-c5cb-4d08-bac9-4f5890387e7b None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:47.836340 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:47.847885 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 348/693] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 24 11:20:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:47.850995 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df78c37-c5cb-4d08-bac9-4f5890387e7b None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:47.968896 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a494f181-44f4-4883-ba8c-ff89ac6484ea None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:48.031142 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df78c37-c5cb-4d08-bac9-4f5890387e7b None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:48.033000 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cdd3f9-5b9a-41a3-bca9-67ce14443a6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:48.033640 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cdd3f9-5b9a-41a3-bca9-67ce14443a6d None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:48.033907 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cdd3f9-5b9a-41a3-bca9-67ce14443a6d None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:48.034172 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cdd3f9-5b9a-41a3-bca9-67ce14443a6d None admin] PATH_INFO: `/v3/users/nova` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:48.048912 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cdd3f9-5b9a-41a3-bca9-67ce14443a6d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:48.050536 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cdd3f9-5b9a-41a3-bca9-67ce14443a6d None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:48.067812 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-45cdd3f9-5b9a-41a3-bca9-67ce14443a6d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 11:20:48.067812 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:20:48.067812 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:20:48.067812 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:20:48.067812 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:20:48.067812 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:20:48.067812 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:20:48.067812 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:20:48.067812 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:20:48.067812 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:20:48.067812 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:20:48.067812 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:20:48.067812 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 11:20:48.067812 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 11:20:48.067812 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 11:20:48.067812 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 11:20:48.068795 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:20:48.068795 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:20:48.068795 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 11:20:48.068795 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 11:20:48.068795 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 11:20:48.068795 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 11:20:48.068795 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:20:48.068795 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:20:48.068795 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:20:48.068795 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:20:48.068795 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:20:48.068795 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Aug 24 11:20:48.068795 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:20:48.068795 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:20:48.068795 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:20:48.068795 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:20:48.068795 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:20:48.068795 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:20:48.069744 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:20:48.069744 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:20:48.069744 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 11:20:48.069744 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 11:20:48.069744 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 11:20:48.069744 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 11:20:48.069744 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 11:20:48.069744 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 11:20:48.069744 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 11:20:48.069744 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Aug 24 11:20:48.069744 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 346/694] 10.222.0.27 () {56 vars in 1093 bytes} [Wed Aug 24 11:20:47 2022] GET /identity/v3/users/nova => generated 82 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:20:48.075864 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cdd3f9-5b9a-41a3-bca9-67ce14443a6d None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:48.098521 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915df06c-b2df-4f4b-9460-265166eb83ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:48.099163 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915df06c-b2df-4f4b-9460-265166eb83ca None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:48.099443 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915df06c-b2df-4f4b-9460-265166eb83ca None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:48.102553 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915df06c-b2df-4f4b-9460-265166eb83ca None admin] PATH_INFO: `/v3/projects/service` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:48.109649 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915df06c-b2df-4f4b-9460-265166eb83ca None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:48.113793 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915df06c-b2df-4f4b-9460-265166eb83ca None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:48.130474 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-915df06c-b2df-4f4b-9460-265166eb83ca None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 11:20:48.130474 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:20:48.130474 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:20:48.130474 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:20:48.130474 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:20:48.130474 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:20:48.130474 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:20:48.130474 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:20:48.130474 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:20:48.130474 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:20:48.130474 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:20:48.130474 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:20:48.130474 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 11:20:48.130474 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 11:20:48.130474 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 11:20:48.131415 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 11:20:48.131415 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:20:48.131415 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:20:48.131415 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:20:48.131415 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:20:48.131415 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:20:48.131415 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:20:48.131415 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:20:48.131415 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Aug 24 11:20:48.131415 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:20:48.131415 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:20:48.131415 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:20:48.131415 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:20:48.131415 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:20:48.131415 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:20:48.131415 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:20:48.131415 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:20:48.132315 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 11:20:48.132315 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 11:20:48.132315 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 11:20:48.132315 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 11:20:48.132315 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 11:20:48.132315 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 11:20:48.132315 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 11:20:48.132315 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:20:48.132761 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 349/695] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Aug 24 11:20:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:20:48.147133 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915df06c-b2df-4f4b-9460-265166eb83ca None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:48.207863 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:48.229162 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:48.231049 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cdd3f9-5b9a-41a3-bca9-67ce14443a6d None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:48.265512 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df400a28-6c7c-4720-9254-7e6715d2a07b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:48.266598 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df400a28-6c7c-4720-9254-7e6715d2a07b None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:48.266940 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df400a28-6c7c-4720-9254-7e6715d2a07b None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:48.267272 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df400a28-6c7c-4720-9254-7e6715d2a07b None admin] PATH_INFO: `/v3/users` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:48.268069 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df400a28-6c7c-4720-9254-7e6715d2a07b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:20:48.268434 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df400a28-6c7c-4720-9254-7e6715d2a07b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:48.269985 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df400a28-6c7c-4720-9254-7e6715d2a07b None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:48.277029 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915df06c-b2df-4f4b-9460-265166eb83ca None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:48.288932 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 347/696] 10.222.0.27 () {56 vars in 1133 bytes} [Wed Aug 24 11:20:48 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:48.294772 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed09edf-7e57-4d8a-b705-60be7ec852d3 None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:48.295122 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed09edf-7e57-4d8a-b705-60be7ec852d3 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:48.295457 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed09edf-7e57-4d8a-b705-60be7ec852d3 None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:48.296998 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 348/697] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:20:48 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:20:48.297752 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed09edf-7e57-4d8a-b705-60be7ec852d3 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:48.317122 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01e89c2-9508-44fd-ae21-d2498cb2c288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:48.318037 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01e89c2-9508-44fd-ae21-d2498cb2c288 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:48.318608 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01e89c2-9508-44fd-ae21-d2498cb2c288 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:48.318881 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01e89c2-9508-44fd-ae21-d2498cb2c288 None admin] PATH_INFO: `/v3/projects` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:48.319574 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01e89c2-9508-44fd-ae21-d2498cb2c288 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:20:48.319881 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01e89c2-9508-44fd-ae21-d2498cb2c288 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:48.321921 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01e89c2-9508-44fd-ae21-d2498cb2c288 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:48.342496 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 350/698] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Aug 24 11:20:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:48.343976 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e200583f-afb3-4328-92c3-c806aac824d4 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:48.344513 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e200583f-afb3-4328-92c3-c806aac824d4 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:48.344787 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e200583f-afb3-4328-92c3-c806aac824d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:48.364007 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-e200583f-afb3-4328-92c3-c806aac824d4 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:20:48.365427 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-e200583f-afb3-4328-92c3-c806aac824d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:20:48.427094 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed09edf-7e57-4d8a-b705-60be7ec852d3 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:48.446678 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 351/699] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:20:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 11:20:48.447658 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e200583f-afb3-4328-92c3-c806aac824d4 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:48.472587 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a920a7-fab3-4d48-a0e1-2476b3879d30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:48.473980 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a920a7-fab3-4d48-a0e1-2476b3879d30 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:48.474527 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a920a7-fab3-4d48-a0e1-2476b3879d30 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:48.474988 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a920a7-fab3-4d48-a0e1-2476b3879d30 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:48.492160 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:48.509867 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:48.612042 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a920a7-fab3-4d48-a0e1-2476b3879d30 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:48.614157 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a920a7-fab3-4d48-a0e1-2476b3879d30 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:48.628216 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e200583f-afb3-4328-92c3-c806aac824d4 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:48.671676 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f5b8de-b3cf-4391-b55f-0707a09b421f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:48.672589 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f5b8de-b3cf-4391-b55f-0707a09b421f None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:48.673278 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f5b8de-b3cf-4391-b55f-0707a09b421f None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:48.673566 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f5b8de-b3cf-4391-b55f-0707a09b421f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:48.674605 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f5b8de-b3cf-4391-b55f-0707a09b421f None admin] RBAC: Adding query filter params (role.id=217baac59e08499ea2f1b1d84935df0b, scope.project.id=317f54a463cb48ab86648c6dcec5db0f, user.id=f1069558c085449f9e4c9f06013b2a85) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:20:48.674917 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f5b8de-b3cf-4391-b55f-0707a09b421f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:48.677465 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f5b8de-b3cf-4391-b55f-0707a09b421f None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:48.685571 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 352/700] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Aug 24 11:20:48 2022] GET /identity/v3/role_assignments?user.id=f1069558c085449f9e4c9f06013b2a85&scope.project.id=317f54a463cb48ab86648c6dcec5db0f&role.id=217baac59e08499ea2f1b1d84935df0b => generated 608 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:48.686835 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f128807-ca3a-49fb-9832-618fe0964101 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:48.687170 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f128807-ca3a-49fb-9832-618fe0964101 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:48.687450 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f128807-ca3a-49fb-9832-618fe0964101 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:48.693279 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 353/701] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:20:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:20:48.694805 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a85aaa-0c1d-4a05-b3f9-6b3dbadb6a24 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:48.695090 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a85aaa-0c1d-4a05-b3f9-6b3dbadb6a24 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:48.695364 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a85aaa-0c1d-4a05-b3f9-6b3dbadb6a24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:48.728553 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-39a85aaa-0c1d-4a05-b3f9-6b3dbadb6a24 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:20:48.729872 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-39a85aaa-0c1d-4a05-b3f9-6b3dbadb6a24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:20:48.743855 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 349/702] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 24 11:20:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 11:20:48.749598 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a920a7-fab3-4d48-a0e1-2476b3879d30 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:48.790171 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:48.828784 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 354/703] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:20:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 11:20:48.830924 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a85aaa-0c1d-4a05-b3f9-6b3dbadb6a24 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:48.881206 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:48.904274 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a920a7-fab3-4d48-a0e1-2476b3879d30 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:48.963037 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df8d81d-ae83-4c94-a64d-f0b6a1c637c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:48.964062 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df8d81d-ae83-4c94-a64d-f0b6a1c637c1 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:48.964537 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df8d81d-ae83-4c94-a64d-f0b6a1c637c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:48.965014 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df8d81d-ae83-4c94-a64d-f0b6a1c637c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:48.976339 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df8d81d-ae83-4c94-a64d-f0b6a1c637c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:48.978026 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df8d81d-ae83-4c94-a64d-f0b6a1c637c1 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:48.987957 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a85aaa-0c1d-4a05-b3f9-6b3dbadb6a24 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:48.994080 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-7df8d81d-ae83-4c94-a64d-f0b6a1c637c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:20:48.994080 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:20:48.994080 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:20:48.994080 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:20:48.994080 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:20:48.994080 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:20:48.994080 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:20:48.994080 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:20:48.994080 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:20:48.994080 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:20:48.994080 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:20:48.994080 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:20:48.994080 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 11:20:48.994080 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 11:20:48.994080 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 11:20:48.994080 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 11:20:48.995059 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:20:48.995059 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:20:48.995059 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:20:48.995059 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:20:48.995059 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:20:48.995059 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:20:48.995059 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:20:48.995059 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Aug 24 11:20:48.995059 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:20:48.995059 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:20:48.995059 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:20:48.995059 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:20:48.995059 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:20:48.995059 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:20:48.995059 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:20:48.995059 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:20:48.995059 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 11:20:48.996171 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 11:20:48.996171 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:20:48.996171 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Aug 24 11:20:48.996171 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 350/704] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 11:20:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:20:49.001126 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df8d81d-ae83-4c94-a64d-f0b6a1c637c1 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:49.041453 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48991ab7-0283-45df-a489-50ebdb6f9be5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:49.042104 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48991ab7-0283-45df-a489-50ebdb6f9be5 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:49.042402 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48991ab7-0283-45df-a489-50ebdb6f9be5 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:49.042681 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48991ab7-0283-45df-a489-50ebdb6f9be5 None admin] PATH_INFO: `/v3/services/network` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:49.043289 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48991ab7-0283-45df-a489-50ebdb6f9be5 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:49.044690 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48991ab7-0283-45df-a489-50ebdb6f9be5 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:49.059322 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-48991ab7-0283-45df-a489-50ebdb6f9be5 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 11:20:49.059322 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:20:49.059322 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 11:20:49.059322 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 11:20:49.059322 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 11:20:49.059322 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 11:20:49.059322 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 11:20:49.059322 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 11:20:49.059322 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 11:20:49.059322 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:20:49.059322 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 11:20:49.059322 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:20:49.059322 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:20:49.059322 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:20:49.059322 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:20:49.059322 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:20:49.059322 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:20:49.060371 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:20:49.060371 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:20:49.060371 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:20:49.060371 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:20:49.060371 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:20:49.060371 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:20:49.060371 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 11:20:49.060371 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 11:20:49.060371 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 11:20:49.060371 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 11:20:49.060371 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:20:49.060371 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:20:49.060371 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:20:49.060371 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:20:49.060371 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:20:49.060371 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:20:49.061718 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:20:49.061718 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Aug 24 11:20:49.061718 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:20:49.061718 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:20:49.061718 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:20:49.061718 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:20:49.061718 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:20:49.061718 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:20:49.061718 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:20:49.061718 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:20:49.061718 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 11:20:49.061718 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 11:20:49.061718 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 11:20:49.061718 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:20:49.061718 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 355/705] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Aug 24 11:20:48 2022] GET /identity/v3/services/network => generated 88 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:20:49.066998 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48991ab7-0283-45df-a489-50ebdb6f9be5 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:49.103287 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:49.123749 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df8d81d-ae83-4c94-a64d-f0b6a1c637c1 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:49.159723 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedd5f65-680c-4cb1-a23d-155d0e0c46c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:49.160260 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedd5f65-680c-4cb1-a23d-155d0e0c46c5 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:49.160558 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedd5f65-680c-4cb1-a23d-155d0e0c46c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:49.160842 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedd5f65-680c-4cb1-a23d-155d0e0c46c5 None admin] PATH_INFO: `/v3/domains` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:49.161488 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedd5f65-680c-4cb1-a23d-155d0e0c46c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:20:49.161792 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedd5f65-680c-4cb1-a23d-155d0e0c46c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:49.163288 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedd5f65-680c-4cb1-a23d-155d0e0c46c5 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:49.176481 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 351/706] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 24 11:20:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:20:49.177417 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedd5f65-680c-4cb1-a23d-155d0e0c46c5 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:49.198273 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:49.212268 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48991ab7-0283-45df-a489-50ebdb6f9be5 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:49.246558 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cd30e4-3cde-4eb0-bfa5-ffd3a28454a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:49.247269 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cd30e4-3cde-4eb0-bfa5-ffd3a28454a9 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:49.247614 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cd30e4-3cde-4eb0-bfa5-ffd3a28454a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:49.247951 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cd30e4-3cde-4eb0-bfa5-ffd3a28454a9 None admin] PATH_INFO: `/v3/services` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:49.248703 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cd30e4-3cde-4eb0-bfa5-ffd3a28454a9 None admin] RBAC: Adding query filter params (name=network) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:20:49.249076 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cd30e4-3cde-4eb0-bfa5-ffd3a28454a9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:49.250591 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cd30e4-3cde-4eb0-bfa5-ffd3a28454a9 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:49.255713 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 356/707] 10.222.0.27 () {56 vars in 1112 bytes} [Wed Aug 24 11:20:49 2022] GET /identity/v3/services?name=network => generated 124 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:49.256602 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cd30e4-3cde-4eb0-bfa5-ffd3a28454a9 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:49.292776 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedd5f65-680c-4cb1-a23d-155d0e0c46c5 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:49.331165 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fdf1af-1a2f-41e9-8b5d-606bac7e9361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:49.331965 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fdf1af-1a2f-41e9-8b5d-606bac7e9361 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:49.332241 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fdf1af-1a2f-41e9-8b5d-606bac7e9361 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:49.332617 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fdf1af-1a2f-41e9-8b5d-606bac7e9361 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:49.333204 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fdf1af-1a2f-41e9-8b5d-606bac7e9361 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:49.334619 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fdf1af-1a2f-41e9-8b5d-606bac7e9361 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:49.345996 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-71fdf1af-1a2f-41e9-8b5d-606bac7e9361 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 11:20:49.345996 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:20:49.345996 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 11:20:49.345996 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 11:20:49.345996 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 11:20:49.345996 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 11:20:49.345996 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 11:20:49.345996 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 11:20:49.345996 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 11:20:49.345996 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Aug 24 11:20:49.345996 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 11:20:49.345996 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Aug 24 11:20:49.345996 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:20:49.345996 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:20:49.345996 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:20:49.345996 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:20:49.345996 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:20:49.347201 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:20:49.347201 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:20:49.347201 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:20:49.347201 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:20:49.347201 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:20:49.347201 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:20:49.347201 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 11:20:49.347201 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 11:20:49.347201 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 11:20:49.347201 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 11:20:49.347201 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:20:49.347201 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:20:49.347201 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:20:49.347201 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:20:49.347201 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:20:49.347201 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:20:49.348049 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:20:49.348049 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Aug 24 11:20:49.348049 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:20:49.348049 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:20:49.348049 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:20:49.348049 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:20:49.348049 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:20:49.348049 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:20:49.348049 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:20:49.348049 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:20:49.348049 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 11:20:49.348049 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 11:20:49.348049 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 11:20:49.348049 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Aug 24 11:20:49.348049 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 352/708] 10.222.0.27 () {56 vars in 1129 bytes} [Wed Aug 24 11:20:49 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:20:49.348849 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fdf1af-1a2f-41e9-8b5d-606bac7e9361 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:49.361856 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:49.370016 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cd30e4-3cde-4eb0-bfa5-ffd3a28454a9 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:49.406334 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7284a136-1398-4f36-9b79-3e4af055515f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:49.407484 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7284a136-1398-4f36-9b79-3e4af055515f None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:49.407962 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7284a136-1398-4f36-9b79-3e4af055515f None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:49.408484 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7284a136-1398-4f36-9b79-3e4af055515f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:49.416685 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7284a136-1398-4f36-9b79-3e4af055515f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:49.418466 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7284a136-1398-4f36-9b79-3e4af055515f None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:49.431069 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-7284a136-1398-4f36-9b79-3e4af055515f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 11:20:49.431069 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:20:49.431069 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:20:49.431069 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:20:49.431069 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:20:49.431069 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:20:49.431069 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:20:49.431069 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:20:49.431069 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:20:49.431069 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:20:49.431069 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:20:49.431069 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:20:49.431069 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 11:20:49.431069 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 11:20:49.431069 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 11:20:49.431990 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 11:20:49.431990 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:20:49.431990 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:20:49.431990 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:20:49.431990 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:20:49.431990 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:20:49.431990 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:20:49.431990 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:20:49.431990 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Aug 24 11:20:49.431990 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:20:49.431990 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:20:49.431990 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:20:49.431990 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:20:49.431990 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:20:49.431990 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:20:49.431990 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:20:49.431990 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:20:49.432948 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 11:20:49.432948 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 11:20:49.432948 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 11:20:49.432948 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 11:20:49.432948 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 11:20:49.432948 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 11:20:49.432948 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 11:20:49.432948 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:20:49.435115 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 357/709] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Aug 24 11:20:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:20:49.436119 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7284a136-1398-4f36-9b79-3e4af055515f None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:49.452366 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:49.457327 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fdf1af-1a2f-41e9-8b5d-606bac7e9361 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:49.491422 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57207ac7-9cda-459a-ad79-0013c25bd553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:49.492217 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57207ac7-9cda-459a-ad79-0013c25bd553 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:49.492532 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57207ac7-9cda-459a-ad79-0013c25bd553 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:49.492810 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57207ac7-9cda-459a-ad79-0013c25bd553 None admin] PATH_INFO: `/v3/services` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:49.493455 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57207ac7-9cda-459a-ad79-0013c25bd553 None admin] RBAC: Adding query filter params (type=network) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:20:49.493760 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57207ac7-9cda-459a-ad79-0013c25bd553 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:49.495195 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57207ac7-9cda-459a-ad79-0013c25bd553 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:49.508451 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 353/710] 10.222.0.27 () {56 vars in 1112 bytes} [Wed Aug 24 11:20:49 2022] GET /identity/v3/services?type=network => generated 124 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:49.508451 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02330e09-aeeb-4b6f-a205-015a00573b68 None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:49.508451 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02330e09-aeeb-4b6f-a205-015a00573b68 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:49.508451 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02330e09-aeeb-4b6f-a205-015a00573b68 None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:49.508451 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 354/711] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:20:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:20:49.508451 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02330e09-aeeb-4b6f-a205-015a00573b68 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:49.578488 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7284a136-1398-4f36-9b79-3e4af055515f None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:49.602311 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:49.619638 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374b3f11-0cf6-4d61-bfca-428d79d9af78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:49.620691 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374b3f11-0cf6-4d61-bfca-428d79d9af78 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:49.621205 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374b3f11-0cf6-4d61-bfca-428d79d9af78 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:49.621730 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374b3f11-0cf6-4d61-bfca-428d79d9af78 None admin] PATH_INFO: `/v3/services` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:49.622747 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374b3f11-0cf6-4d61-bfca-428d79d9af78 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:20:49.623259 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374b3f11-0cf6-4d61-bfca-428d79d9af78 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:49.625008 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374b3f11-0cf6-4d61-bfca-428d79d9af78 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:49.630831 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 358/712] 10.222.0.27 () {56 vars in 1124 bytes} [Wed Aug 24 11:20:49 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:49.632794 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce40635-80c4-4d62-91b2-4421555dc142 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:49.632933 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02330e09-aeeb-4b6f-a205-015a00573b68 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:49.633426 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce40635-80c4-4d62-91b2-4421555dc142 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:49.633899 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce40635-80c4-4d62-91b2-4421555dc142 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:49.662227 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-bce40635-80c4-4d62-91b2-4421555dc142 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:20:49.663917 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-bce40635-80c4-4d62-91b2-4421555dc142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:20:49.688384 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e02363-9b1f-48fa-b91f-7db9d3ed9858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:49.688924 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e02363-9b1f-48fa-b91f-7db9d3ed9858 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:49.689198 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e02363-9b1f-48fa-b91f-7db9d3ed9858 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:49.689463 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e02363-9b1f-48fa-b91f-7db9d3ed9858 None admin] PATH_INFO: `/v3/projects` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:49.690164 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e02363-9b1f-48fa-b91f-7db9d3ed9858 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:20:49.690510 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e02363-9b1f-48fa-b91f-7db9d3ed9858 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:49.692099 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e02363-9b1f-48fa-b91f-7db9d3ed9858 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:49.706230 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 355/713] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Aug 24 11:20:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:49.710578 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e02363-9b1f-48fa-b91f-7db9d3ed9858 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:49.754709 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 359/714] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:20:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 11:20:49.755849 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce40635-80c4-4d62-91b2-4421555dc142 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:49.766417 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:49.858344 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e02363-9b1f-48fa-b91f-7db9d3ed9858 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:49.922197 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0240d30-da31-44ff-9d59-0606fe492be1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:49.922844 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0240d30-da31-44ff-9d59-0606fe492be1 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:49.923125 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0240d30-da31-44ff-9d59-0606fe492be1 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:49.923396 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0240d30-da31-44ff-9d59-0606fe492be1 None admin] PATH_INFO: `/v3/services` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:49.924044 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0240d30-da31-44ff-9d59-0606fe492be1 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:20:49.924346 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0240d30-da31-44ff-9d59-0606fe492be1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:49.925919 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0240d30-da31-44ff-9d59-0606fe492be1 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:49.935209 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 356/715] 10.222.0.27 () {56 vars in 1124 bytes} [Wed Aug 24 11:20:49 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:49.938837 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:49.940244 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce40635-80c4-4d62-91b2-4421555dc142 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:49.994590 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d06475d-ae8b-4e5d-95a7-91913260c408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:49.995238 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d06475d-ae8b-4e5d-95a7-91913260c408 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:49.995514 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d06475d-ae8b-4e5d-95a7-91913260c408 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:49.995786 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d06475d-ae8b-4e5d-95a7-91913260c408 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:49.996621 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d06475d-ae8b-4e5d-95a7-91913260c408 None admin] RBAC: Adding query filter params (role.id=30bb1e97257f4ca5b90c88545777317b, scope.project.id=317f54a463cb48ab86648c6dcec5db0f, user.id=282ec32864d046b2bea170f6a3845cc0) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:20:49.996927 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d06475d-ae8b-4e5d-95a7-91913260c408 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:49.998486 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d06475d-ae8b-4e5d-95a7-91913260c408 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:50.005395 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 360/716] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Aug 24 11:20:49 2022] GET /identity/v3/role_assignments?user.id=282ec32864d046b2bea170f6a3845cc0&scope.project.id=317f54a463cb48ab86648c6dcec5db0f&role.id=30bb1e97257f4ca5b90c88545777317b => generated 259 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:50.097986 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0240d30-da31-44ff-9d59-0606fe492be1 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:50.217620 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0240d30-da31-44ff-9d59-0606fe492be1 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:50.264865 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0fd970-3b04-4e75-9db8-2bbbe6792fcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:50.265892 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0fd970-3b04-4e75-9db8-2bbbe6792fcc None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:50.266386 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0fd970-3b04-4e75-9db8-2bbbe6792fcc None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:50.266852 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0fd970-3b04-4e75-9db8-2bbbe6792fcc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:50.288398 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0fd970-3b04-4e75-9db8-2bbbe6792fcc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:50.290234 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0fd970-3b04-4e75-9db8-2bbbe6792fcc None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:50.310103 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-fb0fd970-3b04-4e75-9db8-2bbbe6792fcc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:20:50.310103 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:20:50.310103 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:20:50.310103 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:20:50.310103 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:20:50.310103 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:20:50.310103 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:20:50.310103 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:20:50.310103 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:20:50.310103 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:20:50.310103 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:20:50.310103 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:20:50.310103 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 11:20:50.310103 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 11:20:50.310103 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 11:20:50.310103 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 11:20:50.311155 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:20:50.311155 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:20:50.311155 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:20:50.311155 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:20:50.311155 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:20:50.311155 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:20:50.311155 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:20:50.311155 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Aug 24 11:20:50.311155 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:20:50.311155 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:20:50.311155 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:20:50.311155 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:20:50.311155 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:20:50.311155 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:20:50.311155 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:20:50.311155 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:20:50.311155 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 11:20:50.312058 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 11:20:50.312058 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:20:50.312058 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Aug 24 11:20:50.313840 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 357/717] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 11:20:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:20:50.320202 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d06475d-ae8b-4e5d-95a7-91913260c408 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:50.462664 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:50.497601 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d06475d-ae8b-4e5d-95a7-91913260c408 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:50.533054 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032ccca5-52cd-4925-b5ca-778d0b0e0924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:50.533670 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032ccca5-52cd-4925-b5ca-778d0b0e0924 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:50.533947 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032ccca5-52cd-4925-b5ca-778d0b0e0924 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:50.534220 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032ccca5-52cd-4925-b5ca-778d0b0e0924 None admin] PATH_INFO: `/v3/domains` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:50.534960 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032ccca5-52cd-4925-b5ca-778d0b0e0924 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:20:50.535262 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032ccca5-52cd-4925-b5ca-778d0b0e0924 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:50.536665 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032ccca5-52cd-4925-b5ca-778d0b0e0924 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:50.549437 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 361/718] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 24 11:20:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:50.555162 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0fd970-3b04-4e75-9db8-2bbbe6792fcc None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:50.604776 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:50.653928 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0fd970-3b04-4e75-9db8-2bbbe6792fcc None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:50.686888 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92a0e0a-48de-47a8-b711-af195d59aeec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:50.687492 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92a0e0a-48de-47a8-b711-af195d59aeec None admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:50.687763 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92a0e0a-48de-47a8-b711-af195d59aeec None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:50.688027 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92a0e0a-48de-47a8-b711-af195d59aeec None admin] PATH_INFO: `/v3/users` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:50.688672 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92a0e0a-48de-47a8-b711-af195d59aeec None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:50.690115 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92a0e0a-48de-47a8-b711-af195d59aeec None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:50.715339 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 358/719] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Aug 24 11:20:50 2022] POST /identity/v3/users => generated 254 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:20:51.246735 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ee26ab-c291-466d-b059-8fec84a75371 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:51.247109 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ee26ab-c291-466d-b059-8fec84a75371 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:51.247285 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ee26ab-c291-466d-b059-8fec84a75371 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:51.248895 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 362/720] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:20:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:20:51.254047 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74523815-b876-4436-a87e-34eb0cf4388e None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:51.254330 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74523815-b876-4436-a87e-34eb0cf4388e None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:51.254628 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74523815-b876-4436-a87e-34eb0cf4388e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:51.276407 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-74523815-b876-4436-a87e-34eb0cf4388e None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:20:51.277976 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-74523815-b876-4436-a87e-34eb0cf4388e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:20:51.371120 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 359/721] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:20:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 11:20:51.689651 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ee26ab-c291-466d-b059-8fec84a75371 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:51.820955 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ee26ab-c291-466d-b059-8fec84a75371 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:51.861586 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:51.868867 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef93bcb2-f080-4681-99f7-5de3c7933aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:51.869513 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef93bcb2-f080-4681-99f7-5de3c7933aec None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:51.869786 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef93bcb2-f080-4681-99f7-5de3c7933aec None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:51.870056 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef93bcb2-f080-4681-99f7-5de3c7933aec None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:51.884735 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef93bcb2-f080-4681-99f7-5de3c7933aec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:20:51.889472 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-ef93bcb2-f080-4681-99f7-5de3c7933aec None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 11:20:51.889472 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:20:51.889472 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:20:51.889472 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:20:51.889472 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:20:51.889472 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:20:51.889472 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:20:51.889472 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:20:51.889472 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:20:51.889472 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:20:51.889472 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:20:51.889472 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:20:51.889472 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:20:51.889472 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:20:51.889472 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:20:51.889472 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:20:51.890402 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:20:51.890402 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:20:51.890402 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:20:51.890402 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:20:51.890402 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:20:51.890402 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:20:51.890402 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:20:51.890402 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:20:51.890402 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:20:51.890402 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:20:51.890402 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:20:51.890402 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Aug 24 11:20:51.890402 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:20:51.890402 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:20:51.890402 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:20:51.890402 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:20:51.891632 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:20:51.891632 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:20:51.891632 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:20:51.891632 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:20:51.891632 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:20:51.891632 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:20:51.891632 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:20:51.891632 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:20:51.891632 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:20:51.891632 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:20:51.891632 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 11:20:51.891632 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:20:51.891632 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 363/722] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Aug 24 11:20:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:20:51.898589 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74523815-b876-4436-a87e-34eb0cf4388e None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:51.942556 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:51.962441 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023e0713-915a-4d21-9409-5fbea2a10da9 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:51.962864 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023e0713-915a-4d21-9409-5fbea2a10da9 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:51.963253 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023e0713-915a-4d21-9409-5fbea2a10da9 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:51.964959 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 364/723] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:20:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 11:20:51.970270 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb20391-8275-4852-8361-9a23fe99605b None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:51.970686 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb20391-8275-4852-8361-9a23fe99605b None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:51.971391 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb20391-8275-4852-8361-9a23fe99605b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:51.992095 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-cdb20391-8275-4852-8361-9a23fe99605b None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:20:51.993921 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-cdb20391-8275-4852-8361-9a23fe99605b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:20:52.057089 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74523815-b876-4436-a87e-34eb0cf4388e None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:52.118303 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 365/724] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:20:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 11:20:52.118303 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1708d5-5712-477e-8ad4-3435df832acd None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:52.118303 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1708d5-5712-477e-8ad4-3435df832acd None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:52.118303 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1708d5-5712-477e-8ad4-3435df832acd None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:52.118303 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 366/725] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:20:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:20:52.123975 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b027164-4000-40e0-80a4-fdf4b9774d4f None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:52.124205 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b027164-4000-40e0-80a4-fdf4b9774d4f None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:52.124392 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b027164-4000-40e0-80a4-fdf4b9774d4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:52.129399 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c4db3b-2e83-45fc-bd33-b779b495347e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:52.130292 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c4db3b-2e83-45fc-bd33-b779b495347e None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:52.130839 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c4db3b-2e83-45fc-bd33-b779b495347e None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:52.131312 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c4db3b-2e83-45fc-bd33-b779b495347e None admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:52.132173 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c4db3b-2e83-45fc-bd33-b779b495347e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:20:52.132674 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c4db3b-2e83-45fc-bd33-b779b495347e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:52.134334 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c4db3b-2e83-45fc-bd33-b779b495347e None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:52.148000 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 360/726] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 24 11:20:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:52.150399 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c4db3b-2e83-45fc-bd33-b779b495347e None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:52.175441 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-3b027164-4000-40e0-80a4-fdf4b9774d4f None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:20:52.176649 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-3b027164-4000-40e0-80a4-fdf4b9774d4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:20:52.258418 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:52.264863 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c4db3b-2e83-45fc-bd33-b779b495347e None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:52.293548 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 367/727] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:20:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 11:20:52.295784 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55599495-ec17-4886-b600-c76274583e83 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:52.296668 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55599495-ec17-4886-b600-c76274583e83 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:52.297156 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55599495-ec17-4886-b600-c76274583e83 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:52.299310 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 368/728] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:20:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:20:52.305706 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b1f7eb-b655-48fe-849a-d7f9d81e7423 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:52.305982 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b1f7eb-b655-48fe-849a-d7f9d81e7423 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:52.306246 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b1f7eb-b655-48fe-849a-d7f9d81e7423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:52.314715 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b015891-354a-4fa7-b01d-f59c3c005897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:52.315346 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b015891-354a-4fa7-b01d-f59c3c005897 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:52.315619 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b015891-354a-4fa7-b01d-f59c3c005897 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:52.316090 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b015891-354a-4fa7-b01d-f59c3c005897 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:52.325837 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-02b1f7eb-b655-48fe-849a-d7f9d81e7423 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:20:52.327107 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b015891-354a-4fa7-b01d-f59c3c005897 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:52.327535 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-02b1f7eb-b655-48fe-849a-d7f9d81e7423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:20:52.328551 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b015891-354a-4fa7-b01d-f59c3c005897 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:52.343362 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-9b015891-354a-4fa7-b01d-f59c3c005897 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:20:52.343362 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:20:52.343362 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:20:52.343362 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:20:52.343362 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:20:52.343362 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:20:52.343362 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:20:52.343362 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:20:52.343362 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:20:52.343362 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:20:52.343362 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:20:52.343362 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:20:52.343362 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 11:20:52.343362 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 11:20:52.343362 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 11:20:52.343362 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 11:20:52.344389 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:20:52.344389 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:20:52.344389 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:20:52.344389 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:20:52.344389 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:20:52.344389 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:20:52.344389 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:20:52.344389 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Aug 24 11:20:52.344389 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:20:52.344389 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:20:52.344389 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:20:52.344389 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:20:52.344389 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:20:52.344389 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:20:52.344389 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:20:52.344389 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:20:52.344389 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 11:20:52.345345 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 11:20:52.345345 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:20:52.345345 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Aug 24 11:20:52.349279 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 361/729] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 11:20:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:20:52.350483 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b015891-354a-4fa7-b01d-f59c3c005897 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:52.384583 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:52.411378 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 369/730] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:20:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 11:20:52.502473 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b015891-354a-4fa7-b01d-f59c3c005897 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:52.543140 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b1f7eb-b655-48fe-849a-d7f9d81e7423 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:52.556237 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f78e40a-22cd-46ba-afaa-0a21498d3ea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:52.556879 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f78e40a-22cd-46ba-afaa-0a21498d3ea4 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:52.557156 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f78e40a-22cd-46ba-afaa-0a21498d3ea4 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:52.557424 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f78e40a-22cd-46ba-afaa-0a21498d3ea4 None admin] PATH_INFO: `/v3/domains` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:52.558095 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f78e40a-22cd-46ba-afaa-0a21498d3ea4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:20:52.561620 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f78e40a-22cd-46ba-afaa-0a21498d3ea4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:52.561620 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f78e40a-22cd-46ba-afaa-0a21498d3ea4 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:52.579945 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 362/731] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 24 11:20:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:52.591395 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f78e40a-22cd-46ba-afaa-0a21498d3ea4 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:52.612200 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:52.679666 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b1f7eb-b655-48fe-849a-d7f9d81e7423 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:52.720421 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099aa89b-ca58-46ef-b7c3-6fa5b826d0d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:52.721107 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099aa89b-ca58-46ef-b7c3-6fa5b826d0d0 None admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:52.721292 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099aa89b-ca58-46ef-b7c3-6fa5b826d0d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:52.721556 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099aa89b-ca58-46ef-b7c3-6fa5b826d0d0 None admin] PATH_INFO: `/v3/services` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:52.722349 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099aa89b-ca58-46ef-b7c3-6fa5b826d0d0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:52.723766 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099aa89b-ca58-46ef-b7c3-6fa5b826d0d0 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:52.737135 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f78e40a-22cd-46ba-afaa-0a21498d3ea4 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:52.742188 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 370/732] 10.222.0.27 () {60 vars in 1141 bytes} [Wed Aug 24 11:20:52 2022] POST /identity/v3/services => generated 240 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 11:20:52.743100 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099aa89b-ca58-46ef-b7c3-6fa5b826d0d0 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:52.807260 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17dc89e-fa69-4857-9174-3b1d26cb41b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:52.808321 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17dc89e-fa69-4857-9174-3b1d26cb41b9 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:52.808811 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17dc89e-fa69-4857-9174-3b1d26cb41b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:52.809276 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17dc89e-fa69-4857-9174-3b1d26cb41b9 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:52.818513 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:52.819379 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17dc89e-fa69-4857-9174-3b1d26cb41b9 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:52.821566 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17dc89e-fa69-4857-9174-3b1d26cb41b9 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:52.838020 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-a17dc89e-fa69-4857-9174-3b1d26cb41b9 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 11:20:52.838020 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:20:52.838020 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:20:52.838020 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:20:52.838020 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:20:52.838020 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:20:52.838020 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:20:52.838020 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:20:52.838020 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:20:52.838020 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:20:52.838020 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:20:52.838020 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:20:52.838020 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 11:20:52.838020 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 11:20:52.838020 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 11:20:52.838020 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 11:20:52.839088 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:20:52.839088 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:20:52.839088 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 11:20:52.839088 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 11:20:52.839088 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 11:20:52.839088 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 11:20:52.839088 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:20:52.839088 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:20:52.839088 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:20:52.839088 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:20:52.839088 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:20:52.839088 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Aug 24 11:20:52.839088 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:20:52.839088 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:20:52.839088 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:20:52.839088 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:20:52.839088 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:20:52.839088 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:20:52.840046 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:20:52.840046 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:20:52.840046 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 11:20:52.840046 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 11:20:52.840046 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 11:20:52.840046 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 11:20:52.840046 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 11:20:52.840046 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 11:20:52.840046 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 11:20:52.840046 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Aug 24 11:20:52.842937 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 363/733] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Aug 24 11:20:52 2022] GET /identity/v3/users/swift => generated 83 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:20:52.844155 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17dc89e-fa69-4857-9174-3b1d26cb41b9 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:52.899416 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099aa89b-ca58-46ef-b7c3-6fa5b826d0d0 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:52.921445 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:52.941704 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6b039a-bad7-429f-84dc-7ae7157a1def None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:52.942319 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6b039a-bad7-429f-84dc-7ae7157a1def None admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:52.942618 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6b039a-bad7-429f-84dc-7ae7157a1def None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:52.942950 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6b039a-bad7-429f-84dc-7ae7157a1def None admin] PATH_INFO: `/v3/services` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:52.943530 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6b039a-bad7-429f-84dc-7ae7157a1def None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:52.944911 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6b039a-bad7-429f-84dc-7ae7157a1def None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:52.962967 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17dc89e-fa69-4857-9174-3b1d26cb41b9 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:52.964287 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 371/734] 10.222.0.27 () {60 vars in 1141 bytes} [Wed Aug 24 11:20:52 2022] POST /identity/v3/services => generated 251 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:20:52.966136 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6b039a-bad7-429f-84dc-7ae7157a1def None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:53.015400 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce434365-9a5b-43c9-a87f-19275e04093f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:53.016452 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce434365-9a5b-43c9-a87f-19275e04093f None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:53.016748 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce434365-9a5b-43c9-a87f-19275e04093f None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:53.017071 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce434365-9a5b-43c9-a87f-19275e04093f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:53.031941 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce434365-9a5b-43c9-a87f-19275e04093f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:20:53.039977 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-ce434365-9a5b-43c9-a87f-19275e04093f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 11:20:53.039977 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:20:53.039977 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:20:53.039977 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:20:53.039977 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:20:53.039977 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:20:53.039977 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:20:53.039977 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:20:53.039977 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:20:53.039977 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:20:53.039977 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:20:53.039977 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:20:53.039977 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:20:53.039977 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:20:53.039977 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:20:53.039977 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:20:53.041014 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:20:53.041014 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:20:53.041014 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:20:53.041014 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:20:53.041014 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:20:53.041014 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:20:53.041014 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:20:53.041014 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:20:53.041014 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:20:53.041014 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:20:53.041014 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:20:53.041014 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Aug 24 11:20:53.041014 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:20:53.041014 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:20:53.041014 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:20:53.041014 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:20:53.041886 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:20:53.041886 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:20:53.041886 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:20:53.041886 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:20:53.041886 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:20:53.041886 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:20:53.041886 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:20:53.041886 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:20:53.041886 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:20:53.041886 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:20:53.041886 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 11:20:53.041886 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Aug 24 11:20:53.041886 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 364/735] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Aug 24 11:20:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:20:53.047477 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce434365-9a5b-43c9-a87f-19275e04093f None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:53.126285 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:53.132666 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6b039a-bad7-429f-84dc-7ae7157a1def None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:53.205931 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce434365-9a5b-43c9-a87f-19275e04093f None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:53.221502 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ba3a7c-fd8a-473d-8ece-85ea3c624c59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:53.222180 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ba3a7c-fd8a-473d-8ece-85ea3c624c59 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:53.222504 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ba3a7c-fd8a-473d-8ece-85ea3c624c59 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:53.222826 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ba3a7c-fd8a-473d-8ece-85ea3c624c59 None admin] PATH_INFO: `/v3/users` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:53.224129 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ba3a7c-fd8a-473d-8ece-85ea3c624c59 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:20:53.224433 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ba3a7c-fd8a-473d-8ece-85ea3c624c59 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:53.226248 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ba3a7c-fd8a-473d-8ece-85ea3c624c59 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:53.234141 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:53.248494 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8170da39-c3bf-4d60-80fe-56c22c976aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:53.249437 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8170da39-c3bf-4d60-80fe-56c22c976aec None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:53.249911 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8170da39-c3bf-4d60-80fe-56c22c976aec None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:53.250411 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8170da39-c3bf-4d60-80fe-56c22c976aec None admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:53.251001 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 372/736] 10.222.0.27 () {56 vars in 1135 bytes} [Wed Aug 24 11:20:52 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:53.251588 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8170da39-c3bf-4d60-80fe-56c22c976aec None admin] RBAC: Adding query filter params (name=admin) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:20:53.252085 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8170da39-c3bf-4d60-80fe-56c22c976aec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:53.253762 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8170da39-c3bf-4d60-80fe-56c22c976aec None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:53.256265 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ba3a7c-fd8a-473d-8ece-85ea3c624c59 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:53.268399 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 365/737] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 24 11:20:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:53.273716 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8170da39-c3bf-4d60-80fe-56c22c976aec None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:53.414571 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ba3a7c-fd8a-473d-8ece-85ea3c624c59 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:53.446895 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8170da39-c3bf-4d60-80fe-56c22c976aec None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:53.475161 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2c334f-48e5-429e-bf5b-887c4d0500da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:53.475804 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2c334f-48e5-429e-bf5b-887c4d0500da None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:53.476093 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2c334f-48e5-429e-bf5b-887c4d0500da None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:53.476350 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2c334f-48e5-429e-bf5b-887c4d0500da None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:53.500569 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659a4933-3a54-4ee3-9956-1897509202eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:53.501815 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659a4933-3a54-4ee3-9956-1897509202eb None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:53.502339 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659a4933-3a54-4ee3-9956-1897509202eb None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:53.503105 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659a4933-3a54-4ee3-9956-1897509202eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:53.506045 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:53.520131 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659a4933-3a54-4ee3-9956-1897509202eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:53.522467 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659a4933-3a54-4ee3-9956-1897509202eb None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:53.543278 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-659a4933-3a54-4ee3-9956-1897509202eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:20:53.543278 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:20:53.543278 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:20:53.543278 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:20:53.543278 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:20:53.543278 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:20:53.543278 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:20:53.543278 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:20:53.543278 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:20:53.543278 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:20:53.543278 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:20:53.543278 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:20:53.543278 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 11:20:53.543278 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 11:20:53.543278 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 11:20:53.543278 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 11:20:53.544293 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:20:53.544293 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:20:53.544293 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:20:53.544293 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:20:53.544293 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:20:53.544293 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:20:53.544293 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:20:53.544293 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Aug 24 11:20:53.544293 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:20:53.544293 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:20:53.544293 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:20:53.544293 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:20:53.544293 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:20:53.544293 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:20:53.544293 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:20:53.544293 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:20:53.544293 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 11:20:53.545204 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 11:20:53.545204 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:20:53.545204 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Aug 24 11:20:53.548220 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 366/738] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 11:20:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 11:20:53.549612 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55400010-2af6-4ea7-b997-ae085bb5b99e None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:53.550106 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55400010-2af6-4ea7-b997-ae085bb5b99e None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:53.550642 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55400010-2af6-4ea7-b997-ae085bb5b99e None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:53.552323 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 367/739] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:20:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:20:53.553345 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55400010-2af6-4ea7-b997-ae085bb5b99e None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:53.563083 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2c334f-48e5-429e-bf5b-887c4d0500da None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:53.564688 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2c334f-48e5-429e-bf5b-887c4d0500da None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:53.600680 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:53.679156 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55400010-2af6-4ea7-b997-ae085bb5b99e None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:53.690313 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 373/740] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 24 11:20:53 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 24 11:20:53.692854 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea523ed-0dd5-40d2-ad5a-40e1d7e4e00b None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:53.693364 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea523ed-0dd5-40d2-ad5a-40e1d7e4e00b None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:53.694097 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea523ed-0dd5-40d2-ad5a-40e1d7e4e00b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:53.713431 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-2ea523ed-0dd5-40d2-ad5a-40e1d7e4e00b None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:20:53.714673 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-2ea523ed-0dd5-40d2-ad5a-40e1d7e4e00b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:20:53.737528 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7efed95-a69c-4e14-b9ce-764f331307d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:53.738586 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7efed95-a69c-4e14-b9ce-764f331307d5 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:53.739124 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7efed95-a69c-4e14-b9ce-764f331307d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:53.739652 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7efed95-a69c-4e14-b9ce-764f331307d5 None admin] PATH_INFO: `/v3/domains` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:53.740981 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7efed95-a69c-4e14-b9ce-764f331307d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:20:53.741785 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7efed95-a69c-4e14-b9ce-764f331307d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:53.744151 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7efed95-a69c-4e14-b9ce-764f331307d5 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:53.759815 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 368/741] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 24 11:20:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:20:53.760938 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7efed95-a69c-4e14-b9ce-764f331307d5 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:53.779575 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:53.802621 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 374/742] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:20:53 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 11:20:53.803761 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea523ed-0dd5-40d2-ad5a-40e1d7e4e00b None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:53.886804 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:53.894544 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7efed95-a69c-4e14-b9ce-764f331307d5 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:53.921182 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea523ed-0dd5-40d2-ad5a-40e1d7e4e00b None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:53.960583 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616fc278-eb7c-4428-a51e-f52722bf7560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:53.961471 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616fc278-eb7c-4428-a51e-f52722bf7560 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:53.961895 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616fc278-eb7c-4428-a51e-f52722bf7560 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:53.962320 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616fc278-eb7c-4428-a51e-f52722bf7560 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:53.970333 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616fc278-eb7c-4428-a51e-f52722bf7560 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:53.972132 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616fc278-eb7c-4428-a51e-f52722bf7560 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:53.977395 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43b5660-a03f-443c-bf8b-2626f8bde851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:53.979311 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43b5660-a03f-443c-bf8b-2626f8bde851 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:53.981634 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43b5660-a03f-443c-bf8b-2626f8bde851 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:53.982131 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43b5660-a03f-443c-bf8b-2626f8bde851 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:54.000476 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-616fc278-eb7c-4428-a51e-f52722bf7560 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 11:20:54.000476 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:20:54.000476 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:20:54.000476 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:20:54.000476 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:20:54.000476 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:20:54.000476 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:20:54.000476 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:20:54.000476 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:20:54.000476 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:20:54.000476 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:20:54.000476 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:20:54.000476 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 11:20:54.000476 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 11:20:54.000476 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 11:20:54.000476 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 11:20:54.001489 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:20:54.001489 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:20:54.001489 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 11:20:54.001489 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 11:20:54.001489 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 11:20:54.001489 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 11:20:54.001489 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:20:54.001489 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:20:54.001489 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:20:54.001489 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:20:54.001489 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:20:54.001489 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Aug 24 11:20:54.001489 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:20:54.001489 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:20:54.001489 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:20:54.001489 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:20:54.001489 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:20:54.001489 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:20:54.002477 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:20:54.002477 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:20:54.002477 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 11:20:54.002477 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 11:20:54.002477 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 11:20:54.002477 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 11:20:54.002477 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 11:20:54.002477 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 11:20:54.002477 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 11:20:54.002477 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:20:54.006590 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 375/743] 10.222.0.27 () {56 vars in 1093 bytes} [Wed Aug 24 11:20:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:20:54.008939 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43b5660-a03f-443c-bf8b-2626f8bde851 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:54.010673 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43b5660-a03f-443c-bf8b-2626f8bde851 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:54.012789 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616fc278-eb7c-4428-a51e-f52722bf7560 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:54.046635 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-c43b5660-a03f-443c-bf8b-2626f8bde851 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:20:54.046635 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:20:54.046635 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:20:54.046635 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:20:54.046635 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:20:54.046635 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:20:54.046635 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:20:54.046635 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:20:54.046635 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:20:54.046635 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:20:54.046635 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:20:54.046635 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:20:54.046635 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 11:20:54.046635 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 11:20:54.046635 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 11:20:54.046635 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 11:20:54.047661 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:20:54.047661 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:20:54.047661 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:20:54.047661 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:20:54.047661 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:20:54.047661 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:20:54.047661 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:20:54.047661 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Aug 24 11:20:54.047661 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:20:54.047661 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:20:54.047661 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:20:54.047661 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:20:54.047661 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:20:54.047661 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:20:54.047661 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:20:54.047661 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:20:54.047661 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 11:20:54.048551 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 11:20:54.048551 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:20:54.048551 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Aug 24 11:20:54.050744 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 369/744] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 11:20:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:20:54.061375 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43b5660-a03f-443c-bf8b-2626f8bde851 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:54.106783 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:54.215614 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616fc278-eb7c-4428-a51e-f52722bf7560 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:54.218714 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43b5660-a03f-443c-bf8b-2626f8bde851 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:54.252309 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7083d1-bd4d-4740-b626-85d43be4ecb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:54.252704 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c71fc44-a3cb-4787-8505-888dea468b58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:54.252947 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7083d1-bd4d-4740-b626-85d43be4ecb5 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:54.253226 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7083d1-bd4d-4740-b626-85d43be4ecb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:54.253357 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c71fc44-a3cb-4787-8505-888dea468b58 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:54.253572 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7083d1-bd4d-4740-b626-85d43be4ecb5 None admin] PATH_INFO: `/v3/users` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:54.253666 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c71fc44-a3cb-4787-8505-888dea468b58 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:54.253888 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c71fc44-a3cb-4787-8505-888dea468b58 None admin] PATH_INFO: `/v3/domains` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:54.254300 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7083d1-bd4d-4740-b626-85d43be4ecb5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:20:54.254550 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c71fc44-a3cb-4787-8505-888dea468b58 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:20:54.254661 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7083d1-bd4d-4740-b626-85d43be4ecb5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:54.254844 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c71fc44-a3cb-4787-8505-888dea468b58 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:54.256060 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7083d1-bd4d-4740-b626-85d43be4ecb5 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:54.256239 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c71fc44-a3cb-4787-8505-888dea468b58 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:54.268599 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 370/745] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 24 11:20:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:20:54.269397 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c71fc44-a3cb-4787-8505-888dea468b58 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:54.280433 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:54.285151 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 376/746] 10.222.0.27 () {56 vars in 1133 bytes} [Wed Aug 24 11:20:54 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:54.287075 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7083d1-bd4d-4740-b626-85d43be4ecb5 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:54.373361 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c71fc44-a3cb-4787-8505-888dea468b58 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:54.400370 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7083d1-bd4d-4740-b626-85d43be4ecb5 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:54.410143 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45dfb70-3dfa-4551-8984-b6229ee36ce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:54.410804 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45dfb70-3dfa-4551-8984-b6229ee36ce2 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:54.411076 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45dfb70-3dfa-4551-8984-b6229ee36ce2 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:54.411340 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45dfb70-3dfa-4551-8984-b6229ee36ce2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:54.417601 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:54.421709 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45dfb70-3dfa-4551-8984-b6229ee36ce2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:20:54.426501 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-e45dfb70-3dfa-4551-8984-b6229ee36ce2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 11:20:54.426501 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:20:54.426501 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:20:54.426501 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:20:54.426501 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:20:54.426501 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:20:54.426501 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:20:54.426501 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:20:54.426501 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:20:54.426501 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:20:54.426501 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:20:54.426501 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:20:54.426501 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:20:54.426501 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:20:54.426501 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:20:54.426501 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:20:54.427433 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:20:54.427433 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:20:54.427433 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:20:54.427433 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:20:54.427433 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:20:54.427433 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:20:54.427433 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:20:54.427433 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:20:54.427433 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:20:54.427433 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:20:54.427433 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:20:54.427433 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Aug 24 11:20:54.427433 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:20:54.427433 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:20:54.427433 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:20:54.427433 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:20:54.428363 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:20:54.428363 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:20:54.428363 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:20:54.428363 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:20:54.428363 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:20:54.428363 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:20:54.428363 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:20:54.428363 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:20:54.428363 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:20:54.428363 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:20:54.428363 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 11:20:54.428363 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Aug 24 11:20:54.428363 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 371/747] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Aug 24 11:20:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:20:54.429066 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45dfb70-3dfa-4551-8984-b6229ee36ce2 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:54.442235 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb7b43f-f8f1-4e1c-9ee7-0dfe9b7bf7e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:54.443208 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb7b43f-f8f1-4e1c-9ee7-0dfe9b7bf7e9 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:54.443665 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb7b43f-f8f1-4e1c-9ee7-0dfe9b7bf7e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:54.444103 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb7b43f-f8f1-4e1c-9ee7-0dfe9b7bf7e9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:54.451874 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb7b43f-f8f1-4e1c-9ee7-0dfe9b7bf7e9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:54.453598 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb7b43f-f8f1-4e1c-9ee7-0dfe9b7bf7e9 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:54.465885 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-cbb7b43f-f8f1-4e1c-9ee7-0dfe9b7bf7e9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 11:20:54.465885 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:20:54.465885 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:20:54.465885 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:20:54.465885 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:20:54.465885 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:20:54.465885 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:20:54.465885 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:20:54.465885 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:20:54.465885 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:20:54.465885 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:20:54.465885 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:20:54.465885 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 11:20:54.465885 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 11:20:54.465885 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 11:20:54.466784 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 11:20:54.466784 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:20:54.466784 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:20:54.466784 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:20:54.466784 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:20:54.466784 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:20:54.466784 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:20:54.466784 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:20:54.466784 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Aug 24 11:20:54.466784 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:20:54.466784 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:20:54.466784 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:20:54.466784 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:20:54.466784 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:20:54.466784 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:20:54.466784 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:20:54.466784 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:20:54.467724 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 11:20:54.467724 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 11:20:54.467724 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 11:20:54.467724 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 11:20:54.467724 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 11:20:54.467724 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 11:20:54.467724 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 11:20:54.467724 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:20:54.474814 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 377/748] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Aug 24 11:20:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:20:54.475986 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb7b43f-f8f1-4e1c-9ee7-0dfe9b7bf7e9 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:54.501726 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:54.538470 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45dfb70-3dfa-4551-8984-b6229ee36ce2 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:54.573969 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28c6467-1aae-4d20-a895-3d399f3e4406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:54.574826 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28c6467-1aae-4d20-a895-3d399f3e4406 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:54.575170 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28c6467-1aae-4d20-a895-3d399f3e4406 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:54.575507 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28c6467-1aae-4d20-a895-3d399f3e4406 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:54.585308 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb7b43f-f8f1-4e1c-9ee7-0dfe9b7bf7e9 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:54.586485 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28c6467-1aae-4d20-a895-3d399f3e4406 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:54.588953 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28c6467-1aae-4d20-a895-3d399f3e4406 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:54.604119 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-b28c6467-1aae-4d20-a895-3d399f3e4406 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:20:54.604119 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:20:54.604119 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:20:54.604119 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:20:54.604119 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:20:54.604119 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:20:54.604119 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:20:54.604119 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:20:54.604119 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:20:54.604119 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:20:54.604119 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:20:54.604119 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:20:54.604119 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 11:20:54.604119 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 11:20:54.604119 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 11:20:54.604119 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 11:20:54.605140 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:20:54.605140 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:20:54.605140 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:20:54.605140 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:20:54.605140 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:20:54.605140 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:20:54.605140 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:20:54.605140 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Aug 24 11:20:54.605140 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:20:54.605140 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:20:54.605140 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:20:54.605140 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:20:54.605140 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:20:54.605140 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:20:54.605140 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:20:54.605140 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:20:54.605140 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 11:20:54.606050 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 11:20:54.606050 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:20:54.606050 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Aug 24 11:20:54.606050 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 372/749] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 11:20:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:20:54.606959 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28c6467-1aae-4d20-a895-3d399f3e4406 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:54.624865 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b330c2bb-9536-456a-ab84-352a35993ded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:54.625767 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b330c2bb-9536-456a-ab84-352a35993ded None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:54.626262 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b330c2bb-9536-456a-ab84-352a35993ded None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:54.626779 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b330c2bb-9536-456a-ab84-352a35993ded None admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:54.627658 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b330c2bb-9536-456a-ab84-352a35993ded None admin] RBAC: Adding query filter params (name=service) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:20:54.628128 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b330c2bb-9536-456a-ab84-352a35993ded None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:54.629737 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b330c2bb-9536-456a-ab84-352a35993ded None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:54.638926 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 378/750] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Aug 24 11:20:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:54.640049 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b330c2bb-9536-456a-ab84-352a35993ded None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:54.670110 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:54.713778 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28c6467-1aae-4d20-a895-3d399f3e4406 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:54.735015 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:54.749750 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b330c2bb-9536-456a-ab84-352a35993ded None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:54.750701 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7627f981-0420-4c4a-9e38-d05527cd1504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:54.751402 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7627f981-0420-4c4a-9e38-d05527cd1504 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:54.751739 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7627f981-0420-4c4a-9e38-d05527cd1504 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:54.752153 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7627f981-0420-4c4a-9e38-d05527cd1504 None admin] PATH_INFO: `/v3/projects` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:54.752922 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7627f981-0420-4c4a-9e38-d05527cd1504 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:20:54.753988 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7627f981-0420-4c4a-9e38-d05527cd1504 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:54.754990 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7627f981-0420-4c4a-9e38-d05527cd1504 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:54.773443 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 373/751] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Aug 24 11:20:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:54.773443 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7627f981-0420-4c4a-9e38-d05527cd1504 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:54.800102 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5f6878-aa60-4ce4-b925-f8c04c452882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:54.800923 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5f6878-aa60-4ce4-b925-f8c04c452882 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:54.801195 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5f6878-aa60-4ce4-b925-f8c04c452882 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:54.801460 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5f6878-aa60-4ce4-b925-f8c04c452882 None admin] PATH_INFO: `/v3/domains` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:54.802725 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5f6878-aa60-4ce4-b925-f8c04c452882 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:20:54.803028 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5f6878-aa60-4ce4-b925-f8c04c452882 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:54.804777 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5f6878-aa60-4ce4-b925-f8c04c452882 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:54.821565 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 379/752] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 24 11:20:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:54.822531 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5f6878-aa60-4ce4-b925-f8c04c452882 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:54.892279 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7627f981-0420-4c4a-9e38-d05527cd1504 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:54.918394 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:54.931416 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5f6878-aa60-4ce4-b925-f8c04c452882 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:54.931565 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202899f1-a8bf-476a-abb3-bdd2e245bf94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:54.932046 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202899f1-a8bf-476a-abb3-bdd2e245bf94 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:54.932320 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202899f1-a8bf-476a-abb3-bdd2e245bf94 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:54.932586 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202899f1-a8bf-476a-abb3-bdd2e245bf94 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:54.942834 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202899f1-a8bf-476a-abb3-bdd2e245bf94 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:54.944292 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202899f1-a8bf-476a-abb3-bdd2e245bf94 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:54.958862 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-202899f1-a8bf-476a-abb3-bdd2e245bf94 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:20:54.958862 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:20:54.958862 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:20:54.958862 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:20:54.958862 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:20:54.958862 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:20:54.958862 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:20:54.958862 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:20:54.958862 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:20:54.958862 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:20:54.958862 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:20:54.958862 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:20:54.958862 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 11:20:54.958862 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 11:20:54.958862 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 11:20:54.958862 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 11:20:54.959809 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:20:54.959809 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:20:54.959809 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:20:54.959809 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:20:54.959809 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:20:54.959809 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:20:54.959809 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:20:54.959809 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Aug 24 11:20:54.959809 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:20:54.959809 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:20:54.959809 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:20:54.959809 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:20:54.959809 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:20:54.959809 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:20:54.959809 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:20:54.959809 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:20:54.959809 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 11:20:54.960716 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 11:20:54.960716 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:20:54.960716 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Aug 24 11:20:54.964941 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 374/753] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 11:20:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:20:54.965701 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202899f1-a8bf-476a-abb3-bdd2e245bf94 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:54.970661 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aefdad8-7b25-4b9c-848a-689aa0ff2d7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:54.971276 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aefdad8-7b25-4b9c-848a-689aa0ff2d7e None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:54.971553 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aefdad8-7b25-4b9c-848a-689aa0ff2d7e None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:54.971822 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aefdad8-7b25-4b9c-848a-689aa0ff2d7e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:54.972648 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aefdad8-7b25-4b9c-848a-689aa0ff2d7e None admin] RBAC: Adding query filter params (role.id=30bb1e97257f4ca5b90c88545777317b, scope.project.id=317f54a463cb48ab86648c6dcec5db0f, user.id=f1069558c085449f9e4c9f06013b2a85) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:20:54.972960 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aefdad8-7b25-4b9c-848a-689aa0ff2d7e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:54.974415 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aefdad8-7b25-4b9c-848a-689aa0ff2d7e None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:54.987855 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 380/754] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Aug 24 11:20:54 2022] GET /identity/v3/role_assignments?user.id=f1069558c085449f9e4c9f06013b2a85&scope.project.id=317f54a463cb48ab86648c6dcec5db0f&role.id=30bb1e97257f4ca5b90c88545777317b => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:54.987855 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31577ddc-a5b5-433a-a601-0236dcc239f4 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:54.987855 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31577ddc-a5b5-433a-a601-0236dcc239f4 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:54.987855 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31577ddc-a5b5-433a-a601-0236dcc239f4 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:54.987855 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 381/755] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:20:54 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:20:54.987855 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31577ddc-a5b5-433a-a601-0236dcc239f4 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:55.014022 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:55.096126 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202899f1-a8bf-476a-abb3-bdd2e245bf94 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:55.140453 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4b315c-7c17-48d3-8009-f4f7b0649120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:55.140746 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31577ddc-a5b5-433a-a601-0236dcc239f4 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:55.141124 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4b315c-7c17-48d3-8009-f4f7b0649120 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:55.141395 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4b315c-7c17-48d3-8009-f4f7b0649120 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:55.141661 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4b315c-7c17-48d3-8009-f4f7b0649120 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:55.154175 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4b315c-7c17-48d3-8009-f4f7b0649120 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:55.156014 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4b315c-7c17-48d3-8009-f4f7b0649120 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:55.189370 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f7a2f5-8dc6-4dba-a08c-a63f9cd3f645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:55.190123 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f7a2f5-8dc6-4dba-a08c-a63f9cd3f645 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:55.190442 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f7a2f5-8dc6-4dba-a08c-a63f9cd3f645 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:55.190710 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f7a2f5-8dc6-4dba-a08c-a63f9cd3f645 None admin] PATH_INFO: `/v3/domains` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:55.191541 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f7a2f5-8dc6-4dba-a08c-a63f9cd3f645 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:20:55.191840 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f7a2f5-8dc6-4dba-a08c-a63f9cd3f645 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:55.193251 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f7a2f5-8dc6-4dba-a08c-a63f9cd3f645 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:55.206564 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 382/756] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 24 11:20:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:55.208159 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019cd1d2-c800-4036-afa7-35446bff4d49 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:55.208449 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019cd1d2-c800-4036-afa7-35446bff4d49 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:55.208720 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019cd1d2-c800-4036-afa7-35446bff4d49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:55.228468 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-019cd1d2-c800-4036-afa7-35446bff4d49 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:20:55.229722 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-019cd1d2-c800-4036-afa7-35446bff4d49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:20:55.238912 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:55.290272 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-cc4b315c-7c17-48d3-8009-f4f7b0649120 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 11:20:55.290272 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:20:55.290272 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:20:55.290272 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:20:55.290272 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:20:55.290272 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:20:55.290272 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:20:55.290272 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:20:55.290272 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:20:55.290272 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:20:55.290272 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:20:55.290272 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:20:55.290272 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 11:20:55.290272 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 11:20:55.290272 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 11:20:55.296614 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 11:20:55.296614 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:20:55.296614 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:20:55.296614 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:20:55.296614 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:20:55.296614 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:20:55.296614 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:20:55.296614 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:20:55.296614 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Aug 24 11:20:55.296614 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:20:55.296614 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:20:55.296614 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:20:55.296614 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:20:55.296614 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:20:55.296614 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:20:55.296614 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:20:55.296614 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:20:55.297567 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 11:20:55.297567 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 11:20:55.297567 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 11:20:55.297567 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 11:20:55.297567 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 11:20:55.297567 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 11:20:55.297567 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 11:20:55.297567 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Aug 24 11:20:55.297567 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 375/757] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Aug 24 11:20:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:20:55.297567 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbcaa20-01de-4288-b15b-32f625106b13 None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:55.297567 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbcaa20-01de-4288-b15b-32f625106b13 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:55.298216 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbcaa20-01de-4288-b15b-32f625106b13 None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:55.298216 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 376/758] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:20:55 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:20:55.298216 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbcaa20-01de-4288-b15b-32f625106b13 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:55.315844 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 383/759] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:20:55 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 11:20:55.316558 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019cd1d2-c800-4036-afa7-35446bff4d49 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:55.419406 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:55.434776 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbcaa20-01de-4288-b15b-32f625106b13 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:55.455719 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019cd1d2-c800-4036-afa7-35446bff4d49 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:55.477674 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7543c5-cabb-4987-9992-ae38bfbd2942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:55.478292 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7543c5-cabb-4987-9992-ae38bfbd2942 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:55.478595 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7543c5-cabb-4987-9992-ae38bfbd2942 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:55.478863 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7543c5-cabb-4987-9992-ae38bfbd2942 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:55.486243 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7543c5-cabb-4987-9992-ae38bfbd2942 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:55.487822 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7543c5-cabb-4987-9992-ae38bfbd2942 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:55.495256 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc16275-63d5-4ae0-80d1-547286cc8b39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:55.496055 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc16275-63d5-4ae0-80d1-547286cc8b39 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:55.496489 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc16275-63d5-4ae0-80d1-547286cc8b39 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:55.496899 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc16275-63d5-4ae0-80d1-547286cc8b39 None admin] PATH_INFO: `/v3/projects` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:55.497770 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc16275-63d5-4ae0-80d1-547286cc8b39 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:20:55.498261 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc16275-63d5-4ae0-80d1-547286cc8b39 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:55.499519 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-4b7543c5-cabb-4987-9992-ae38bfbd2942 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 11:20:55.499519 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:20:55.499519 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:20:55.499519 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:20:55.499519 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:20:55.499519 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:20:55.499519 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:20:55.499519 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:20:55.499519 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:20:55.499519 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:20:55.499519 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:20:55.499519 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:20:55.499519 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 11:20:55.499519 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 11:20:55.499519 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 11:20:55.499519 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 11:20:55.500651 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:20:55.500651 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:20:55.500651 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 11:20:55.500651 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 11:20:55.500651 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 11:20:55.500651 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 11:20:55.500651 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:20:55.500651 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:20:55.500651 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:20:55.500651 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:20:55.500651 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:20:55.500651 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Aug 24 11:20:55.500651 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:20:55.500651 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:20:55.500651 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:20:55.500651 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:20:55.500651 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:20:55.500651 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:20:55.501795 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:20:55.501795 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:20:55.501795 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 11:20:55.501795 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 11:20:55.501795 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 11:20:55.501795 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 11:20:55.501795 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 11:20:55.501795 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 11:20:55.501795 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 11:20:55.501795 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Aug 24 11:20:55.502764 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc16275-63d5-4ae0-80d1-547286cc8b39 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:55.505444 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 377/760] 10.222.0.27 () {56 vars in 1117 bytes} [Wed Aug 24 11:20:55 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:20:55.506693 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1b7dbf-17fc-47ad-8cd3-9960973ef33e None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:55.506972 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1b7dbf-17fc-47ad-8cd3-9960973ef33e None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:55.507258 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1b7dbf-17fc-47ad-8cd3-9960973ef33e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:55.522286 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 384/761] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Aug 24 11:20:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:55.523688 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc16275-63d5-4ae0-80d1-547286cc8b39 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:55.526274 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-bf1b7dbf-17fc-47ad-8cd3-9960973ef33e None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:20:55.527842 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:55.527961 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-bf1b7dbf-17fc-47ad-8cd3-9960973ef33e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:20:55.596046 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 378/762] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:20:55 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 11:20:55.596879 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1b7dbf-17fc-47ad-8cd3-9960973ef33e None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:55.634733 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc16275-63d5-4ae0-80d1-547286cc8b39 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:55.671656 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52b871f-d024-41fa-872f-b3e89e8052c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:55.672647 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52b871f-d024-41fa-872f-b3e89e8052c3 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:55.673170 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52b871f-d024-41fa-872f-b3e89e8052c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:55.673616 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52b871f-d024-41fa-872f-b3e89e8052c3 None admin] PATH_INFO: `/v3/users` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:55.674628 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52b871f-d024-41fa-872f-b3e89e8052c3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:20:55.675110 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52b871f-d024-41fa-872f-b3e89e8052c3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:55.676784 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52b871f-d024-41fa-872f-b3e89e8052c3 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:55.690393 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:55.696871 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 385/763] 10.222.0.27 () {56 vars in 1149 bytes} [Wed Aug 24 11:20:55 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:55.697992 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52b871f-d024-41fa-872f-b3e89e8052c3 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:55.717043 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1b7dbf-17fc-47ad-8cd3-9960973ef33e None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:55.770784 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2b7c39-43e1-4a13-af5c-40e7d37e1554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:55.770784 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2b7c39-43e1-4a13-af5c-40e7d37e1554 None admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:55.770784 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2b7c39-43e1-4a13-af5c-40e7d37e1554 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:55.770784 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2b7c39-43e1-4a13-af5c-40e7d37e1554 None admin] PATH_INFO: `/v3/projects/317f54a463cb48ab86648c6dcec5db0f/users/282ec32864d046b2bea170f6a3845cc0/roles/30bb1e97257f4ca5b90c88545777317b` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:55.771195 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2b7c39-43e1-4a13-af5c-40e7d37e1554 None admin] RBAC: Authorizing `identity:create_grant(project_id=317f54a463cb48ab86648c6dcec5db0f, user_id=282ec32864d046b2bea170f6a3845cc0, role_id=30bb1e97257f4ca5b90c88545777317b)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:55.771863 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2b7c39-43e1-4a13-af5c-40e7d37e1554 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:55.774096 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:55.798381 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 379/764] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Aug 24 11:20:55 2022] PUT /identity/v3/projects/317f54a463cb48ab86648c6dcec5db0f/users/282ec32864d046b2bea170f6a3845cc0/roles/30bb1e97257f4ca5b90c88545777317b => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:20:55.798381 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2b7c39-43e1-4a13-af5c-40e7d37e1554 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:55.881864 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52b871f-d024-41fa-872f-b3e89e8052c3 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:55.923123 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1325d41f-e0f0-4f72-92f2-79c693cffa67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:55.923818 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1325d41f-e0f0-4f72-92f2-79c693cffa67 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:55.924094 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1325d41f-e0f0-4f72-92f2-79c693cffa67 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:55.924405 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1325d41f-e0f0-4f72-92f2-79c693cffa67 None admin] PATH_INFO: `/v3/services/network` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:55.925055 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1325d41f-e0f0-4f72-92f2-79c693cffa67 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:55.926551 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1325d41f-e0f0-4f72-92f2-79c693cffa67 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:55.936480 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-1325d41f-e0f0-4f72-92f2-79c693cffa67 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 11:20:55.936480 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:20:55.936480 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 11:20:55.936480 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 11:20:55.936480 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 11:20:55.936480 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 11:20:55.936480 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 11:20:55.936480 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 11:20:55.936480 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 11:20:55.936480 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:20:55.936480 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 11:20:55.936480 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:20:55.936480 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:20:55.936480 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:20:55.936480 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:20:55.936480 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:20:55.936480 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:20:55.937534 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:20:55.937534 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:20:55.937534 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:20:55.937534 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:20:55.937534 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:20:55.937534 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:20:55.937534 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 11:20:55.937534 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 11:20:55.937534 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 11:20:55.937534 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 11:20:55.937534 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:20:55.937534 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:20:55.937534 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:20:55.937534 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:20:55.937534 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:20:55.937534 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:20:55.938396 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:20:55.938396 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Aug 24 11:20:55.938396 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:20:55.938396 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:20:55.938396 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:20:55.938396 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:20:55.938396 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:20:55.938396 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:20:55.938396 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:20:55.938396 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:20:55.938396 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 11:20:55.938396 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 11:20:55.938396 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 11:20:55.938396 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:20:55.943344 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 386/765] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Aug 24 11:20:55 2022] GET /identity/v3/services/network => generated 88 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:20:55.943688 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1325d41f-e0f0-4f72-92f2-79c693cffa67 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:55.966774 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2b7c39-43e1-4a13-af5c-40e7d37e1554 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:56.003492 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e918e8-db1a-4be6-8a1f-c4eed31be12e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:56.004096 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e918e8-db1a-4be6-8a1f-c4eed31be12e None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:56.004419 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e918e8-db1a-4be6-8a1f-c4eed31be12e None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:56.004680 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e918e8-db1a-4be6-8a1f-c4eed31be12e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:56.017611 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:56.065635 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1325d41f-e0f0-4f72-92f2-79c693cffa67 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:56.084275 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e918e8-db1a-4be6-8a1f-c4eed31be12e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:56.085831 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e918e8-db1a-4be6-8a1f-c4eed31be12e None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:56.108683 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:56.128638 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfa2aca-c5ff-452d-98d5-2c9752d07851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:56.129283 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfa2aca-c5ff-452d-98d5-2c9752d07851 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:56.129563 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfa2aca-c5ff-452d-98d5-2c9752d07851 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:56.129832 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfa2aca-c5ff-452d-98d5-2c9752d07851 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:56.130499 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfa2aca-c5ff-452d-98d5-2c9752d07851 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:56.131915 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfa2aca-c5ff-452d-98d5-2c9752d07851 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:56.142442 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-3cfa2aca-c5ff-452d-98d5-2c9752d07851 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 11:20:56.142442 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:20:56.142442 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 11:20:56.142442 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 11:20:56.142442 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 11:20:56.142442 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 11:20:56.142442 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 11:20:56.142442 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 11:20:56.142442 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 11:20:56.142442 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:20:56.142442 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 11:20:56.142442 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:20:56.142442 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:20:56.142442 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:20:56.142442 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:20:56.142442 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:20:56.142442 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:20:56.143636 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:20:56.143636 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:20:56.143636 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:20:56.143636 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:20:56.143636 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:20:56.143636 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:20:56.143636 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 11:20:56.143636 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 11:20:56.143636 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 11:20:56.143636 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 11:20:56.143636 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:20:56.143636 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:20:56.143636 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:20:56.143636 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:20:56.143636 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:20:56.143636 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:20:56.144613 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:20:56.144613 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Aug 24 11:20:56.144613 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:20:56.144613 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:20:56.144613 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:20:56.144613 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:20:56.144613 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:20:56.144613 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:20:56.144613 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:20:56.144613 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:20:56.144613 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 11:20:56.144613 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 11:20:56.144613 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 11:20:56.144613 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:20:56.148642 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 387/766] 10.222.0.27 () {56 vars in 1129 bytes} [Wed Aug 24 11:20:55 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:20:56.149597 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfa2aca-c5ff-452d-98d5-2c9752d07851 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:56.254636 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfa2aca-c5ff-452d-98d5-2c9752d07851 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:56.261441 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 380/767] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 24 11:20:55 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 11:20:56.262650 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e918e8-db1a-4be6-8a1f-c4eed31be12e None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:56.294227 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e0dfcd-62a5-4df7-af31-8d6afcf4c303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:56.294920 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e0dfcd-62a5-4df7-af31-8d6afcf4c303 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:56.295201 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e0dfcd-62a5-4df7-af31-8d6afcf4c303 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:56.295657 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e0dfcd-62a5-4df7-af31-8d6afcf4c303 None admin] PATH_INFO: `/v3/services` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:56.296141 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e0dfcd-62a5-4df7-af31-8d6afcf4c303 None admin] RBAC: Adding query filter params (name=network) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:20:56.296438 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e0dfcd-62a5-4df7-af31-8d6afcf4c303 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:56.297828 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e0dfcd-62a5-4df7-af31-8d6afcf4c303 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:56.307381 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 388/768] 10.222.0.27 () {56 vars in 1112 bytes} [Wed Aug 24 11:20:56 2022] GET /identity/v3/services?name=network => generated 124 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:56.307381 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e0dfcd-62a5-4df7-af31-8d6afcf4c303 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:56.326415 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:56.362397 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:56.400226 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e918e8-db1a-4be6-8a1f-c4eed31be12e None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:56.413370 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e0dfcd-62a5-4df7-af31-8d6afcf4c303 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:56.449915 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfc3092-3683-4d85-8dc5-1360349539e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:56.450145 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30708ff-7ae2-4272-91b0-d4bd61aaa56c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:56.450852 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30708ff-7ae2-4272-91b0-d4bd61aaa56c None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:56.451100 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfc3092-3683-4d85-8dc5-1360349539e9 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:56.451352 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30708ff-7ae2-4272-91b0-d4bd61aaa56c None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:56.451663 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfc3092-3683-4d85-8dc5-1360349539e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:56.451773 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30708ff-7ae2-4272-91b0-d4bd61aaa56c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:56.452155 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfc3092-3683-4d85-8dc5-1360349539e9 None admin] PATH_INFO: `/v3/services` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:56.453168 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfc3092-3683-4d85-8dc5-1360349539e9 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:20:56.453625 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfc3092-3683-4d85-8dc5-1360349539e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:56.455817 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfc3092-3683-4d85-8dc5-1360349539e9 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:56.461715 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 381/769] 10.222.0.27 () {56 vars in 1124 bytes} [Wed Aug 24 11:20:56 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:56.462797 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfc3092-3683-4d85-8dc5-1360349539e9 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:56.469034 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30708ff-7ae2-4272-91b0-d4bd61aaa56c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:56.470694 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30708ff-7ae2-4272-91b0-d4bd61aaa56c None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:56.486234 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-e30708ff-7ae2-4272-91b0-d4bd61aaa56c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:20:56.486234 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:20:56.486234 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:20:56.486234 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:20:56.486234 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:20:56.486234 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:20:56.486234 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:20:56.486234 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:20:56.486234 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:20:56.486234 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:20:56.486234 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:20:56.486234 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:20:56.486234 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 11:20:56.486234 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 11:20:56.486234 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 11:20:56.486234 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 11:20:56.487484 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:20:56.487484 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:20:56.487484 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:20:56.487484 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:20:56.487484 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:20:56.487484 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:20:56.487484 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:20:56.487484 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Aug 24 11:20:56.487484 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:20:56.487484 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:20:56.487484 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:20:56.487484 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:20:56.487484 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:20:56.487484 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:20:56.487484 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:20:56.487484 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:20:56.487484 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 11:20:56.488638 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 11:20:56.488638 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:20:56.488638 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:20:56.494598 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 389/770] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 11:20:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:20:56.494598 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30708ff-7ae2-4272-91b0-d4bd61aaa56c None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:56.596750 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfc3092-3683-4d85-8dc5-1360349539e9 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:56.598129 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30708ff-7ae2-4272-91b0-d4bd61aaa56c None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:56.601320 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:56.606451 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:56.635921 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6546ea3b-b7c5-43af-b27a-210f9a4fd31c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:56.636684 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6546ea3b-b7c5-43af-b27a-210f9a4fd31c None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:56.637064 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6546ea3b-b7c5-43af-b27a-210f9a4fd31c None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:56.637404 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6546ea3b-b7c5-43af-b27a-210f9a4fd31c None admin] PATH_INFO: `/v3/services` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:56.638195 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6546ea3b-b7c5-43af-b27a-210f9a4fd31c None admin] RBAC: Adding query filter params (type=network) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:20:56.638724 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6546ea3b-b7c5-43af-b27a-210f9a4fd31c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:56.640274 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6546ea3b-b7c5-43af-b27a-210f9a4fd31c None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:56.645372 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbce764b-64e1-4dcc-8d46-5e9bef38843d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:56.646153 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbce764b-64e1-4dcc-8d46-5e9bef38843d None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:56.646584 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbce764b-64e1-4dcc-8d46-5e9bef38843d None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:56.647009 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbce764b-64e1-4dcc-8d46-5e9bef38843d None admin] PATH_INFO: `/v3/services` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:56.647769 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbce764b-64e1-4dcc-8d46-5e9bef38843d None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:20:56.648202 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbce764b-64e1-4dcc-8d46-5e9bef38843d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:56.649709 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbce764b-64e1-4dcc-8d46-5e9bef38843d None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:56.650448 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 382/771] 10.222.0.27 () {56 vars in 1112 bytes} [Wed Aug 24 11:20:56 2022] GET /identity/v3/services?type=network => generated 350 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:56.651497 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6546ea3b-b7c5-43af-b27a-210f9a4fd31c None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:56.658654 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 390/772] 10.222.0.27 () {56 vars in 1124 bytes} [Wed Aug 24 11:20:56 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:56.659707 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbce764b-64e1-4dcc-8d46-5e9bef38843d None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:56.759472 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6546ea3b-b7c5-43af-b27a-210f9a4fd31c None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:56.791090 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbce764b-64e1-4dcc-8d46-5e9bef38843d None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:56.805478 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16358fba-7cf8-46fe-a0cb-c592113368a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:56.806585 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16358fba-7cf8-46fe-a0cb-c592113368a9 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:56.807026 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16358fba-7cf8-46fe-a0cb-c592113368a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:56.807877 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16358fba-7cf8-46fe-a0cb-c592113368a9 None admin] PATH_INFO: `/v3/domains` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:56.808938 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16358fba-7cf8-46fe-a0cb-c592113368a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:20:56.809396 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16358fba-7cf8-46fe-a0cb-c592113368a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:56.811572 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16358fba-7cf8-46fe-a0cb-c592113368a9 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:56.828080 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 383/773] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 24 11:20:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:56.829159 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16358fba-7cf8-46fe-a0cb-c592113368a9 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:56.835729 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7ef05d-5d85-4142-af2f-ea803ef3f78d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:56.836384 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7ef05d-5d85-4142-af2f-ea803ef3f78d None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:56.836662 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7ef05d-5d85-4142-af2f-ea803ef3f78d None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:56.836928 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7ef05d-5d85-4142-af2f-ea803ef3f78d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:56.837641 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7ef05d-5d85-4142-af2f-ea803ef3f78d None admin] RBAC: Adding query filter params (interface=public, service_id=d73f54e05f3a4919a21c28c7076319f6, region_id=RegionOne) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:20:56.837954 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7ef05d-5d85-4142-af2f-ea803ef3f78d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:56.839413 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7ef05d-5d85-4142-af2f-ea803ef3f78d None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:56.850294 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 391/774] 10.222.0.27 () {56 vars in 1251 bytes} [Wed Aug 24 11:20:56 2022] GET /identity/v3/endpoints?service_id=d73f54e05f3a4919a21c28c7076319f6&interface=public®ion_id=RegionOne => generated 194 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:56.851120 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7ef05d-5d85-4142-af2f-ea803ef3f78d None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:56.867441 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:56.891300 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:56.963759 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16358fba-7cf8-46fe-a0cb-c592113368a9 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:56.978136 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7ef05d-5d85-4142-af2f-ea803ef3f78d None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:56.999353 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f46708-7fa1-4eb7-8ff6-ff59db58b303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:56.999965 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f46708-7fa1-4eb7-8ff6-ff59db58b303 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:57.000743 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f46708-7fa1-4eb7-8ff6-ff59db58b303 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:57.001021 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f46708-7fa1-4eb7-8ff6-ff59db58b303 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:57.001727 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f46708-7fa1-4eb7-8ff6-ff59db58b303 None admin] RBAC: Adding query filter params (interface=public, service_id=a67309255b284534b71345456b57ee31, region_id=RegionOne) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:20:57.002033 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f46708-7fa1-4eb7-8ff6-ff59db58b303 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:57.003486 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f46708-7fa1-4eb7-8ff6-ff59db58b303 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:57.011070 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 384/775] 10.222.0.27 () {56 vars in 1251 bytes} [Wed Aug 24 11:20:56 2022] GET /identity/v3/endpoints?service_id=a67309255b284534b71345456b57ee31&interface=public®ion_id=RegionOne => generated 194 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:57.011664 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f46708-7fa1-4eb7-8ff6-ff59db58b303 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:57.019250 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d034c9bf-52ed-4026-8327-0184c47f2188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:57.019250 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d034c9bf-52ed-4026-8327-0184c47f2188 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:57.019250 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d034c9bf-52ed-4026-8327-0184c47f2188 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:57.019250 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d034c9bf-52ed-4026-8327-0184c47f2188 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:57.022421 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d034c9bf-52ed-4026-8327-0184c47f2188 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:57.023872 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d034c9bf-52ed-4026-8327-0184c47f2188 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:57.035658 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-d034c9bf-52ed-4026-8327-0184c47f2188 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 11:20:57.035658 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:20:57.035658 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:20:57.035658 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:20:57.035658 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:20:57.035658 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:20:57.035658 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:20:57.035658 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:20:57.035658 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:20:57.035658 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:20:57.035658 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:20:57.035658 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:20:57.035658 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 11:20:57.035658 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 11:20:57.035658 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 11:20:57.036594 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 11:20:57.036594 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:20:57.036594 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:20:57.036594 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:20:57.036594 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:20:57.036594 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:20:57.036594 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:20:57.036594 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:20:57.036594 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Aug 24 11:20:57.036594 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:20:57.036594 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:20:57.036594 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:20:57.036594 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:20:57.036594 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:20:57.036594 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:20:57.036594 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:20:57.036594 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:20:57.037485 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 11:20:57.037485 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 11:20:57.037485 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 11:20:57.037485 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 11:20:57.037485 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 11:20:57.037485 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 11:20:57.037485 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 11:20:57.037485 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:20:57.037485 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 392/776] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Aug 24 11:20:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:20:57.037971 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae65fb86-41fc-450f-8d10-fd1b93356a25 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:57.038340 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae65fb86-41fc-450f-8d10-fd1b93356a25 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:57.038472 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae65fb86-41fc-450f-8d10-fd1b93356a25 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:57.039897 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 393/777] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:20:57 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:20:57.040594 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae65fb86-41fc-450f-8d10-fd1b93356a25 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:57.120136 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:57.127824 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f46708-7fa1-4eb7-8ff6-ff59db58b303 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:57.142089 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:57.157126 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae65fb86-41fc-450f-8d10-fd1b93356a25 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:57.165176 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14423ac4-4a60-4945-ada1-fee411642bd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:57.165816 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14423ac4-4a60-4945-ada1-fee411642bd0 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:57.166090 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14423ac4-4a60-4945-ada1-fee411642bd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:57.166373 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14423ac4-4a60-4945-ada1-fee411642bd0 None admin] PATH_INFO: `/v3/services` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:57.167030 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14423ac4-4a60-4945-ada1-fee411642bd0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:57.168420 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14423ac4-4a60-4945-ada1-fee411642bd0 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:57.182392 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 385/778] 10.222.0.27 () {56 vars in 1087 bytes} [Wed Aug 24 11:20:57 2022] GET /identity/v3/services => generated 772 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:57.182392 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14423ac4-4a60-4945-ada1-fee411642bd0 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:57.198343 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11b9820-b7d1-40bf-a413-1b263f71297d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:57.199100 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11b9820-b7d1-40bf-a413-1b263f71297d None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:57.199419 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11b9820-b7d1-40bf-a413-1b263f71297d None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:57.199751 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11b9820-b7d1-40bf-a413-1b263f71297d None admin] PATH_INFO: `/v3/services` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:57.200453 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11b9820-b7d1-40bf-a413-1b263f71297d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:57.201966 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11b9820-b7d1-40bf-a413-1b263f71297d None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:57.218780 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 394/779] 10.222.0.27 () {56 vars in 1087 bytes} [Wed Aug 24 11:20:57 2022] GET /identity/v3/services => generated 772 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:57.221944 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfa2b98-32c8-4846-81ab-32230f06bc9d None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:57.223486 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfa2b98-32c8-4846-81ab-32230f06bc9d None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:57.223921 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfa2b98-32c8-4846-81ab-32230f06bc9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:57.262601 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-abfa2b98-32c8-4846-81ab-32230f06bc9d None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:20:57.266070 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-abfa2b98-32c8-4846-81ab-32230f06bc9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:20:57.369304 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14423ac4-4a60-4945-ada1-fee411642bd0 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:57.398519 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 395/780] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:20:57 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 11:20:57.419083 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49d4779-0a0b-4c15-8b23-01293a6ee68d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:57.419428 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49d4779-0a0b-4c15-8b23-01293a6ee68d None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:57.419714 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49d4779-0a0b-4c15-8b23-01293a6ee68d None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:57.419987 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49d4779-0a0b-4c15-8b23-01293a6ee68d None admin] PATH_INFO: `/v3/projects` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:57.420702 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49d4779-0a0b-4c15-8b23-01293a6ee68d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:20:57.421007 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49d4779-0a0b-4c15-8b23-01293a6ee68d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:57.423712 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49d4779-0a0b-4c15-8b23-01293a6ee68d None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:57.438526 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 386/781] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Aug 24 11:20:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:57.444382 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfa2b98-32c8-4846-81ab-32230f06bc9d None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:57.541077 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:57.560477 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfa2b98-32c8-4846-81ab-32230f06bc9d None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:57.607999 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda96313-800d-4420-950e-75b99867e7d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:57.608620 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda96313-800d-4420-950e-75b99867e7d0 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:57.608896 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda96313-800d-4420-950e-75b99867e7d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:57.609227 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda96313-800d-4420-950e-75b99867e7d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:57.609966 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda96313-800d-4420-950e-75b99867e7d0 None admin] RBAC: Adding query filter params (role.id=217baac59e08499ea2f1b1d84935df0b, scope.project.id=317f54a463cb48ab86648c6dcec5db0f, user.id=a5915030f01941fc89f92228ff57c7f0) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:20:57.610271 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda96313-800d-4420-950e-75b99867e7d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:57.611744 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda96313-800d-4420-950e-75b99867e7d0 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:57.621918 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 396/782] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Aug 24 11:20:57 2022] GET /identity/v3/role_assignments?user.id=a5915030f01941fc89f92228ff57c7f0&scope.project.id=317f54a463cb48ab86648c6dcec5db0f&role.id=217baac59e08499ea2f1b1d84935df0b => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:57.680464 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49d4779-0a0b-4c15-8b23-01293a6ee68d None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:57.701407 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:57.811929 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49d4779-0a0b-4c15-8b23-01293a6ee68d None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:57.850649 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d40e64-74c9-44ee-964c-766e029e4dff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:57.851291 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d40e64-74c9-44ee-964c-766e029e4dff None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:57.851571 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d40e64-74c9-44ee-964c-766e029e4dff None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:57.851831 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d40e64-74c9-44ee-964c-766e029e4dff None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:57.862869 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d40e64-74c9-44ee-964c-766e029e4dff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:20:57.867506 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-64d40e64-74c9-44ee-964c-766e029e4dff None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 11:20:57.867506 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:20:57.867506 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:20:57.867506 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:20:57.867506 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:20:57.867506 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:20:57.867506 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:20:57.867506 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:20:57.867506 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:20:57.867506 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:20:57.867506 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:20:57.867506 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:20:57.867506 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:20:57.867506 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:20:57.867506 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:20:57.867506 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:20:57.868434 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:20:57.868434 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:20:57.868434 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:20:57.868434 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:20:57.868434 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:20:57.868434 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:20:57.868434 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:20:57.868434 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:20:57.868434 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:20:57.868434 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:20:57.868434 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:20:57.868434 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Aug 24 11:20:57.868434 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:20:57.868434 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:20:57.868434 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:20:57.868434 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:20:57.869340 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:20:57.869340 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:20:57.869340 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:20:57.869340 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:20:57.869340 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:20:57.869340 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:20:57.869340 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:20:57.869340 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:20:57.869340 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:20:57.869340 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:20:57.869340 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 11:20:57.869340 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Aug 24 11:20:57.869340 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 387/783] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Aug 24 11:20:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:20:57.877106 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda96313-800d-4420-950e-75b99867e7d0 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:57.892944 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f14f36-1923-4d67-aa5f-4cf8174551d1 None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:57.893272 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f14f36-1923-4d67-aa5f-4cf8174551d1 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:57.894825 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f14f36-1923-4d67-aa5f-4cf8174551d1 None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:57.896470 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 388/784] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:20:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:20:57.904690 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbdebb2-fc7c-4f25-a321-95d66afa0ec1 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:57.904965 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbdebb2-fc7c-4f25-a321-95d66afa0ec1 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:57.905228 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbdebb2-fc7c-4f25-a321-95d66afa0ec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:57.937500 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-3bbdebb2-fc7c-4f25-a321-95d66afa0ec1 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:20:57.938723 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-3bbdebb2-fc7c-4f25-a321-95d66afa0ec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:20:58.052873 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda96313-800d-4420-950e-75b99867e7d0 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:58.082482 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 389/785] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:20:57 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 11:20:58.107994 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c039415f-89cf-4099-846c-3494b871e913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:58.108677 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c039415f-89cf-4099-846c-3494b871e913 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:58.108958 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c039415f-89cf-4099-846c-3494b871e913 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:58.109232 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c039415f-89cf-4099-846c-3494b871e913 None admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:58.109899 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c039415f-89cf-4099-846c-3494b871e913 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:20:58.110195 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c039415f-89cf-4099-846c-3494b871e913 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:58.113553 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c039415f-89cf-4099-846c-3494b871e913 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:58.130041 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 397/786] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 24 11:20:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:58.135653 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbdebb2-fc7c-4f25-a321-95d66afa0ec1 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:58.156302 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:58.280307 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbdebb2-fc7c-4f25-a321-95d66afa0ec1 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:58.320629 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23caa85-32df-4d04-80e4-87ecd5049236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:58.321256 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23caa85-32df-4d04-80e4-87ecd5049236 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:58.321524 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23caa85-32df-4d04-80e4-87ecd5049236 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:58.321783 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23caa85-32df-4d04-80e4-87ecd5049236 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:58.332441 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23caa85-32df-4d04-80e4-87ecd5049236 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:58.333897 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23caa85-32df-4d04-80e4-87ecd5049236 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:58.348577 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-c23caa85-32df-4d04-80e4-87ecd5049236 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:20:58.348577 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:20:58.348577 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:20:58.348577 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:20:58.348577 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:20:58.348577 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:20:58.348577 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:20:58.348577 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:20:58.348577 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:20:58.348577 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:20:58.348577 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:20:58.348577 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:20:58.348577 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 11:20:58.348577 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 11:20:58.348577 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 11:20:58.348577 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 11:20:58.349529 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:20:58.349529 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:20:58.349529 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:20:58.349529 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:20:58.349529 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:20:58.349529 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:20:58.349529 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:20:58.349529 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Aug 24 11:20:58.349529 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:20:58.349529 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:20:58.349529 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:20:58.349529 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:20:58.349529 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:20:58.349529 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:20:58.349529 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:20:58.349529 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:20:58.349529 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 11:20:58.350459 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 11:20:58.350459 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:20:58.350459 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Aug 24 11:20:58.350459 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 390/787] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 11:20:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:20:58.356904 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c039415f-89cf-4099-846c-3494b871e913 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:58.380457 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:58.428804 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23caa85-32df-4d04-80e4-87ecd5049236 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:58.518006 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:58.520959 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c039415f-89cf-4099-846c-3494b871e913 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:58.586759 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d70cf8-17e6-4c5f-876e-d56f81bd6828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:58.587870 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d70cf8-17e6-4c5f-876e-d56f81bd6828 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:58.588289 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d70cf8-17e6-4c5f-876e-d56f81bd6828 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:58.588569 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d70cf8-17e6-4c5f-876e-d56f81bd6828 None admin] PATH_INFO: `/v3/domains` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:58.589529 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d70cf8-17e6-4c5f-876e-d56f81bd6828 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:20:58.589837 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d70cf8-17e6-4c5f-876e-d56f81bd6828 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:58.590801 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23caa85-32df-4d04-80e4-87ecd5049236 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:58.591308 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d70cf8-17e6-4c5f-876e-d56f81bd6828 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:58.615115 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 398/788] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 24 11:20:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:58.621428 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d70cf8-17e6-4c5f-876e-d56f81bd6828 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:58.660110 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bb6368-bf49-424b-a934-e47795432d6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:58.660714 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bb6368-bf49-424b-a934-e47795432d6f None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:58.660992 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bb6368-bf49-424b-a934-e47795432d6f None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:58.661261 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bb6368-bf49-424b-a934-e47795432d6f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:58.679766 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bb6368-bf49-424b-a934-e47795432d6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:20:58.687578 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-23bb6368-bf49-424b-a934-e47795432d6f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 11:20:58.687578 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:20:58.687578 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:20:58.687578 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:20:58.687578 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:20:58.687578 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:20:58.687578 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:20:58.687578 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:20:58.687578 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:20:58.687578 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:20:58.687578 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:20:58.687578 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:20:58.687578 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:20:58.687578 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:20:58.687578 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:20:58.687578 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:20:58.688493 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:20:58.688493 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:20:58.688493 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:20:58.688493 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:20:58.688493 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:20:58.688493 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:20:58.688493 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:20:58.688493 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:20:58.688493 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:20:58.688493 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:20:58.688493 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:20:58.688493 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Aug 24 11:20:58.688493 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:20:58.688493 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:20:58.688493 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:20:58.688493 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:20:58.689341 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:20:58.689341 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:20:58.689341 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:20:58.689341 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:20:58.689341 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:20:58.689341 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:20:58.689341 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:20:58.689341 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:20:58.689341 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:20:58.689341 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:20:58.689341 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 11:20:58.689341 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Aug 24 11:20:58.693738 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 391/789] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Aug 24 11:20:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:20:58.699494 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bb6368-bf49-424b-a934-e47795432d6f None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:58.738866 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:58.774206 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d70cf8-17e6-4c5f-876e-d56f81bd6828 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:58.838772 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcf2f9f-2801-4f21-9aac-2414286fd803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:58.839409 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcf2f9f-2801-4f21-9aac-2414286fd803 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:58.839686 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcf2f9f-2801-4f21-9aac-2414286fd803 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:58.842240 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcf2f9f-2801-4f21-9aac-2414286fd803 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:58.848136 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bb6368-bf49-424b-a934-e47795432d6f None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:58.860809 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcf2f9f-2801-4f21-9aac-2414286fd803 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:58.862312 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcf2f9f-2801-4f21-9aac-2414286fd803 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:58.877486 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-1fcf2f9f-2801-4f21-9aac-2414286fd803 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 11:20:58.877486 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:20:58.877486 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:20:58.877486 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:20:58.877486 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:20:58.877486 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:20:58.877486 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:20:58.877486 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:20:58.877486 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:20:58.877486 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:20:58.877486 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:20:58.877486 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:20:58.877486 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 11:20:58.877486 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 11:20:58.877486 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 11:20:58.877486 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 11:20:58.879746 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:20:58.879746 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:20:58.879746 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 11:20:58.879746 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 11:20:58.879746 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 11:20:58.879746 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 11:20:58.879746 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:20:58.879746 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:20:58.879746 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:20:58.879746 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:20:58.879746 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:20:58.879746 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Aug 24 11:20:58.879746 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:20:58.879746 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:20:58.879746 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:20:58.879746 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:20:58.879746 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:20:58.879746 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:20:58.880933 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:20:58.880933 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:20:58.880933 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 11:20:58.880933 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 11:20:58.880933 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 11:20:58.880933 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 11:20:58.880933 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 11:20:58.880933 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 11:20:58.880933 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 11:20:58.880933 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:20:58.880933 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 399/790] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Aug 24 11:20:58 2022] GET /identity/v3/users/swift => generated 83 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:20:58.884705 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:58.887987 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcf2f9f-2801-4f21-9aac-2414286fd803 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:58.915933 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fed6dc4-4884-43ef-879f-955749c8992e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:58.916517 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fed6dc4-4884-43ef-879f-955749c8992e None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:58.916784 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fed6dc4-4884-43ef-879f-955749c8992e None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:58.917049 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fed6dc4-4884-43ef-879f-955749c8992e None admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:58.917723 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fed6dc4-4884-43ef-879f-955749c8992e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:20:58.918033 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fed6dc4-4884-43ef-879f-955749c8992e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:58.919441 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fed6dc4-4884-43ef-879f-955749c8992e None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:58.936971 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 392/791] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 24 11:20:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:58.942971 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fed6dc4-4884-43ef-879f-955749c8992e None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:59.078437 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcf2f9f-2801-4f21-9aac-2414286fd803 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:59.125630 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:59.133330 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac077d5-e05d-4f06-ad5b-5df5e4720365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:59.134228 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac077d5-e05d-4f06-ad5b-5df5e4720365 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:59.134727 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac077d5-e05d-4f06-ad5b-5df5e4720365 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:59.135196 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac077d5-e05d-4f06-ad5b-5df5e4720365 None admin] PATH_INFO: `/v3/users` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:59.136132 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac077d5-e05d-4f06-ad5b-5df5e4720365 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:20:59.136627 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac077d5-e05d-4f06-ad5b-5df5e4720365 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:59.138299 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac077d5-e05d-4f06-ad5b-5df5e4720365 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:59.153565 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fed6dc4-4884-43ef-879f-955749c8992e None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:59.168600 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 400/792] 10.222.0.27 () {56 vars in 1135 bytes} [Wed Aug 24 11:20:58 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:59.174297 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac077d5-e05d-4f06-ad5b-5df5e4720365 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:59.219273 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874776f7-eaaa-4147-857a-f0b045f35a9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:59.220480 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874776f7-eaaa-4147-857a-f0b045f35a9b None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:59.221609 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874776f7-eaaa-4147-857a-f0b045f35a9b None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:59.222287 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874776f7-eaaa-4147-857a-f0b045f35a9b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:59.242489 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874776f7-eaaa-4147-857a-f0b045f35a9b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:59.244379 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874776f7-eaaa-4147-857a-f0b045f35a9b None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:59.269958 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-874776f7-eaaa-4147-857a-f0b045f35a9b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:20:59.269958 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:20:59.269958 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:20:59.269958 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:20:59.269958 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:20:59.269958 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:20:59.269958 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:20:59.269958 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:20:59.269958 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:20:59.269958 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:20:59.269958 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:20:59.269958 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:20:59.269958 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 11:20:59.269958 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 11:20:59.269958 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 11:20:59.269958 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 11:20:59.271005 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:20:59.271005 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:20:59.271005 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:20:59.271005 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:20:59.271005 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:20:59.271005 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:20:59.271005 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:20:59.271005 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Aug 24 11:20:59.271005 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:20:59.271005 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:20:59.271005 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:20:59.271005 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:20:59.271005 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:20:59.271005 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:20:59.271005 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:20:59.271005 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:20:59.271005 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 11:20:59.271917 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 11:20:59.271917 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:20:59.271917 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Aug 24 11:20:59.278465 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 393/793] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 11:20:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:20:59.282283 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874776f7-eaaa-4147-857a-f0b045f35a9b None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:59.345306 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:59.357067 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac077d5-e05d-4f06-ad5b-5df5e4720365 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:59.407112 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca5cf05-6b76-408b-a92e-af8e7ca089bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:59.408139 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca5cf05-6b76-408b-a92e-af8e7ca089bd None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:59.408618 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca5cf05-6b76-408b-a92e-af8e7ca089bd None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:59.409115 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca5cf05-6b76-408b-a92e-af8e7ca089bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:59.421063 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca5cf05-6b76-408b-a92e-af8e7ca089bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:59.422873 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca5cf05-6b76-408b-a92e-af8e7ca089bd None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:59.440607 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-4ca5cf05-6b76-408b-a92e-af8e7ca089bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:20:59.440607 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:20:59.440607 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:20:59.440607 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:20:59.440607 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:20:59.440607 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:20:59.440607 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:20:59.440607 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:20:59.440607 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:20:59.440607 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:20:59.440607 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:20:59.440607 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:20:59.440607 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 11:20:59.440607 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 11:20:59.440607 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 11:20:59.440607 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 11:20:59.441685 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:20:59.441685 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:20:59.441685 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:20:59.441685 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:20:59.441685 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:20:59.441685 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:20:59.441685 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:20:59.441685 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Aug 24 11:20:59.441685 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:20:59.441685 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:20:59.441685 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:20:59.441685 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:20:59.441685 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:20:59.441685 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:20:59.441685 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:20:59.441685 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:20:59.441685 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 11:20:59.442629 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 11:20:59.442629 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:20:59.442629 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:20:59.445212 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 401/794] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 11:20:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 11:20:59.450520 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca5cf05-6b76-408b-a92e-af8e7ca089bd None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:59.483823 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874776f7-eaaa-4147-857a-f0b045f35a9b None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:59.521598 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90e9e60-a6f3-4218-b207-03c785525607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:59.522613 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90e9e60-a6f3-4218-b207-03c785525607 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:59.523111 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90e9e60-a6f3-4218-b207-03c785525607 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:59.523655 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90e9e60-a6f3-4218-b207-03c785525607 None admin] PATH_INFO: `/v3/domains` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:59.524628 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90e9e60-a6f3-4218-b207-03c785525607 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:20:59.524933 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90e9e60-a6f3-4218-b207-03c785525607 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:59.526333 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90e9e60-a6f3-4218-b207-03c785525607 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:59.533683 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:59.540107 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 394/795] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 24 11:20:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:59.541236 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63389a3-8212-4bbc-9f8c-14697b9796dc None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:59.541519 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63389a3-8212-4bbc-9f8c-14697b9796dc None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:59.541791 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63389a3-8212-4bbc-9f8c-14697b9796dc None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:59.543260 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 395/796] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:20:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:20:59.544427 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700ab3c3-33e5-453f-ae09-e8914eae5444 None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:59.544535 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700ab3c3-33e5-453f-ae09-e8914eae5444 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:59.544803 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700ab3c3-33e5-453f-ae09-e8914eae5444 None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:59.546081 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 396/797] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:20:59 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:20:59.550165 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700ab3c3-33e5-453f-ae09-e8914eae5444 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:59.599414 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca5cf05-6b76-408b-a92e-af8e7ca089bd None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:59.634864 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18657ea3-cf09-4b76-9d28-aaaec8923a7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:59.635532 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18657ea3-cf09-4b76-9d28-aaaec8923a7b None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:59.635805 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18657ea3-cf09-4b76-9d28-aaaec8923a7b None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:59.636107 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18657ea3-cf09-4b76-9d28-aaaec8923a7b None admin] PATH_INFO: `/v3/domains` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:59.636712 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18657ea3-cf09-4b76-9d28-aaaec8923a7b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:20:59.637017 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18657ea3-cf09-4b76-9d28-aaaec8923a7b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:59.638574 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18657ea3-cf09-4b76-9d28-aaaec8923a7b None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:59.641703 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:59.651405 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700ab3c3-33e5-453f-ae09-e8914eae5444 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:59.657631 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 402/798] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 24 11:20:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:20:59.657631 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30669e2-1904-4c0d-8fa7-1c606f3ded3f None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:59.657631 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30669e2-1904-4c0d-8fa7-1c606f3ded3f None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:59.657631 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30669e2-1904-4c0d-8fa7-1c606f3ded3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:59.673493 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-a30669e2-1904-4c0d-8fa7-1c606f3ded3f None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:20:59.674645 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-a30669e2-1904-4c0d-8fa7-1c606f3ded3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:20:59.692154 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa45d54-e45e-4b02-afc7-1abc0b71b37a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:59.692795 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa45d54-e45e-4b02-afc7-1abc0b71b37a None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:59.693069 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa45d54-e45e-4b02-afc7-1abc0b71b37a None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:59.693336 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa45d54-e45e-4b02-afc7-1abc0b71b37a None admin] PATH_INFO: `/v3/users/nova` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:59.700650 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa45d54-e45e-4b02-afc7-1abc0b71b37a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:59.702111 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa45d54-e45e-4b02-afc7-1abc0b71b37a None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:59.713500 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-9aa45d54-e45e-4b02-afc7-1abc0b71b37a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 11:20:59.713500 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:20:59.713500 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:20:59.713500 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:20:59.713500 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:20:59.713500 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:20:59.713500 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:20:59.713500 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:20:59.713500 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:20:59.713500 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:20:59.713500 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:20:59.713500 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:20:59.713500 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 11:20:59.713500 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 11:20:59.713500 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 11:20:59.713500 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 11:20:59.714711 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:20:59.714711 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:20:59.714711 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 11:20:59.714711 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 11:20:59.714711 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 11:20:59.714711 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 11:20:59.714711 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:20:59.714711 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:20:59.714711 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:20:59.714711 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:20:59.714711 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:20:59.714711 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Aug 24 11:20:59.714711 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:20:59.714711 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:20:59.714711 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:20:59.714711 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:20:59.714711 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:20:59.714711 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:20:59.716038 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:20:59.716038 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:20:59.716038 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 11:20:59.716038 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 11:20:59.716038 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 11:20:59.716038 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 11:20:59.716038 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 11:20:59.716038 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 11:20:59.716038 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 11:20:59.716038 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Aug 24 11:20:59.719386 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 397/799] 10.222.0.27 () {56 vars in 1093 bytes} [Wed Aug 24 11:20:59 2022] GET /identity/v3/users/nova => generated 82 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:20:59.720642 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77069930-c98d-4bce-b9d5-244acde67efc None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:59.720928 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77069930-c98d-4bce-b9d5-244acde67efc None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:59.721209 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77069930-c98d-4bce-b9d5-244acde67efc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:59.738641 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-77069930-c98d-4bce-b9d5-244acde67efc None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:20:59.739812 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-77069930-c98d-4bce-b9d5-244acde67efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:20:59.745443 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 403/800] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:20:59 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 11:20:59.746290 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30669e2-1904-4c0d-8fa7-1c606f3ded3f None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:59.779709 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:59.853725 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 398/801] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:20:59 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 11:20:59.853725 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77069930-c98d-4bce-b9d5-244acde67efc None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:59.867835 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30669e2-1904-4c0d-8fa7-1c606f3ded3f None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:20:59.934003 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb03e9db-7269-40c2-a467-b0141852bdef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:20:59.934896 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb03e9db-7269-40c2-a467-b0141852bdef None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:59.935178 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb03e9db-7269-40c2-a467-b0141852bdef None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:59.935451 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb03e9db-7269-40c2-a467-b0141852bdef None admin] PATH_INFO: `/v3/projects/service` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:59.944428 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb03e9db-7269-40c2-a467-b0141852bdef None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:20:59.946389 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb03e9db-7269-40c2-a467-b0141852bdef None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:20:59.960901 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-bb03e9db-7269-40c2-a467-b0141852bdef None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 11:20:59.960901 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:20:59.960901 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:20:59.960901 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:20:59.960901 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:20:59.960901 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:20:59.960901 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:20:59.960901 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:20:59.960901 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:20:59.960901 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:20:59.960901 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:20:59.960901 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:20:59.960901 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 11:20:59.960901 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 11:20:59.960901 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 11:20:59.961795 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 11:20:59.961795 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:20:59.961795 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:20:59.961795 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:20:59.961795 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:20:59.961795 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:20:59.961795 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:20:59.961795 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:20:59.961795 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Aug 24 11:20:59.961795 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:20:59.961795 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:20:59.961795 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:20:59.961795 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:20:59.961795 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:20:59.961795 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:20:59.961795 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:20:59.961795 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:20:59.963155 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 11:20:59.963155 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 11:20:59.963155 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 11:20:59.963155 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 11:20:59.963155 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 11:20:59.963155 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 11:20:59.963155 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 11:20:59.963155 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:20:59.963155 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 404/802] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Aug 24 11:20:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:20:59.964782 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9885485c-2d32-4f48-b794-aab23eb87895 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:20:59.964893 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9885485c-2d32-4f48-b794-aab23eb87895 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:20:59.966413 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9885485c-2d32-4f48-b794-aab23eb87895 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:20:59.970393 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 405/803] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:20:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:20:59.970393 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9885485c-2d32-4f48-b794-aab23eb87895 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:20:59.974529 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:59.993283 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77069930-c98d-4bce-b9d5-244acde67efc None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:00.030160 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c45856-d3bc-43e6-a8a7-4dd84dbca86f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:00.030833 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c45856-d3bc-43e6-a8a7-4dd84dbca86f None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:00.031108 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c45856-d3bc-43e6-a8a7-4dd84dbca86f None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:00.031384 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c45856-d3bc-43e6-a8a7-4dd84dbca86f None admin] PATH_INFO: `/v3/users` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:00.032134 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c45856-d3bc-43e6-a8a7-4dd84dbca86f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:21:00.032447 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c45856-d3bc-43e6-a8a7-4dd84dbca86f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:00.033906 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c45856-d3bc-43e6-a8a7-4dd84dbca86f None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:00.053053 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 399/804] 10.222.0.27 () {56 vars in 1133 bytes} [Wed Aug 24 11:20:59 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:21:00.053053 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd69e07-9f6e-4604-8855-3c4688743034 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:00.053053 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd69e07-9f6e-4604-8855-3c4688743034 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:00.053053 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd69e07-9f6e-4604-8855-3c4688743034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:00.072878 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-0fd69e07-9f6e-4604-8855-3c4688743034 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:21:00.074068 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-0fd69e07-9f6e-4604-8855-3c4688743034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:21:00.074863 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:00.085819 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9885485c-2d32-4f48-b794-aab23eb87895 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:00.127465 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2b15b4-2b79-470b-b8cc-777acdef2972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:00.128096 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2b15b4-2b79-470b-b8cc-777acdef2972 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:00.128441 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2b15b4-2b79-470b-b8cc-777acdef2972 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:00.128715 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2b15b4-2b79-470b-b8cc-777acdef2972 None admin] PATH_INFO: `/v3/projects` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:00.129419 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2b15b4-2b79-470b-b8cc-777acdef2972 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:21:00.129722 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2b15b4-2b79-470b-b8cc-777acdef2972 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:00.131260 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2b15b4-2b79-470b-b8cc-777acdef2972 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:00.147695 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 406/805] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Aug 24 11:20:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:21:00.147695 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2b15b4-2b79-470b-b8cc-777acdef2972 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:00.153946 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 400/806] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:21:00 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 11:21:00.154869 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd69e07-9f6e-4604-8855-3c4688743034 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:00.229521 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:00.261656 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd69e07-9f6e-4604-8855-3c4688743034 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:00.269535 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2b15b4-2b79-470b-b8cc-777acdef2972 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:00.300741 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeb89cb-e3bf-4fa6-9186-5e904fd84b2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:00.301363 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeb89cb-e3bf-4fa6-9186-5e904fd84b2d None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:00.301622 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeb89cb-e3bf-4fa6-9186-5e904fd84b2d None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:00.301890 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeb89cb-e3bf-4fa6-9186-5e904fd84b2d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:00.307064 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6642f72-d625-44fd-a14a-f2611f03f9b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:00.307702 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6642f72-d625-44fd-a14a-f2611f03f9b7 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:00.307978 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6642f72-d625-44fd-a14a-f2611f03f9b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:00.308246 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6642f72-d625-44fd-a14a-f2611f03f9b7 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:00.308830 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6642f72-d625-44fd-a14a-f2611f03f9b7 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:00.310648 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6642f72-d625-44fd-a14a-f2611f03f9b7 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:00.320023 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-e6642f72-d625-44fd-a14a-f2611f03f9b7 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 11:21:00.320023 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:21:00.320023 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 11:21:00.320023 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 11:21:00.320023 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 11:21:00.320023 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 11:21:00.320023 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 11:21:00.320023 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 11:21:00.320023 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 11:21:00.320023 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:21:00.320023 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 11:21:00.320023 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:21:00.320023 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:21:00.320023 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:21:00.320023 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:21:00.320023 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:21:00.320023 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:21:00.321074 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:21:00.321074 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:21:00.321074 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:21:00.321074 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:21:00.321074 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:21:00.321074 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:21:00.321074 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 11:21:00.321074 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 11:21:00.321074 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 11:21:00.321074 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 11:21:00.321074 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:21:00.321074 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:21:00.321074 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:21:00.321074 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:21:00.321074 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:21:00.321074 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:21:00.321941 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:21:00.321941 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Aug 24 11:21:00.321941 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:21:00.321941 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:21:00.321941 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:21:00.321941 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:21:00.321941 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:21:00.321941 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:21:00.321941 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:21:00.321941 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:21:00.321941 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 11:21:00.321941 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 11:21:00.321941 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 11:21:00.321941 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:21:00.321941 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 407/807] 10.222.0.27 () {56 vars in 1129 bytes} [Wed Aug 24 11:21:00 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:21:00.322764 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6642f72-d625-44fd-a14a-f2611f03f9b7 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:00.340882 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:00.378346 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deeb89cb-e3bf-4fa6-9186-5e904fd84b2d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:00.379681 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deeb89cb-e3bf-4fa6-9186-5e904fd84b2d None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:00.428308 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6642f72-d625-44fd-a14a-f2611f03f9b7 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:00.446576 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:00.462415 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e571d0-1746-4ca6-bc3d-1a5b010526e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:00.463039 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e571d0-1746-4ca6-bc3d-1a5b010526e9 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:00.463305 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e571d0-1746-4ca6-bc3d-1a5b010526e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:00.463571 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e571d0-1746-4ca6-bc3d-1a5b010526e9 None admin] PATH_INFO: `/v3/services/network` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:00.464142 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e571d0-1746-4ca6-bc3d-1a5b010526e9 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:00.465549 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e571d0-1746-4ca6-bc3d-1a5b010526e9 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:00.474126 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-59e571d0-1746-4ca6-bc3d-1a5b010526e9 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 11:21:00.474126 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:21:00.474126 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 11:21:00.474126 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 11:21:00.474126 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 11:21:00.474126 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 11:21:00.474126 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 11:21:00.474126 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 11:21:00.474126 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 11:21:00.474126 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:21:00.474126 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 11:21:00.474126 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:21:00.474126 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:21:00.474126 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:21:00.474126 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:21:00.474126 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:21:00.474126 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:21:00.475203 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:21:00.475203 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:21:00.475203 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:21:00.475203 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:21:00.475203 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:21:00.475203 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:21:00.475203 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 11:21:00.475203 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 11:21:00.475203 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 11:21:00.475203 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 11:21:00.475203 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:21:00.475203 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:21:00.475203 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:21:00.475203 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:21:00.475203 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:21:00.475203 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:21:00.476062 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:21:00.476062 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Aug 24 11:21:00.476062 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:21:00.476062 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:21:00.476062 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:21:00.476062 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:21:00.476062 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:21:00.476062 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:21:00.476062 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:21:00.476062 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:21:00.476062 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 11:21:00.476062 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 11:21:00.476062 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 11:21:00.476062 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:21:00.476062 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 408/808] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Aug 24 11:21:00 2022] GET /identity/v3/services/network => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:21:00.476878 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e571d0-1746-4ca6-bc3d-1a5b010526e9 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:00.476956 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 401/809] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 24 11:21:00 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 11:21:00.477738 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeb89cb-e3bf-4fa6-9186-5e904fd84b2d None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:00.566187 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:00.579017 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeb89cb-e3bf-4fa6-9186-5e904fd84b2d None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:00.585582 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e571d0-1746-4ca6-bc3d-1a5b010526e9 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:00.612535 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48b95f5-a02d-47a4-b15c-6a44dd30c6e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:00.613243 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48b95f5-a02d-47a4-b15c-6a44dd30c6e8 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:00.613519 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48b95f5-a02d-47a4-b15c-6a44dd30c6e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:00.613789 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48b95f5-a02d-47a4-b15c-6a44dd30c6e8 None admin] PATH_INFO: `/v3/services` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:00.614467 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48b95f5-a02d-47a4-b15c-6a44dd30c6e8 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:21:00.614770 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48b95f5-a02d-47a4-b15c-6a44dd30c6e8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:00.616165 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48b95f5-a02d-47a4-b15c-6a44dd30c6e8 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:00.619480 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93253823-f20c-47af-a6e8-d8d6f0c1ec04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:00.620134 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93253823-f20c-47af-a6e8-d8d6f0c1ec04 None admin] REQUEST_METHOD: `PUT` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:00.620410 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93253823-f20c-47af-a6e8-d8d6f0c1ec04 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:00.625161 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93253823-f20c-47af-a6e8-d8d6f0c1ec04 None admin] PATH_INFO: `/v3/projects/317f54a463cb48ab86648c6dcec5db0f/users/f1069558c085449f9e4c9f06013b2a85/roles/30bb1e97257f4ca5b90c88545777317b` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:00.625292 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 402/810] 10.222.0.27 () {56 vars in 1124 bytes} [Wed Aug 24 11:21:00 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:21:00.625292 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48b95f5-a02d-47a4-b15c-6a44dd30c6e8 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:00.625451 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93253823-f20c-47af-a6e8-d8d6f0c1ec04 None admin] RBAC: Authorizing `identity:create_grant(project_id=317f54a463cb48ab86648c6dcec5db0f, user_id=f1069558c085449f9e4c9f06013b2a85, role_id=30bb1e97257f4ca5b90c88545777317b)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:00.625451 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93253823-f20c-47af-a6e8-d8d6f0c1ec04 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:00.636743 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 409/811] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Aug 24 11:21:00 2022] PUT /identity/v3/projects/317f54a463cb48ab86648c6dcec5db0f/users/f1069558c085449f9e4c9f06013b2a85/roles/30bb1e97257f4ca5b90c88545777317b => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:21:00.637537 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93253823-f20c-47af-a6e8-d8d6f0c1ec04 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:00.662863 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:00.741171 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48b95f5-a02d-47a4-b15c-6a44dd30c6e8 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:00.765343 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93253823-f20c-47af-a6e8-d8d6f0c1ec04 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:00.784404 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ba3db1-961a-49b3-a1c6-ea3252b955cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:00.785904 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ba3db1-961a-49b3-a1c6-ea3252b955cd None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:00.786569 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ba3db1-961a-49b3-a1c6-ea3252b955cd None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:00.787080 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ba3db1-961a-49b3-a1c6-ea3252b955cd None admin] PATH_INFO: `/v3/roles/service` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:00.799982 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ba3db1-961a-49b3-a1c6-ea3252b955cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:21:00.804847 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-d7ba3db1-961a-49b3-a1c6-ea3252b955cd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 11:21:00.804847 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:21:00.804847 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:21:00.804847 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:21:00.804847 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:21:00.804847 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:21:00.804847 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:21:00.804847 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:21:00.804847 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:21:00.804847 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:21:00.804847 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:21:00.804847 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:21:00.804847 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:21:00.804847 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:21:00.804847 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:21:00.804847 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:21:00.805773 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:21:00.805773 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:21:00.805773 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:21:00.805773 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:21:00.805773 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:21:00.805773 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:21:00.805773 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:21:00.805773 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:21:00.805773 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:21:00.805773 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:21:00.805773 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:21:00.805773 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Aug 24 11:21:00.805773 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:21:00.805773 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:21:00.805773 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:21:00.805773 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:21:00.806815 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:21:00.806815 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:21:00.806815 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:21:00.806815 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:21:00.806815 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:21:00.806815 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:21:00.806815 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:21:00.806815 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:21:00.806815 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:21:00.806815 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:21:00.806815 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 11:21:00.806815 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Aug 24 11:21:00.806815 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 403/812] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Aug 24 11:21:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:21:00.807501 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ba3db1-961a-49b3-a1c6-ea3252b955cd None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:00.809043 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e520bd7f-808c-4dd6-a26e-7ffd98778c8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:00.809659 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e520bd7f-808c-4dd6-a26e-7ffd98778c8c None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:00.809934 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e520bd7f-808c-4dd6-a26e-7ffd98778c8c None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:00.810200 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e520bd7f-808c-4dd6-a26e-7ffd98778c8c None admin] PATH_INFO: `/v3/services` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:00.810892 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e520bd7f-808c-4dd6-a26e-7ffd98778c8c None admin] RBAC: Adding query filter params (name=network) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:21:00.811189 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e520bd7f-808c-4dd6-a26e-7ffd98778c8c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:00.812861 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e520bd7f-808c-4dd6-a26e-7ffd98778c8c None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:00.817663 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 410/813] 10.222.0.27 () {56 vars in 1112 bytes} [Wed Aug 24 11:21:00 2022] GET /identity/v3/services?name=network => generated 124 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:21:00.818487 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e520bd7f-808c-4dd6-a26e-7ffd98778c8c None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:00.827805 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:00.914489 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:00.923505 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ba3db1-961a-49b3-a1c6-ea3252b955cd None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:00.927999 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e520bd7f-808c-4dd6-a26e-7ffd98778c8c None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:00.959891 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e033be0d-38c0-42e5-af56-43912c532a67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:00.960908 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e033be0d-38c0-42e5-af56-43912c532a67 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:00.961375 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e033be0d-38c0-42e5-af56-43912c532a67 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:00.961864 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e033be0d-38c0-42e5-af56-43912c532a67 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:00.963184 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9245c4f5-a821-4979-b39c-113d07c9b337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:00.963805 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9245c4f5-a821-4979-b39c-113d07c9b337 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:00.964206 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9245c4f5-a821-4979-b39c-113d07c9b337 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:00.964493 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9245c4f5-a821-4979-b39c-113d07c9b337 None admin] PATH_INFO: `/v3/services` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:00.965153 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9245c4f5-a821-4979-b39c-113d07c9b337 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:21:00.965742 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9245c4f5-a821-4979-b39c-113d07c9b337 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:00.967195 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9245c4f5-a821-4979-b39c-113d07c9b337 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:00.973023 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 411/814] 10.222.0.27 () {56 vars in 1124 bytes} [Wed Aug 24 11:21:00 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:21:00.974207 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9245c4f5-a821-4979-b39c-113d07c9b337 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:00.974474 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e033be0d-38c0-42e5-af56-43912c532a67 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:00.976126 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e033be0d-38c0-42e5-af56-43912c532a67 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:00.992389 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-e033be0d-38c0-42e5-af56-43912c532a67 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:21:00.992389 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:21:00.992389 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:21:00.992389 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:21:00.992389 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:21:00.992389 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:21:00.992389 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:21:00.992389 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:21:00.992389 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:21:00.992389 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:21:00.992389 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:21:00.992389 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:21:00.992389 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 11:21:00.992389 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 11:21:00.992389 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 11:21:00.992389 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 11:21:00.993397 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:21:00.993397 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:21:00.993397 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:21:00.993397 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:21:00.993397 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:21:00.993397 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:21:00.993397 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:21:00.993397 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Aug 24 11:21:00.993397 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:21:00.993397 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:21:00.993397 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:21:00.993397 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:21:00.993397 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:21:00.993397 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:21:00.993397 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:21:00.993397 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:21:00.993397 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 11:21:00.994296 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 11:21:00.994296 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:21:00.994296 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Aug 24 11:21:00.998248 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 404/815] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 11:21:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:21:00.998961 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e033be0d-38c0-42e5-af56-43912c532a67 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:01.047565 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:01.088710 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9245c4f5-a821-4979-b39c-113d07c9b337 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:01.109247 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e033be0d-38c0-42e5-af56-43912c532a67 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:01.127284 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055eb957-1507-4698-bc8c-36b362ecde7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:01.127935 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055eb957-1507-4698-bc8c-36b362ecde7f None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:01.128214 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055eb957-1507-4698-bc8c-36b362ecde7f None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:01.128551 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055eb957-1507-4698-bc8c-36b362ecde7f None admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:01.129227 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055eb957-1507-4698-bc8c-36b362ecde7f None admin] RBAC: Adding query filter params (name=service) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:21:01.129529 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055eb957-1507-4698-bc8c-36b362ecde7f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:01.130969 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055eb957-1507-4698-bc8c-36b362ecde7f None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:01.139235 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 412/816] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Aug 24 11:21:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:21:01.140033 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055eb957-1507-4698-bc8c-36b362ecde7f None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:01.154249 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e813d02f-77f1-4ec5-ae9a-87d8ca98be08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:01.155498 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e813d02f-77f1-4ec5-ae9a-87d8ca98be08 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:01.155930 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e813d02f-77f1-4ec5-ae9a-87d8ca98be08 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:01.156234 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e813d02f-77f1-4ec5-ae9a-87d8ca98be08 None admin] PATH_INFO: `/v3/services` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:01.156866 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e813d02f-77f1-4ec5-ae9a-87d8ca98be08 None admin] RBAC: Adding query filter params (type=network) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:21:01.157159 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e813d02f-77f1-4ec5-ae9a-87d8ca98be08 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:01.158599 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e813d02f-77f1-4ec5-ae9a-87d8ca98be08 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:01.168344 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 405/817] 10.222.0.27 () {56 vars in 1112 bytes} [Wed Aug 24 11:21:00 2022] GET /identity/v3/services?type=network => generated 350 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:21:01.169199 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e813d02f-77f1-4ec5-ae9a-87d8ca98be08 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:01.184290 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:01.244907 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055eb957-1507-4698-bc8c-36b362ecde7f None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:01.273144 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e813d02f-77f1-4ec5-ae9a-87d8ca98be08 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:01.275121 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:01.284427 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc62b03-3659-4946-bee2-a83c7c82e09b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:01.285343 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc62b03-3659-4946-bee2-a83c7c82e09b None admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:01.285633 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc62b03-3659-4946-bee2-a83c7c82e09b None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:01.285878 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc62b03-3659-4946-bee2-a83c7c82e09b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:01.286725 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc62b03-3659-4946-bee2-a83c7c82e09b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:01.288972 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc62b03-3659-4946-bee2-a83c7c82e09b None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:01.308732 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd269fb1-d3a1-4e3e-bf4d-8019487adba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:01.309577 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd269fb1-d3a1-4e3e-bf4d-8019487adba4 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:01.309864 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd269fb1-d3a1-4e3e-bf4d-8019487adba4 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:01.310125 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd269fb1-d3a1-4e3e-bf4d-8019487adba4 None admin] PATH_INFO: `/v3/domains` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:01.310804 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd269fb1-d3a1-4e3e-bf4d-8019487adba4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:21:01.311104 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd269fb1-d3a1-4e3e-bf4d-8019487adba4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:01.322549 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 413/818] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 11:21:01 2022] POST /identity/v3/endpoints => generated 346 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:21:01.322768 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd269fb1-d3a1-4e3e-bf4d-8019487adba4 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:01.322883 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc62b03-3659-4946-bee2-a83c7c82e09b None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:01.335625 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 406/819] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 24 11:21:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:21:01.336664 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd269fb1-d3a1-4e3e-bf4d-8019487adba4 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:01.429414 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:01.461920 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc62b03-3659-4946-bee2-a83c7c82e09b None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:01.472261 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd269fb1-d3a1-4e3e-bf4d-8019487adba4 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:01.502541 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474dd32b-2fae-426a-9256-b911fcdcb974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:01.503634 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474dd32b-2fae-426a-9256-b911fcdcb974 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:01.504134 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474dd32b-2fae-426a-9256-b911fcdcb974 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:01.504406 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474dd32b-2fae-426a-9256-b911fcdcb974 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:01.516435 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca28e821-7f9d-4dbb-b68c-0499850eca4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:01.517104 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca28e821-7f9d-4dbb-b68c-0499850eca4d None admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:01.517407 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca28e821-7f9d-4dbb-b68c-0499850eca4d None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:01.517802 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca28e821-7f9d-4dbb-b68c-0499850eca4d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:01.518517 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca28e821-7f9d-4dbb-b68c-0499850eca4d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:01.520200 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca28e821-7f9d-4dbb-b68c-0499850eca4d None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:01.547825 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 407/820] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 11:21:01 2022] POST /identity/v3/endpoints => generated 337 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:21:01.549120 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca28e821-7f9d-4dbb-b68c-0499850eca4d None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:01.657663 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474dd32b-2fae-426a-9256-b911fcdcb974 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:01.659281 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474dd32b-2fae-426a-9256-b911fcdcb974 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:01.675037 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-474dd32b-2fae-426a-9256-b911fcdcb974 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:21:01.675037 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:21:01.675037 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:21:01.675037 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:21:01.675037 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:21:01.675037 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:21:01.675037 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:21:01.675037 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:21:01.675037 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:21:01.675037 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:21:01.675037 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:21:01.675037 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:21:01.675037 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 11:21:01.675037 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 11:21:01.675037 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 11:21:01.675037 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 11:21:01.676195 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:21:01.676195 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:21:01.676195 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:21:01.676195 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:21:01.676195 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:21:01.676195 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:21:01.676195 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:21:01.676195 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Aug 24 11:21:01.676195 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:21:01.676195 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:21:01.676195 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:21:01.676195 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:21:01.676195 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:21:01.676195 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:21:01.676195 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:21:01.676195 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:21:01.676195 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 11:21:01.677102 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 11:21:01.677102 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:21:01.677102 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:21:01.677102 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 414/821] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 11:21:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 364 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:21:01.682189 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474dd32b-2fae-426a-9256-b911fcdcb974 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:01.725673 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:01.733053 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca28e821-7f9d-4dbb-b68c-0499850eca4d None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:01.799892 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474dd32b-2fae-426a-9256-b911fcdcb974 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:01.801934 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:01.808228 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8927fed-a1cc-4a49-99e5-d89cf22d18a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:01.809055 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8927fed-a1cc-4a49-99e5-d89cf22d18a5 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:01.809329 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8927fed-a1cc-4a49-99e5-d89cf22d18a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:01.809594 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8927fed-a1cc-4a49-99e5-d89cf22d18a5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:01.817751 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8927fed-a1cc-4a49-99e5-d89cf22d18a5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:01.819247 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8927fed-a1cc-4a49-99e5-d89cf22d18a5 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:01.831817 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-d8927fed-a1cc-4a49-99e5-d89cf22d18a5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 11:21:01.831817 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:21:01.831817 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:21:01.831817 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:21:01.831817 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:21:01.831817 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:21:01.831817 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:21:01.831817 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:21:01.831817 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:21:01.831817 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:21:01.831817 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:21:01.831817 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:21:01.831817 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 11:21:01.831817 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 11:21:01.831817 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 11:21:01.832807 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 11:21:01.832807 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:21:01.832807 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:21:01.832807 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:21:01.832807 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:21:01.832807 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:21:01.832807 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:21:01.832807 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:21:01.832807 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Aug 24 11:21:01.832807 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:21:01.832807 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:21:01.832807 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:21:01.832807 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:21:01.832807 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:21:01.832807 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:21:01.832807 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:21:01.832807 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:21:01.833722 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 11:21:01.833722 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 11:21:01.833722 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 11:21:01.833722 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 11:21:01.833722 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 11:21:01.833722 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 11:21:01.833722 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 11:21:01.833722 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Aug 24 11:21:01.837933 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 408/822] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Aug 24 11:21:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:21:01.839437 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8927fed-a1cc-4a49-99e5-d89cf22d18a5 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:01.843335 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c0fd33-2da4-49af-b7fb-530aa8e8f810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:01.845188 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c0fd33-2da4-49af-b7fb-530aa8e8f810 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:01.845468 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c0fd33-2da4-49af-b7fb-530aa8e8f810 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:01.845738 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c0fd33-2da4-49af-b7fb-530aa8e8f810 None admin] PATH_INFO: `/v3/domains` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:01.846482 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c0fd33-2da4-49af-b7fb-530aa8e8f810 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:21:01.847052 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c0fd33-2da4-49af-b7fb-530aa8e8f810 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:01.848507 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c0fd33-2da4-49af-b7fb-530aa8e8f810 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:01.863584 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 415/823] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 24 11:21:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:21:01.869043 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c0fd33-2da4-49af-b7fb-530aa8e8f810 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:01.969577 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8927fed-a1cc-4a49-99e5-d89cf22d18a5 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:01.988754 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:02.003190 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c0fd33-2da4-49af-b7fb-530aa8e8f810 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:02.021789 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77478774-9a1c-4bed-8ce7-bf3f6f218578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:02.023174 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77478774-9a1c-4bed-8ce7-bf3f6f218578 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:02.023778 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77478774-9a1c-4bed-8ce7-bf3f6f218578 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:02.024335 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77478774-9a1c-4bed-8ce7-bf3f6f218578 None admin] PATH_INFO: `/v3/projects` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:02.025207 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77478774-9a1c-4bed-8ce7-bf3f6f218578 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:21:02.025874 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77478774-9a1c-4bed-8ce7-bf3f6f218578 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:02.028250 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77478774-9a1c-4bed-8ce7-bf3f6f218578 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:02.045624 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 409/824] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Aug 24 11:21:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:21:02.052764 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77478774-9a1c-4bed-8ce7-bf3f6f218578 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:02.052932 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5af6f25-16d4-4c3e-b073-105ea042b1c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:02.053556 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5af6f25-16d4-4c3e-b073-105ea042b1c9 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:02.053837 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5af6f25-16d4-4c3e-b073-105ea042b1c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:02.054102 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5af6f25-16d4-4c3e-b073-105ea042b1c9 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:02.066046 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5af6f25-16d4-4c3e-b073-105ea042b1c9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:02.067593 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5af6f25-16d4-4c3e-b073-105ea042b1c9 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:02.079541 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-e5af6f25-16d4-4c3e-b073-105ea042b1c9 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 11:21:02.079541 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:21:02.079541 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:21:02.079541 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:21:02.079541 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:21:02.079541 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:21:02.079541 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:21:02.079541 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:21:02.079541 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:21:02.079541 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:21:02.079541 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:21:02.079541 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:21:02.079541 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 11:21:02.079541 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 11:21:02.079541 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 11:21:02.079541 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 11:21:02.080557 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:21:02.080557 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:21:02.080557 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 11:21:02.080557 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 11:21:02.080557 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 11:21:02.080557 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 11:21:02.080557 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:21:02.080557 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:21:02.080557 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:21:02.080557 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:21:02.080557 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:21:02.080557 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Aug 24 11:21:02.080557 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:21:02.080557 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:21:02.080557 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:21:02.080557 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:21:02.080557 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:21:02.080557 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:21:02.081600 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:21:02.081600 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:21:02.081600 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 11:21:02.081600 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 11:21:02.081600 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 11:21:02.081600 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 11:21:02.081600 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 11:21:02.081600 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 11:21:02.081600 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 11:21:02.081600 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:21:02.081600 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 416/825] 10.222.0.27 () {56 vars in 1117 bytes} [Wed Aug 24 11:21:01 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:21:02.087403 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5af6f25-16d4-4c3e-b073-105ea042b1c9 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:02.114647 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:02.176816 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77478774-9a1c-4bed-8ce7-bf3f6f218578 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:02.213533 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3be90a5-5f1e-4169-8e3b-f0617079dd82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:02.214164 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3be90a5-5f1e-4169-8e3b-f0617079dd82 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:02.214477 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3be90a5-5f1e-4169-8e3b-f0617079dd82 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:02.214746 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3be90a5-5f1e-4169-8e3b-f0617079dd82 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:02.215474 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3be90a5-5f1e-4169-8e3b-f0617079dd82 None admin] RBAC: Adding query filter params (role.id=30bb1e97257f4ca5b90c88545777317b, scope.project.id=317f54a463cb48ab86648c6dcec5db0f, user.id=282ec32864d046b2bea170f6a3845cc0) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:21:02.215773 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3be90a5-5f1e-4169-8e3b-f0617079dd82 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:02.217320 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3be90a5-5f1e-4169-8e3b-f0617079dd82 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:02.223978 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 410/826] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Aug 24 11:21:02 2022] GET /identity/v3/role_assignments?user.id=282ec32864d046b2bea170f6a3845cc0&scope.project.id=317f54a463cb48ab86648c6dcec5db0f&role.id=30bb1e97257f4ca5b90c88545777317b => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:21:02.229790 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5af6f25-16d4-4c3e-b073-105ea042b1c9 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:02.268195 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbd541b-339c-4f8a-907f-d0ed7dc62e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:02.269350 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbd541b-339c-4f8a-907f-d0ed7dc62e7d None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:02.269848 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbd541b-339c-4f8a-907f-d0ed7dc62e7d None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:02.270314 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbd541b-339c-4f8a-907f-d0ed7dc62e7d None admin] PATH_INFO: `/v3/users` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:02.271348 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbd541b-339c-4f8a-907f-d0ed7dc62e7d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:21:02.271885 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbd541b-339c-4f8a-907f-d0ed7dc62e7d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:02.273688 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbd541b-339c-4f8a-907f-d0ed7dc62e7d None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:02.295245 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 417/827] 10.222.0.27 () {56 vars in 1149 bytes} [Wed Aug 24 11:21:02 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:21:02.306418 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3be90a5-5f1e-4169-8e3b-f0617079dd82 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:02.410085 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3be90a5-5f1e-4169-8e3b-f0617079dd82 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:02.419392 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:02.446216 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22a442d-572c-44c1-85fe-ba8f6bdff12c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:02.446868 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22a442d-572c-44c1-85fe-ba8f6bdff12c None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:02.447140 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22a442d-572c-44c1-85fe-ba8f6bdff12c None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:02.447406 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22a442d-572c-44c1-85fe-ba8f6bdff12c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:02.459578 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22a442d-572c-44c1-85fe-ba8f6bdff12c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:02.461045 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22a442d-572c-44c1-85fe-ba8f6bdff12c None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:02.475822 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-a22a442d-572c-44c1-85fe-ba8f6bdff12c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:21:02.475822 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:21:02.475822 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:21:02.475822 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:21:02.475822 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:21:02.475822 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:21:02.475822 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:21:02.475822 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:21:02.475822 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:21:02.475822 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:21:02.475822 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:21:02.475822 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:21:02.475822 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 11:21:02.475822 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 11:21:02.475822 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 11:21:02.475822 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 11:21:02.477026 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:21:02.477026 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:21:02.477026 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:21:02.477026 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:21:02.477026 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:21:02.477026 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:21:02.477026 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:21:02.477026 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Aug 24 11:21:02.477026 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:21:02.477026 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:21:02.477026 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:21:02.477026 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:21:02.477026 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:21:02.477026 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:21:02.477026 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:21:02.477026 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:21:02.477026 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 11:21:02.478184 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 11:21:02.478184 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:21:02.478184 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Aug 24 11:21:02.478184 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 411/828] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 11:21:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:21:02.483827 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbd541b-339c-4f8a-907f-d0ed7dc62e7d None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:02.500546 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:02.590209 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbd541b-339c-4f8a-907f-d0ed7dc62e7d None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:02.626597 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f874105-2504-447b-94f0-0c4c8ec0b3a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:02.627211 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f874105-2504-447b-94f0-0c4c8ec0b3a7 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:02.627480 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f874105-2504-447b-94f0-0c4c8ec0b3a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:02.627743 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f874105-2504-447b-94f0-0c4c8ec0b3a7 None admin] PATH_INFO: `/v3/domains` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:02.628637 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f874105-2504-447b-94f0-0c4c8ec0b3a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:21:02.628954 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f874105-2504-447b-94f0-0c4c8ec0b3a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:02.630422 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f874105-2504-447b-94f0-0c4c8ec0b3a7 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:02.642787 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 418/829] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 24 11:21:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:21:02.648145 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22a442d-572c-44c1-85fe-ba8f6bdff12c None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:02.665819 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fde137d-ee69-41fc-b426-02769b60f24e None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:02.666471 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fde137d-ee69-41fc-b426-02769b60f24e None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:02.666925 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fde137d-ee69-41fc-b426-02769b60f24e None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:02.668700 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 419/830] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:21:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 11:21:02.673919 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1a24cf-6931-4889-a089-91cf646a6027 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:02.674524 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1a24cf-6931-4889-a089-91cf646a6027 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:02.674946 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1a24cf-6931-4889-a089-91cf646a6027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:02.694189 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-4f1a24cf-6931-4889-a089-91cf646a6027 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:21:02.695765 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-4f1a24cf-6931-4889-a089-91cf646a6027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:21:02.772146 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22a442d-572c-44c1-85fe-ba8f6bdff12c None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:02.772403 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 420/831] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:21:02 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 11:21:02.806529 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdab9cb-7434-4a61-8e2b-5f3ec36b69eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:02.807170 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdab9cb-7434-4a61-8e2b-5f3ec36b69eb None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:02.807451 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdab9cb-7434-4a61-8e2b-5f3ec36b69eb None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:02.807716 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdab9cb-7434-4a61-8e2b-5f3ec36b69eb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:02.814428 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdab9cb-7434-4a61-8e2b-5f3ec36b69eb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:02.816092 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdab9cb-7434-4a61-8e2b-5f3ec36b69eb None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:02.828407 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-3bdab9cb-7434-4a61-8e2b-5f3ec36b69eb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 11:21:02.828407 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:21:02.828407 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:21:02.828407 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:21:02.828407 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:21:02.828407 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:21:02.828407 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:21:02.828407 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:21:02.828407 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:21:02.828407 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:21:02.828407 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:21:02.828407 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:21:02.828407 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 11:21:02.828407 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 11:21:02.828407 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 11:21:02.829322 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 11:21:02.829322 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:21:02.829322 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:21:02.829322 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:21:02.829322 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:21:02.829322 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:21:02.829322 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:21:02.829322 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:21:02.829322 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Aug 24 11:21:02.829322 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:21:02.829322 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:21:02.829322 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:21:02.829322 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:21:02.829322 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:21:02.829322 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:21:02.829322 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:21:02.829322 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:21:02.830211 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 11:21:02.830211 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 11:21:02.830211 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 11:21:02.830211 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 11:21:02.830211 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 11:21:02.830211 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 11:21:02.830211 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 11:21:02.830211 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Aug 24 11:21:02.830211 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 412/832] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Aug 24 11:21:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:21:02.835441 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1a24cf-6931-4889-a089-91cf646a6027 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:02.838434 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:02.943536 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1a24cf-6931-4889-a089-91cf646a6027 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:02.980219 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ebb504-3775-46df-89f1-9011740b671c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:02.980842 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ebb504-3775-46df-89f1-9011740b671c None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:02.981112 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ebb504-3775-46df-89f1-9011740b671c None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:02.981374 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ebb504-3775-46df-89f1-9011740b671c None admin] PATH_INFO: `/v3/projects` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:02.982065 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ebb504-3775-46df-89f1-9011740b671c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:21:02.982388 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ebb504-3775-46df-89f1-9011740b671c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:02.983847 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ebb504-3775-46df-89f1-9011740b671c None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:02.996375 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 421/833] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Aug 24 11:21:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:21:03.002146 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdab9cb-7434-4a61-8e2b-5f3ec36b69eb None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:03.028684 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:03.038795 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ebb504-3775-46df-89f1-9011740b671c None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:03.126291 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdab9cb-7434-4a61-8e2b-5f3ec36b69eb None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:03.134012 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:03.163570 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ebb504-3775-46df-89f1-9011740b671c None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:03.169406 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a548cd7-1d34-4e24-ab39-4b59e4695e8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:03.170073 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a548cd7-1d34-4e24-ab39-4b59e4695e8a None admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:03.170349 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a548cd7-1d34-4e24-ab39-4b59e4695e8a None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:03.170643 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a548cd7-1d34-4e24-ab39-4b59e4695e8a None admin] PATH_INFO: `/v3/projects/317f54a463cb48ab86648c6dcec5db0f/users/a5915030f01941fc89f92228ff57c7f0/roles/217baac59e08499ea2f1b1d84935df0b` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:03.186420 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a548cd7-1d34-4e24-ab39-4b59e4695e8a None admin] RBAC: Authorizing `identity:create_grant(project_id=317f54a463cb48ab86648c6dcec5db0f, user_id=a5915030f01941fc89f92228ff57c7f0, role_id=217baac59e08499ea2f1b1d84935df0b)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:03.188102 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a548cd7-1d34-4e24-ab39-4b59e4695e8a None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:03.199059 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9d1f91-ea59-47e3-a870-3737d284de44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:03.199719 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9d1f91-ea59-47e3-a870-3737d284de44 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:03.200039 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9d1f91-ea59-47e3-a870-3737d284de44 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:03.200309 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9d1f91-ea59-47e3-a870-3737d284de44 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:03.204149 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 413/834] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Aug 24 11:21:03 2022] PUT /identity/v3/projects/317f54a463cb48ab86648c6dcec5db0f/users/a5915030f01941fc89f92228ff57c7f0/roles/217baac59e08499ea2f1b1d84935df0b => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:21:03.215738 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9d1f91-ea59-47e3-a870-3737d284de44 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:21:03.221619 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-dc9d1f91-ea59-47e3-a870-3737d284de44 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 11:21:03.221619 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:21:03.221619 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:21:03.221619 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:21:03.221619 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:21:03.221619 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:21:03.221619 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:21:03.221619 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:21:03.221619 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:21:03.221619 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:21:03.221619 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:21:03.221619 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:21:03.221619 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:21:03.221619 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:21:03.221619 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:21:03.221619 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:21:03.223093 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:21:03.223093 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:21:03.223093 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:21:03.223093 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:21:03.223093 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:21:03.223093 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:21:03.223093 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:21:03.223093 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:21:03.223093 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:21:03.223093 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:21:03.223093 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:21:03.223093 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Aug 24 11:21:03.223093 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:21:03.223093 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:21:03.223093 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:21:03.223093 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:21:03.224553 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:21:03.224553 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:21:03.224553 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:21:03.224553 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:21:03.224553 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:21:03.224553 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:21:03.224553 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:21:03.224553 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:21:03.224553 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:21:03.224553 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:21:03.224553 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 11:21:03.224553 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:21:03.224553 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 422/835] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Aug 24 11:21:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 11:21:03.232277 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a548cd7-1d34-4e24-ab39-4b59e4695e8a None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:03.315843 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:03.355597 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a548cd7-1d34-4e24-ab39-4b59e4695e8a None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:03.391035 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00991054-0c72-47db-aece-60ad77080350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:03.391659 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00991054-0c72-47db-aece-60ad77080350 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:03.391934 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00991054-0c72-47db-aece-60ad77080350 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:03.392198 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00991054-0c72-47db-aece-60ad77080350 None admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:03.392932 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00991054-0c72-47db-aece-60ad77080350 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:21:03.393233 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00991054-0c72-47db-aece-60ad77080350 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:03.394695 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00991054-0c72-47db-aece-60ad77080350 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:03.404309 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 414/836] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 24 11:21:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:21:03.411765 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9d1f91-ea59-47e3-a870-3737d284de44 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:03.504168 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c798ffab-f85f-4822-888c-635016fb0af5 None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:03.504447 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c798ffab-f85f-4822-888c-635016fb0af5 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:03.504725 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c798ffab-f85f-4822-888c-635016fb0af5 None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:03.506290 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 415/837] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:21:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:21:03.511758 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94ff8c7-c897-4149-9244-7723b31ec60c None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:03.512039 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94ff8c7-c897-4149-9244-7723b31ec60c None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:03.512639 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94ff8c7-c897-4149-9244-7723b31ec60c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:03.521764 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9d1f91-ea59-47e3-a870-3737d284de44 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:03.538145 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-a94ff8c7-c897-4149-9244-7723b31ec60c None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:21:03.539632 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-a94ff8c7-c897-4149-9244-7723b31ec60c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:21:03.545923 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:03.559197 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb1c3f1-3fdf-49ee-8ece-68a0c2cf7d7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:03.559902 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb1c3f1-3fdf-49ee-8ece-68a0c2cf7d7a None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:03.560238 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb1c3f1-3fdf-49ee-8ece-68a0c2cf7d7a None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:03.560570 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb1c3f1-3fdf-49ee-8ece-68a0c2cf7d7a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:03.571530 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb1c3f1-3fdf-49ee-8ece-68a0c2cf7d7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:03.572991 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb1c3f1-3fdf-49ee-8ece-68a0c2cf7d7a None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:03.587206 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-cfb1c3f1-3fdf-49ee-8ece-68a0c2cf7d7a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:21:03.587206 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:21:03.587206 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:21:03.587206 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:21:03.587206 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:21:03.587206 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:21:03.587206 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:21:03.587206 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:21:03.587206 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:21:03.587206 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:21:03.587206 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:21:03.587206 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:21:03.587206 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 11:21:03.587206 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 11:21:03.587206 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 11:21:03.587206 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 11:21:03.588179 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:21:03.588179 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:21:03.588179 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:21:03.588179 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:21:03.588179 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:21:03.588179 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:21:03.588179 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:21:03.588179 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Aug 24 11:21:03.588179 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:21:03.588179 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:21:03.588179 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:21:03.588179 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:21:03.588179 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:21:03.588179 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:21:03.588179 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:21:03.588179 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:21:03.588179 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 11:21:03.589076 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 11:21:03.589076 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:21:03.589076 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:21:03.589076 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 423/838] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 11:21:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:21:03.594128 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb1c3f1-3fdf-49ee-8ece-68a0c2cf7d7a None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:03.634720 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 416/839] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:21:03 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 11:21:03.701972 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb1c3f1-3fdf-49ee-8ece-68a0c2cf7d7a None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:03.741251 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de906919-7149-47cc-8d66-7e0dbb7690cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:03.742249 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de906919-7149-47cc-8d66-7e0dbb7690cf None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:03.742760 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de906919-7149-47cc-8d66-7e0dbb7690cf None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:03.743216 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de906919-7149-47cc-8d66-7e0dbb7690cf None admin] PATH_INFO: `/v3/domains` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:03.744092 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de906919-7149-47cc-8d66-7e0dbb7690cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:21:03.744597 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de906919-7149-47cc-8d66-7e0dbb7690cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:03.746157 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de906919-7149-47cc-8d66-7e0dbb7690cf None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:03.759578 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 424/840] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 24 11:21:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:21:03.767880 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94ff8c7-c897-4149-9244-7723b31ec60c None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:03.832177 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:03.872137 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94ff8c7-c897-4149-9244-7723b31ec60c None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:03.907716 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7c3e7b-a7b9-4356-8a8e-d2e26f753506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:03.908719 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7c3e7b-a7b9-4356-8a8e-d2e26f753506 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:03.909190 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7c3e7b-a7b9-4356-8a8e-d2e26f753506 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:03.909721 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7c3e7b-a7b9-4356-8a8e-d2e26f753506 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:03.917331 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7c3e7b-a7b9-4356-8a8e-d2e26f753506 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:03.919280 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7c3e7b-a7b9-4356-8a8e-d2e26f753506 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:03.930951 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-bd7c3e7b-a7b9-4356-8a8e-d2e26f753506 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 11:21:03.930951 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:21:03.930951 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:21:03.930951 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:21:03.930951 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:21:03.930951 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:21:03.930951 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:21:03.930951 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:21:03.930951 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:21:03.930951 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:21:03.930951 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:21:03.930951 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:21:03.930951 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 11:21:03.930951 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 11:21:03.930951 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 11:21:03.930951 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 11:21:03.931963 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:21:03.931963 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:21:03.931963 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 11:21:03.931963 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 11:21:03.931963 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 11:21:03.931963 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 11:21:03.931963 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:21:03.931963 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:21:03.931963 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:21:03.931963 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:21:03.931963 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:21:03.931963 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Aug 24 11:21:03.931963 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:21:03.931963 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:21:03.931963 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:21:03.931963 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:21:03.931963 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:21:03.931963 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:21:03.932896 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:21:03.932896 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:21:03.932896 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 11:21:03.932896 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 11:21:03.932896 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 11:21:03.932896 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 11:21:03.932896 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 11:21:03.932896 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 11:21:03.932896 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 11:21:03.932896 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Aug 24 11:21:03.935378 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 417/841] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Aug 24 11:21:03 2022] GET /identity/v3/users/swift => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:21:03.942175 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de906919-7149-47cc-8d66-7e0dbb7690cf None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:03.943823 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7c3e7b-a7b9-4356-8a8e-d2e26f753506 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:03.988589 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:04.057676 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7c3e7b-a7b9-4356-8a8e-d2e26f753506 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:04.059375 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de906919-7149-47cc-8d66-7e0dbb7690cf None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:04.081170 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:04.094335 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c810048-6b46-42ed-8b1e-70d29acb7c9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:04.095001 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c810048-6b46-42ed-8b1e-70d29acb7c9e None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:04.095284 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c810048-6b46-42ed-8b1e-70d29acb7c9e None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:04.095551 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c810048-6b46-42ed-8b1e-70d29acb7c9e None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:04.096134 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c810048-6b46-42ed-8b1e-70d29acb7c9e None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:04.097700 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c810048-6b46-42ed-8b1e-70d29acb7c9e None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:04.098110 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1d6e24-8211-4990-829e-b883253117e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:04.099056 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1d6e24-8211-4990-829e-b883253117e2 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:04.099589 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1d6e24-8211-4990-829e-b883253117e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:04.100067 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1d6e24-8211-4990-829e-b883253117e2 None admin] PATH_INFO: `/v3/users` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:04.101094 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1d6e24-8211-4990-829e-b883253117e2 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:21:04.101597 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1d6e24-8211-4990-829e-b883253117e2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:04.103270 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1d6e24-8211-4990-829e-b883253117e2 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:04.112323 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-0c810048-6b46-42ed-8b1e-70d29acb7c9e None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 11:21:04.112323 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:21:04.112323 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 11:21:04.112323 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 11:21:04.112323 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 11:21:04.112323 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 11:21:04.112323 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 11:21:04.112323 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 11:21:04.112323 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 11:21:04.112323 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Aug 24 11:21:04.112323 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 11:21:04.112323 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Aug 24 11:21:04.112323 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:21:04.112323 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:21:04.112323 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:21:04.112323 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:21:04.112323 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:21:04.113442 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:21:04.113442 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:21:04.113442 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:21:04.113442 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:21:04.113442 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:21:04.113442 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:21:04.113442 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 11:21:04.113442 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 11:21:04.113442 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 11:21:04.113442 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 11:21:04.113442 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:21:04.113442 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:21:04.113442 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:21:04.113442 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:21:04.113442 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:21:04.113442 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:21:04.114307 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:21:04.114307 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Aug 24 11:21:04.114307 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:21:04.114307 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:21:04.114307 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:21:04.114307 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:21:04.114307 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:21:04.114307 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:21:04.114307 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:21:04.114307 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:21:04.114307 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 11:21:04.114307 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 11:21:04.114307 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 11:21:04.114307 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Aug 24 11:21:04.118746 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 418/842] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Aug 24 11:21:03 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:21:04.120071 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c810048-6b46-42ed-8b1e-70d29acb7c9e None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:04.132641 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 425/843] 10.222.0.27 () {56 vars in 1135 bytes} [Wed Aug 24 11:21:03 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:21:04.134009 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1d6e24-8211-4990-829e-b883253117e2 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:04.224144 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c810048-6b46-42ed-8b1e-70d29acb7c9e None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:04.230977 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:04.245682 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1d6e24-8211-4990-829e-b883253117e2 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:04.263448 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a795de5f-7a05-4031-b70f-c2cd38c9046c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:04.263916 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a795de5f-7a05-4031-b70f-c2cd38c9046c None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:04.264190 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a795de5f-7a05-4031-b70f-c2cd38c9046c None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:04.264455 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a795de5f-7a05-4031-b70f-c2cd38c9046c None admin] PATH_INFO: `/v3/services` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:04.265087 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a795de5f-7a05-4031-b70f-c2cd38c9046c None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:21:04.265509 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a795de5f-7a05-4031-b70f-c2cd38c9046c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:04.269610 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a795de5f-7a05-4031-b70f-c2cd38c9046c None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:04.276834 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 419/844] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Aug 24 11:21:04 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:21:04.283729 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a795de5f-7a05-4031-b70f-c2cd38c9046c None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:04.293624 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81ac02e-40e3-4220-a292-bfd7dde967a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:04.294701 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81ac02e-40e3-4220-a292-bfd7dde967a5 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:04.295203 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81ac02e-40e3-4220-a292-bfd7dde967a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:04.295667 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81ac02e-40e3-4220-a292-bfd7dde967a5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:04.341470 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:04.374178 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81ac02e-40e3-4220-a292-bfd7dde967a5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:04.375628 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81ac02e-40e3-4220-a292-bfd7dde967a5 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:04.395444 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a795de5f-7a05-4031-b70f-c2cd38c9046c None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:04.429970 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4037bea6-4f15-4f2b-a5bd-a9eb071d449c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:04.430600 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4037bea6-4f15-4f2b-a5bd-a9eb071d449c None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:04.430873 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4037bea6-4f15-4f2b-a5bd-a9eb071d449c None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:04.431136 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4037bea6-4f15-4f2b-a5bd-a9eb071d449c None admin] PATH_INFO: `/v3/services` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:04.431757 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4037bea6-4f15-4f2b-a5bd-a9eb071d449c None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:21:04.432049 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4037bea6-4f15-4f2b-a5bd-a9eb071d449c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:04.433413 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4037bea6-4f15-4f2b-a5bd-a9eb071d449c None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:04.438024 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 420/845] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Aug 24 11:21:04 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:21:04.439241 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1bd94e-18a9-49d9-ab45-456f8474e888 None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:04.439516 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1bd94e-18a9-49d9-ab45-456f8474e888 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:04.439779 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1bd94e-18a9-49d9-ab45-456f8474e888 None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:04.441162 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 421/846] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:21:04 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:21:04.447092 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58fb652-6e92-48e4-9a65-c9eb6ef72800 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:04.447368 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58fb652-6e92-48e4-9a65-c9eb6ef72800 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:04.447686 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58fb652-6e92-48e4-9a65-c9eb6ef72800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:04.466676 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-e58fb652-6e92-48e4-9a65-c9eb6ef72800 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:21:04.467920 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-e58fb652-6e92-48e4-9a65-c9eb6ef72800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:21:04.486658 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:04.500487 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 426/847] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 24 11:21:04 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 11:21:04.507514 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81ac02e-40e3-4220-a292-bfd7dde967a5 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:04.554816 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 422/848] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:21:04 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 11:21:04.626709 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81ac02e-40e3-4220-a292-bfd7dde967a5 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:04.661571 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ff6e64-87aa-4e50-bb38-058555827cd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:04.662270 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ff6e64-87aa-4e50-bb38-058555827cd7 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:04.662585 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ff6e64-87aa-4e50-bb38-058555827cd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:04.662902 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ff6e64-87aa-4e50-bb38-058555827cd7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:04.673222 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ff6e64-87aa-4e50-bb38-058555827cd7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:04.674735 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ff6e64-87aa-4e50-bb38-058555827cd7 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:04.689960 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-04ff6e64-87aa-4e50-bb38-058555827cd7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:21:04.689960 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:21:04.689960 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:21:04.689960 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:21:04.689960 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:21:04.689960 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:21:04.689960 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:21:04.689960 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:21:04.689960 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:21:04.689960 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:21:04.689960 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:21:04.689960 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:21:04.689960 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 11:21:04.689960 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 11:21:04.689960 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 11:21:04.689960 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 11:21:04.691181 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:21:04.691181 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:21:04.691181 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:21:04.691181 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:21:04.691181 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:21:04.691181 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:21:04.691181 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:21:04.691181 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Aug 24 11:21:04.691181 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:21:04.691181 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:21:04.691181 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:21:04.691181 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:21:04.691181 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:21:04.691181 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:21:04.691181 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:21:04.691181 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:21:04.691181 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 11:21:04.692075 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 11:21:04.692075 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:21:04.692075 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:21:04.692075 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 427/849] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 11:21:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 11:21:04.698397 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58fb652-6e92-48e4-9a65-c9eb6ef72800 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:04.747384 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:04.804533 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58fb652-6e92-48e4-9a65-c9eb6ef72800 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:04.811038 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ff6e64-87aa-4e50-bb38-058555827cd7 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:04.844658 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb462da-e42c-465a-bf16-f9a690f743cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:04.845263 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb462da-e42c-465a-bf16-f9a690f743cc None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:04.845521 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb462da-e42c-465a-bf16-f9a690f743cc None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:04.845786 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb462da-e42c-465a-bf16-f9a690f743cc None admin] PATH_INFO: `/v3/domains` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:04.846476 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb462da-e42c-465a-bf16-f9a690f743cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:21:04.846774 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb462da-e42c-465a-bf16-f9a690f743cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:04.848240 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb462da-e42c-465a-bf16-f9a690f743cc None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:04.860625 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 423/850] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 24 11:21:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:21:04.867414 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb462da-e42c-465a-bf16-f9a690f743cc None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:04.870741 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:04.934751 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ff6e64-87aa-4e50-bb38-058555827cd7 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:04.978390 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb193fc-dda7-475f-9038-f68a0ff88686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:04.979554 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb462da-e42c-465a-bf16-f9a690f743cc None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:04.979660 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb193fc-dda7-475f-9038-f68a0ff88686 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:04.979660 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb193fc-dda7-475f-9038-f68a0ff88686 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:04.979660 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb193fc-dda7-475f-9038-f68a0ff88686 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:04.979660 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb193fc-dda7-475f-9038-f68a0ff88686 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:04.979926 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:04.979995 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb193fc-dda7-475f-9038-f68a0ff88686 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:04.990986 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-ceb193fc-dda7-475f-9038-f68a0ff88686 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 11:21:04.990986 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:21:04.990986 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 11:21:04.990986 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 11:21:04.990986 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 11:21:04.990986 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 11:21:04.990986 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 11:21:04.990986 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 11:21:04.990986 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 11:21:04.990986 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:21:04.990986 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 11:21:04.990986 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:21:04.990986 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:21:04.990986 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:21:04.990986 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:21:04.990986 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:21:04.991963 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:21:04.991963 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:21:04.991963 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:21:04.991963 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:21:04.991963 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:21:04.991963 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:21:04.991963 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:21:04.991963 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 11:21:04.991963 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 11:21:04.991963 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 11:21:04.991963 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 11:21:04.991963 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:21:04.991963 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:21:04.991963 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:21:04.991963 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:21:04.991963 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:21:04.991963 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:21:04.993419 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:21:04.993419 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Aug 24 11:21:04.993419 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:21:04.993419 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:21:04.993419 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:21:04.993419 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:21:04.993419 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:21:04.993419 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:21:04.993419 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:21:04.993419 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:21:04.993419 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 11:21:04.993419 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 11:21:04.993419 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 11:21:04.993419 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:21:04.993419 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 428/851] 10.222.0.27 () {56 vars in 1132 bytes} [Wed Aug 24 11:21:04 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 11:21:05.000396 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb193fc-dda7-475f-9038-f68a0ff88686 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:05.019163 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb61192-1c06-41e2-84ca-42838547b2ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:05.019811 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb61192-1c06-41e2-84ca-42838547b2ff None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:05.020090 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb61192-1c06-41e2-84ca-42838547b2ff None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:05.020360 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb61192-1c06-41e2-84ca-42838547b2ff None admin] PATH_INFO: `/v3/projects/service` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:05.030504 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb61192-1c06-41e2-84ca-42838547b2ff None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:05.032851 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb61192-1c06-41e2-84ca-42838547b2ff None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:05.058562 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-ceb61192-1c06-41e2-84ca-42838547b2ff None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 11:21:05.058562 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:21:05.058562 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:21:05.058562 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:21:05.058562 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:21:05.058562 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:21:05.058562 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:21:05.058562 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:21:05.058562 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:21:05.058562 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:21:05.058562 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:21:05.058562 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:21:05.058562 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 11:21:05.058562 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 11:21:05.058562 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 11:21:05.059554 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 11:21:05.059554 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:21:05.059554 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:21:05.059554 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:21:05.059554 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:21:05.059554 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:21:05.059554 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:21:05.059554 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:21:05.059554 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Aug 24 11:21:05.059554 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:21:05.059554 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:21:05.059554 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:21:05.059554 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:21:05.059554 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:21:05.059554 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:21:05.059554 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:21:05.059554 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:21:05.060441 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 11:21:05.060441 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 11:21:05.060441 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 11:21:05.060441 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 11:21:05.060441 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 11:21:05.060441 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 11:21:05.060441 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 11:21:05.060441 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Aug 24 11:21:05.062658 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 424/852] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Aug 24 11:21:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 11:21:05.065583 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb61192-1c06-41e2-84ca-42838547b2ff None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:05.125039 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb193fc-dda7-475f-9038-f68a0ff88686 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:05.134758 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:05.163674 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd8fed0-de68-4579-ae85-6582a7cbe83e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:05.164311 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd8fed0-de68-4579-ae85-6582a7cbe83e None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:05.164585 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd8fed0-de68-4579-ae85-6582a7cbe83e None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:05.164853 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd8fed0-de68-4579-ae85-6582a7cbe83e None admin] PATH_INFO: `/v3/services` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:05.165478 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd8fed0-de68-4579-ae85-6582a7cbe83e None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:21:05.165773 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd8fed0-de68-4579-ae85-6582a7cbe83e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:05.167217 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd8fed0-de68-4579-ae85-6582a7cbe83e None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:05.171723 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 429/853] 10.222.0.27 () {56 vars in 1126 bytes} [Wed Aug 24 11:21:04 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:21:05.172915 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3368fb-f44f-4ac4-ba9f-0f17c6a5b319 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:05.173194 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3368fb-f44f-4ac4-ba9f-0f17c6a5b319 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:05.173460 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3368fb-f44f-4ac4-ba9f-0f17c6a5b319 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:05.174794 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 430/854] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:21:05 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:21:05.179569 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3368fb-f44f-4ac4-ba9f-0f17c6a5b319 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:05.199942 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb61192-1c06-41e2-84ca-42838547b2ff None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:05.236503 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18297194-2112-489f-8313-184cdc14e64b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:05.237316 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18297194-2112-489f-8313-184cdc14e64b None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:05.237717 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18297194-2112-489f-8313-184cdc14e64b None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:05.237990 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18297194-2112-489f-8313-184cdc14e64b None admin] PATH_INFO: `/v3/projects` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:05.238895 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18297194-2112-489f-8313-184cdc14e64b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:21:05.239212 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18297194-2112-489f-8313-184cdc14e64b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:05.241029 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18297194-2112-489f-8313-184cdc14e64b None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:05.258388 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 425/855] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Aug 24 11:21:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:21:05.258388 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e69a58-6fb8-4bf3-a093-b72c2b72136c None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:05.258388 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e69a58-6fb8-4bf3-a093-b72c2b72136c None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:05.258388 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e69a58-6fb8-4bf3-a093-b72c2b72136c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:05.275167 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-74e69a58-6fb8-4bf3-a093-b72c2b72136c None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:21:05.277131 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-74e69a58-6fb8-4bf3-a093-b72c2b72136c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:21:05.284542 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3368fb-f44f-4ac4-ba9f-0f17c6a5b319 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:05.296317 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:05.317599 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abad6f7d-bdd2-4c57-970f-afda9494165f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:05.318210 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abad6f7d-bdd2-4c57-970f-afda9494165f None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:05.318516 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abad6f7d-bdd2-4c57-970f-afda9494165f None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:05.318785 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abad6f7d-bdd2-4c57-970f-afda9494165f None admin] PATH_INFO: `/v3/services` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:05.319447 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abad6f7d-bdd2-4c57-970f-afda9494165f None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:21:05.319754 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abad6f7d-bdd2-4c57-970f-afda9494165f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:05.321146 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abad6f7d-bdd2-4c57-970f-afda9494165f None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:05.327711 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 431/856] 10.222.0.27 () {56 vars in 1126 bytes} [Wed Aug 24 11:21:05 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:21:05.328518 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abad6f7d-bdd2-4c57-970f-afda9494165f None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:05.369672 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:05.378863 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 426/857] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:21:05 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 11:21:05.451890 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abad6f7d-bdd2-4c57-970f-afda9494165f None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:05.488779 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4a8063-71f6-4fe7-8b55-f84f09fb34cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:05.489428 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4a8063-71f6-4fe7-8b55-f84f09fb34cb None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:05.489658 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4a8063-71f6-4fe7-8b55-f84f09fb34cb None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:05.489926 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4a8063-71f6-4fe7-8b55-f84f09fb34cb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:05.490682 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4a8063-71f6-4fe7-8b55-f84f09fb34cb None admin] RBAC: Adding query filter params (role.id=30bb1e97257f4ca5b90c88545777317b, scope.project.id=317f54a463cb48ab86648c6dcec5db0f, user.id=f1069558c085449f9e4c9f06013b2a85) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:21:05.490985 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4a8063-71f6-4fe7-8b55-f84f09fb34cb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:05.492437 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4a8063-71f6-4fe7-8b55-f84f09fb34cb None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:05.498964 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 432/858] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Aug 24 11:21:05 2022] GET /identity/v3/role_assignments?user.id=f1069558c085449f9e4c9f06013b2a85&scope.project.id=317f54a463cb48ab86648c6dcec5db0f&role.id=30bb1e97257f4ca5b90c88545777317b => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:21:05.643565 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e69a58-6fb8-4bf3-a093-b72c2b72136c None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:05.749576 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e69a58-6fb8-4bf3-a093-b72c2b72136c None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:05.784905 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4941ab-a2a7-4e78-85fb-c5692b09abc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:05.785841 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4941ab-a2a7-4e78-85fb-c5692b09abc3 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:05.786261 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4941ab-a2a7-4e78-85fb-c5692b09abc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:05.786693 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4941ab-a2a7-4e78-85fb-c5692b09abc3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:05.797225 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4941ab-a2a7-4e78-85fb-c5692b09abc3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:21:05.802190 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-5a4941ab-a2a7-4e78-85fb-c5692b09abc3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 11:21:05.802190 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:21:05.802190 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:21:05.802190 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:21:05.802190 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:21:05.802190 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:21:05.802190 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:21:05.802190 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:21:05.802190 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:21:05.802190 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:21:05.802190 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:21:05.802190 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:21:05.802190 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:21:05.802190 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:21:05.802190 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:21:05.802190 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:21:05.803324 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:21:05.803324 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:21:05.803324 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:21:05.803324 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:21:05.803324 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:21:05.803324 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:21:05.803324 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:21:05.803324 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:21:05.803324 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:21:05.803324 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:21:05.803324 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:21:05.803324 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Aug 24 11:21:05.803324 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:21:05.803324 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:21:05.803324 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:21:05.803324 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:21:05.804382 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:21:05.804382 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:21:05.804382 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:21:05.804382 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:21:05.804382 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:21:05.804382 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:21:05.804382 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:21:05.804382 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:21:05.804382 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:21:05.804382 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:21:05.804382 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 11:21:05.804382 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Aug 24 11:21:05.806713 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 427/859] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Aug 24 11:21:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:21:05.812780 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4a8063-71f6-4fe7-8b55-f84f09fb34cb None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:05.913680 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:05.922400 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4a8063-71f6-4fe7-8b55-f84f09fb34cb None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:05.953655 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe57a63-2ff8-4a22-99df-3c9090978a74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:05.954278 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe57a63-2ff8-4a22-99df-3c9090978a74 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:05.954588 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe57a63-2ff8-4a22-99df-3c9090978a74 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:05.954866 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe57a63-2ff8-4a22-99df-3c9090978a74 None admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:05.956507 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe57a63-2ff8-4a22-99df-3c9090978a74 None admin] RBAC: Adding query filter params (name=service) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:21:05.956507 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe57a63-2ff8-4a22-99df-3c9090978a74 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:05.957338 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe57a63-2ff8-4a22-99df-3c9090978a74 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:05.966077 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 433/860] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Aug 24 11:21:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:21:05.971830 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4941ab-a2a7-4e78-85fb-c5692b09abc3 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:05.989313 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:06.077567 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4941ab-a2a7-4e78-85fb-c5692b09abc3 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:06.120751 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e715dde0-3819-49d2-a2ee-38b303f7e9bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:06.121386 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e715dde0-3819-49d2-a2ee-38b303f7e9bf None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:06.121678 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e715dde0-3819-49d2-a2ee-38b303f7e9bf None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:06.121946 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e715dde0-3819-49d2-a2ee-38b303f7e9bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:06.132519 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e715dde0-3819-49d2-a2ee-38b303f7e9bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:06.133989 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e715dde0-3819-49d2-a2ee-38b303f7e9bf None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:06.149245 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-e715dde0-3819-49d2-a2ee-38b303f7e9bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:21:06.149245 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:21:06.149245 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:21:06.149245 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:21:06.149245 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:21:06.149245 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:21:06.149245 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:21:06.149245 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:21:06.149245 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:21:06.149245 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:21:06.149245 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:21:06.149245 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:21:06.149245 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 11:21:06.149245 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 11:21:06.149245 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 11:21:06.149245 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 11:21:06.150241 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:21:06.150241 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:21:06.150241 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:21:06.150241 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:21:06.150241 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:21:06.150241 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:21:06.150241 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:21:06.150241 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Aug 24 11:21:06.150241 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:21:06.150241 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:21:06.150241 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:21:06.150241 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:21:06.150241 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:21:06.150241 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:21:06.150241 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:21:06.150241 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:21:06.150241 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 11:21:06.151271 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 11:21:06.151271 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:21:06.151271 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Aug 24 11:21:06.151271 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 428/861] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 11:21:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:21:06.156726 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe57a63-2ff8-4a22-99df-3c9090978a74 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:06.259920 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe57a63-2ff8-4a22-99df-3c9090978a74 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:06.295009 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21031140-89a2-45a8-9a26-be258bcd633e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:06.295622 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21031140-89a2-45a8-9a26-be258bcd633e None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:06.295894 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21031140-89a2-45a8-9a26-be258bcd633e None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:06.296165 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21031140-89a2-45a8-9a26-be258bcd633e None admin] PATH_INFO: `/v3/domains` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:06.296812 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21031140-89a2-45a8-9a26-be258bcd633e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:21:06.297112 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21031140-89a2-45a8-9a26-be258bcd633e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:06.298588 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21031140-89a2-45a8-9a26-be258bcd633e None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:06.315596 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 434/862] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 24 11:21:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:21:06.320960 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e715dde0-3819-49d2-a2ee-38b303f7e9bf None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:06.389166 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:06.430376 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e715dde0-3819-49d2-a2ee-38b303f7e9bf None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:06.464650 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daed5c7-7803-4a36-8beb-28d396549eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:06.465282 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daed5c7-7803-4a36-8beb-28d396549eca None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:06.465559 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daed5c7-7803-4a36-8beb-28d396549eca None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:06.465835 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daed5c7-7803-4a36-8beb-28d396549eca None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:06.474015 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5daed5c7-7803-4a36-8beb-28d396549eca None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:06.475530 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5daed5c7-7803-4a36-8beb-28d396549eca None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:06.487046 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-5daed5c7-7803-4a36-8beb-28d396549eca None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 11:21:06.487046 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:21:06.487046 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:21:06.487046 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:21:06.487046 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:21:06.487046 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:21:06.487046 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:21:06.487046 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:21:06.487046 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:21:06.487046 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:21:06.487046 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:21:06.487046 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:21:06.487046 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 11:21:06.487046 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 11:21:06.487046 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 11:21:06.487046 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 11:21:06.488091 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:21:06.488091 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:21:06.488091 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 11:21:06.488091 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 11:21:06.488091 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 11:21:06.488091 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 11:21:06.488091 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:21:06.488091 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:21:06.488091 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:21:06.488091 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:21:06.488091 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:21:06.488091 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Aug 24 11:21:06.488091 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:21:06.488091 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:21:06.488091 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:21:06.488091 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:21:06.488091 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:21:06.488091 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:21:06.489050 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:21:06.489050 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:21:06.489050 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 11:21:06.489050 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 11:21:06.489050 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 11:21:06.489050 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 11:21:06.489050 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 11:21:06.489050 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 11:21:06.489050 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 11:21:06.489050 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Aug 24 11:21:06.489050 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 429/863] 10.222.0.27 () {56 vars in 1117 bytes} [Wed Aug 24 11:21:06 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:21:06.495810 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21031140-89a2-45a8-9a26-be258bcd633e None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:06.513520 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822ad1b9-b38e-470b-bd25-19d43bc0301a None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:06.513891 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822ad1b9-b38e-470b-bd25-19d43bc0301a None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:06.514220 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822ad1b9-b38e-470b-bd25-19d43bc0301a None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:06.515694 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 430/864] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:21:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 11:21:06.521288 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1278bcea-f3b3-4af8-825d-3a5f1f6502e7 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:06.521575 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1278bcea-f3b3-4af8-825d-3a5f1f6502e7 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:06.521821 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1278bcea-f3b3-4af8-825d-3a5f1f6502e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:06.528909 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:06.541833 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-1278bcea-f3b3-4af8-825d-3a5f1f6502e7 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:21:06.543087 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-1278bcea-f3b3-4af8-825d-3a5f1f6502e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:21:06.610391 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21031140-89a2-45a8-9a26-be258bcd633e None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:06.618376 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 431/865] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:21:06 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 11:21:06.648822 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f65839-785d-4740-951c-50fc17a54e0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:06.649728 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f65839-785d-4740-951c-50fc17a54e0e None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:06.650158 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f65839-785d-4740-951c-50fc17a54e0e None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:06.650563 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f65839-785d-4740-951c-50fc17a54e0e None admin] PATH_INFO: `/v3/users` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:06.651303 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f65839-785d-4740-951c-50fc17a54e0e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:21:06.651946 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f65839-785d-4740-951c-50fc17a54e0e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:06.653393 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f65839-785d-4740-951c-50fc17a54e0e None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:06.676078 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 435/866] 10.222.0.27 () {56 vars in 1149 bytes} [Wed Aug 24 11:21:06 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:21:06.678133 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1278bcea-f3b3-4af8-825d-3a5f1f6502e7 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:06.745279 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:06.789818 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1278bcea-f3b3-4af8-825d-3a5f1f6502e7 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:06.824385 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9082f03-8f89-4f06-8d5f-bb75ecbbf318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:06.824993 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9082f03-8f89-4f06-8d5f-bb75ecbbf318 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:06.825268 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9082f03-8f89-4f06-8d5f-bb75ecbbf318 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:06.825536 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9082f03-8f89-4f06-8d5f-bb75ecbbf318 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:06.892704 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9082f03-8f89-4f06-8d5f-bb75ecbbf318 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:06.894194 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9082f03-8f89-4f06-8d5f-bb75ecbbf318 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:06.899838 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f65839-785d-4740-951c-50fc17a54e0e None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:06.973475 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:06.990748 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:07.012198 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f65839-785d-4740-951c-50fc17a54e0e None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:07.040779 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 432/867] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 24 11:21:06 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 11:21:07.047427 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9082f03-8f89-4f06-8d5f-bb75ecbbf318 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:07.054998 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2531a808-ae06-4ac2-bb52-418e4ce925a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:07.055633 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2531a808-ae06-4ac2-bb52-418e4ce925a4 None admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:07.055911 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2531a808-ae06-4ac2-bb52-418e4ce925a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:07.056188 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2531a808-ae06-4ac2-bb52-418e4ce925a4 None admin] PATH_INFO: `/v3/services` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:07.056843 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2531a808-ae06-4ac2-bb52-418e4ce925a4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:07.058856 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2531a808-ae06-4ac2-bb52-418e4ce925a4 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:07.079944 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 436/868] 10.222.0.27 () {60 vars in 1141 bytes} [Wed Aug 24 11:21:06 2022] POST /identity/v3/services => generated 251 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 11:21:07.174152 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9082f03-8f89-4f06-8d5f-bb75ecbbf318 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:07.219734 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5cc670-6b57-4937-a260-857b5e536725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:07.220377 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5cc670-6b57-4937-a260-857b5e536725 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:07.220648 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5cc670-6b57-4937-a260-857b5e536725 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:07.220913 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5cc670-6b57-4937-a260-857b5e536725 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:07.233011 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5cc670-6b57-4937-a260-857b5e536725 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:07.234581 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5cc670-6b57-4937-a260-857b5e536725 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:07.251148 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-ef5cc670-6b57-4937-a260-857b5e536725 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:21:07.251148 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:21:07.251148 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:21:07.251148 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:21:07.251148 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:21:07.251148 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:21:07.251148 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:21:07.251148 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:21:07.251148 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:21:07.251148 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:21:07.251148 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:21:07.251148 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:21:07.251148 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 11:21:07.251148 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 11:21:07.251148 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 11:21:07.251148 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 11:21:07.252174 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:21:07.252174 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:21:07.252174 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:21:07.252174 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:21:07.252174 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:21:07.252174 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:21:07.252174 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:21:07.252174 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Aug 24 11:21:07.252174 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:21:07.252174 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:21:07.252174 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:21:07.252174 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:21:07.252174 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:21:07.252174 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:21:07.252174 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:21:07.252174 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:21:07.252174 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 11:21:07.253162 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 11:21:07.253162 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:21:07.253162 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Aug 24 11:21:07.253162 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 433/869] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 11:21:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 11:21:07.258433 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2531a808-ae06-4ac2-bb52-418e4ce925a4 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:07.366251 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2531a808-ae06-4ac2-bb52-418e4ce925a4 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:07.370931 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c795e9-5aff-4640-b23c-f58095489b79 None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:07.371482 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c795e9-5aff-4640-b23c-f58095489b79 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:07.371482 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c795e9-5aff-4640-b23c-f58095489b79 None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:07.373050 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 434/870] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:21:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:21:07.378191 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14da9363-93ee-4b25-b636-770576fafc72 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:07.378517 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14da9363-93ee-4b25-b636-770576fafc72 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:07.378785 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14da9363-93ee-4b25-b636-770576fafc72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:07.386694 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:07.399041 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-14da9363-93ee-4b25-b636-770576fafc72 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:21:07.400267 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-14da9363-93ee-4b25-b636-770576fafc72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:21:07.403084 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e3288e-f2e4-4c70-8fbb-ae9311c250da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:07.403825 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e3288e-f2e4-4c70-8fbb-ae9311c250da None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:07.404106 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e3288e-f2e4-4c70-8fbb-ae9311c250da None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:07.404374 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e3288e-f2e4-4c70-8fbb-ae9311c250da None admin] PATH_INFO: `/v3/domains` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:07.405026 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e3288e-f2e4-4c70-8fbb-ae9311c250da None admin] RBAC: Adding query filter params (name=Default) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:21:07.405332 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e3288e-f2e4-4c70-8fbb-ae9311c250da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:07.406757 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e3288e-f2e4-4c70-8fbb-ae9311c250da None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:07.416453 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:07.420349 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 437/871] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 24 11:21:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:21:07.425794 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e3288e-f2e4-4c70-8fbb-ae9311c250da None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:07.482587 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 435/872] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:21:07 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 11:21:07.536670 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e3288e-f2e4-4c70-8fbb-ae9311c250da None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:07.571421 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59c4b98-47a6-41db-bbfd-559cb0484731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:07.572063 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59c4b98-47a6-41db-bbfd-559cb0484731 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:07.572340 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59c4b98-47a6-41db-bbfd-559cb0484731 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:07.572612 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59c4b98-47a6-41db-bbfd-559cb0484731 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:07.579571 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59c4b98-47a6-41db-bbfd-559cb0484731 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:07.581036 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59c4b98-47a6-41db-bbfd-559cb0484731 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:07.592409 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-f59c4b98-47a6-41db-bbfd-559cb0484731 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 11:21:07.592409 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:21:07.592409 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:21:07.592409 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:21:07.592409 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:21:07.592409 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:21:07.592409 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:21:07.592409 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:21:07.592409 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:21:07.592409 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:21:07.592409 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:21:07.592409 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:21:07.592409 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 11:21:07.592409 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 11:21:07.592409 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 11:21:07.593363 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 11:21:07.593363 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:21:07.593363 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:21:07.593363 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:21:07.593363 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:21:07.593363 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:21:07.593363 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:21:07.593363 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:21:07.593363 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Aug 24 11:21:07.593363 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:21:07.593363 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:21:07.593363 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:21:07.593363 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:21:07.593363 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:21:07.593363 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:21:07.593363 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:21:07.593363 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:21:07.594296 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 11:21:07.594296 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 11:21:07.594296 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 11:21:07.594296 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 11:21:07.594296 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 11:21:07.594296 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 11:21:07.594296 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 11:21:07.594296 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:21:07.596899 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 438/873] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Aug 24 11:21:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:21:07.602455 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14da9363-93ee-4b25-b636-770576fafc72 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:07.612850 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78317b0c-b0dc-4db5-b336-dfaf2f575ebe None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:07.613129 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78317b0c-b0dc-4db5-b336-dfaf2f575ebe None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:07.613402 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78317b0c-b0dc-4db5-b336-dfaf2f575ebe None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:07.614828 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 439/874] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:21:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 11:21:07.620194 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316a8cf2-41bc-4885-8dd4-e7ad2402b43c None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:07.620646 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316a8cf2-41bc-4885-8dd4-e7ad2402b43c None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:07.620925 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316a8cf2-41bc-4885-8dd4-e7ad2402b43c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:07.639619 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-316a8cf2-41bc-4885-8dd4-e7ad2402b43c None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:21:07.640858 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-316a8cf2-41bc-4885-8dd4-e7ad2402b43c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:21:07.709689 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:07.711323 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14da9363-93ee-4b25-b636-770576fafc72 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:07.724424 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 440/875] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:21:07 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 11:21:07.747767 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7b5c8e-1bcb-44dc-b568-4625cb83ab0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:07.748686 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7b5c8e-1bcb-44dc-b568-4625cb83ab0a None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:07.749104 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7b5c8e-1bcb-44dc-b568-4625cb83ab0a None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:07.749512 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7b5c8e-1bcb-44dc-b568-4625cb83ab0a None admin] PATH_INFO: `/v3/projects` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:07.750346 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7b5c8e-1bcb-44dc-b568-4625cb83ab0a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:21:07.750808 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7b5c8e-1bcb-44dc-b568-4625cb83ab0a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:07.752378 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7b5c8e-1bcb-44dc-b568-4625cb83ab0a None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:07.754226 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:07.766031 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 436/876] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Aug 24 11:21:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:21:07.772263 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316a8cf2-41bc-4885-8dd4-e7ad2402b43c None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:07.777173 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7b5c8e-1bcb-44dc-b568-4625cb83ab0a None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:07.875799 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7b5c8e-1bcb-44dc-b568-4625cb83ab0a None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:07.878206 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316a8cf2-41bc-4885-8dd4-e7ad2402b43c None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:07.910472 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91418577-1303-436f-84b7-2f98a0400bf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:07.911321 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91418577-1303-436f-84b7-2f98a0400bf8 None admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:07.911745 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91418577-1303-436f-84b7-2f98a0400bf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:07.912197 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91418577-1303-436f-84b7-2f98a0400bf8 None admin] PATH_INFO: `/v3/services` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:07.913055 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91418577-1303-436f-84b7-2f98a0400bf8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:07.914724 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91418577-1303-436f-84b7-2f98a0400bf8 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:07.914832 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b04d12-8789-455f-981e-0acc052fb519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:07.915426 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b04d12-8789-455f-981e-0acc052fb519 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:07.915705 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b04d12-8789-455f-981e-0acc052fb519 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:07.915978 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b04d12-8789-455f-981e-0acc052fb519 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:07.916708 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b04d12-8789-455f-981e-0acc052fb519 None admin] RBAC: Adding query filter params (role.id=217baac59e08499ea2f1b1d84935df0b, scope.project.id=317f54a463cb48ab86648c6dcec5db0f, user.id=a5915030f01941fc89f92228ff57c7f0) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:21:07.917016 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b04d12-8789-455f-981e-0acc052fb519 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:07.918509 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b04d12-8789-455f-981e-0acc052fb519 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:07.925045 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 441/877] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Aug 24 11:21:07 2022] GET /identity/v3/role_assignments?user.id=a5915030f01941fc89f92228ff57c7f0&scope.project.id=317f54a463cb48ab86648c6dcec5db0f&role.id=217baac59e08499ea2f1b1d84935df0b => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:21:07.938323 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 437/878] 10.222.0.27 () {60 vars in 1141 bytes} [Wed Aug 24 11:21:07 2022] POST /identity/v3/services => generated 269 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 11:21:07.991012 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b04d12-8789-455f-981e-0acc052fb519 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:08.063419 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:08.115577 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b04d12-8789-455f-981e-0acc052fb519 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:08.158625 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4f2d09-3687-4e78-b307-486a1dc30fee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:08.159268 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4f2d09-3687-4e78-b307-486a1dc30fee None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:08.159580 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4f2d09-3687-4e78-b307-486a1dc30fee None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:08.159851 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4f2d09-3687-4e78-b307-486a1dc30fee None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:08.160438 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4f2d09-3687-4e78-b307-486a1dc30fee None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:08.161828 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4f2d09-3687-4e78-b307-486a1dc30fee None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:08.171450 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-7b4f2d09-3687-4e78-b307-486a1dc30fee None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 11:21:08.171450 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:21:08.171450 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 11:21:08.171450 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 11:21:08.171450 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 11:21:08.171450 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 11:21:08.171450 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 11:21:08.171450 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 11:21:08.171450 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 11:21:08.171450 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:21:08.171450 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 11:21:08.171450 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:21:08.171450 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:21:08.171450 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:21:08.171450 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:21:08.171450 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:21:08.171450 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:21:08.172479 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:21:08.172479 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:21:08.172479 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:21:08.172479 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:21:08.172479 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:21:08.172479 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:21:08.172479 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 11:21:08.172479 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 11:21:08.172479 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 11:21:08.172479 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 11:21:08.172479 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:21:08.172479 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:21:08.172479 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:21:08.172479 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:21:08.172479 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:21:08.172479 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:21:08.173586 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:21:08.173586 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Aug 24 11:21:08.173586 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:21:08.173586 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:21:08.173586 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:21:08.173586 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:21:08.173586 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:21:08.173586 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:21:08.173586 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:21:08.173586 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:21:08.173586 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 11:21:08.173586 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 11:21:08.173586 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 11:21:08.173586 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:21:08.173586 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 442/879] 10.222.0.27 () {56 vars in 1126 bytes} [Wed Aug 24 11:21:07 2022] GET /identity/v3/services/object-store => generated 93 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:21:08.180950 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91418577-1303-436f-84b7-2f98a0400bf8 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:08.242594 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:08.290275 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91418577-1303-436f-84b7-2f98a0400bf8 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:08.325319 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73196115-a17c-44d8-b740-b3e76dee67ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:08.325999 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73196115-a17c-44d8-b740-b3e76dee67ac None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:08.326279 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73196115-a17c-44d8-b740-b3e76dee67ac None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:08.326608 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73196115-a17c-44d8-b740-b3e76dee67ac None admin] PATH_INFO: `/v3/services` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:08.327252 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73196115-a17c-44d8-b740-b3e76dee67ac None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:21:08.327554 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73196115-a17c-44d8-b740-b3e76dee67ac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:08.328933 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73196115-a17c-44d8-b740-b3e76dee67ac None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:08.334201 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 438/880] 10.222.0.27 () {56 vars in 1122 bytes} [Wed Aug 24 11:21:08 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:21:08.340218 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4f2d09-3687-4e78-b307-486a1dc30fee None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:08.443309 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4f2d09-3687-4e78-b307-486a1dc30fee None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:08.458509 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:08.481068 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b265463b-28a3-4294-a0b0-f810170a4cbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:08.481678 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b265463b-28a3-4294-a0b0-f810170a4cbc None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:08.481953 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b265463b-28a3-4294-a0b0-f810170a4cbc None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:08.482219 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b265463b-28a3-4294-a0b0-f810170a4cbc None admin] PATH_INFO: `/v3/services` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:08.482879 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b265463b-28a3-4294-a0b0-f810170a4cbc None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:21:08.483171 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b265463b-28a3-4294-a0b0-f810170a4cbc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:08.484557 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b265463b-28a3-4294-a0b0-f810170a4cbc None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:08.489892 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 443/881] 10.222.0.27 () {56 vars in 1122 bytes} [Wed Aug 24 11:21:08 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:21:09.073590 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dfb571-b2e8-45d0-aa59-1bc7894fa135 None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:09.074158 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dfb571-b2e8-45d0-aa59-1bc7894fa135 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:09.074158 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dfb571-b2e8-45d0-aa59-1bc7894fa135 None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:09.075910 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 439/882] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:21:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:21:09.081375 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7276910-754e-46ea-bf7d-3efcaa0744f3 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:09.081814 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7276910-754e-46ea-bf7d-3efcaa0744f3 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:09.081984 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7276910-754e-46ea-bf7d-3efcaa0744f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:09.101682 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-c7276910-754e-46ea-bf7d-3efcaa0744f3 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:21:09.103433 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-c7276910-754e-46ea-bf7d-3efcaa0744f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:21:09.179871 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 444/883] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:21:09 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 11:21:09.453737 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dfb571-b2e8-45d0-aa59-1bc7894fa135 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:09.558606 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dfb571-b2e8-45d0-aa59-1bc7894fa135 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:09.576830 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:09.594031 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917521ad-46e4-444e-96ba-4cba51876ec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:09.594695 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917521ad-46e4-444e-96ba-4cba51876ec8 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:09.594968 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917521ad-46e4-444e-96ba-4cba51876ec8 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:09.595232 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917521ad-46e4-444e-96ba-4cba51876ec8 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:09.595845 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917521ad-46e4-444e-96ba-4cba51876ec8 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:09.597281 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917521ad-46e4-444e-96ba-4cba51876ec8 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:09.606189 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-917521ad-46e4-444e-96ba-4cba51876ec8 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 11:21:09.606189 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:21:09.606189 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 11:21:09.606189 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 11:21:09.606189 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 11:21:09.606189 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 11:21:09.606189 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 11:21:09.606189 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 11:21:09.606189 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 11:21:09.606189 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Aug 24 11:21:09.606189 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 11:21:09.606189 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Aug 24 11:21:09.606189 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:21:09.606189 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:21:09.606189 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:21:09.606189 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:21:09.606189 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:21:09.607200 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:21:09.607200 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:21:09.607200 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:21:09.607200 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:21:09.607200 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:21:09.607200 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:21:09.607200 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 11:21:09.607200 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 11:21:09.607200 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 11:21:09.607200 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 11:21:09.607200 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:21:09.607200 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:21:09.607200 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:21:09.607200 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:21:09.607200 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:21:09.607200 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:21:09.608425 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:21:09.608425 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Aug 24 11:21:09.608425 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:21:09.608425 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:21:09.608425 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:21:09.608425 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:21:09.608425 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:21:09.608425 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:21:09.608425 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:21:09.608425 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:21:09.608425 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 11:21:09.608425 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 11:21:09.608425 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 11:21:09.608425 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Aug 24 11:21:09.608425 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 440/884] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Aug 24 11:21:09 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:21:09.613360 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7276910-754e-46ea-bf7d-3efcaa0744f3 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:09.722532 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7276910-754e-46ea-bf7d-3efcaa0744f3 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:09.732498 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:09.759050 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fc61ac-7133-4966-a004-caffcbaaa063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:09.759684 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fc61ac-7133-4966-a004-caffcbaaa063 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:09.759972 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fc61ac-7133-4966-a004-caffcbaaa063 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:09.760241 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fc61ac-7133-4966-a004-caffcbaaa063 None admin] PATH_INFO: `/v3/services` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:09.760885 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fc61ac-7133-4966-a004-caffcbaaa063 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:21:09.761187 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fc61ac-7133-4966-a004-caffcbaaa063 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:09.762634 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fc61ac-7133-4966-a004-caffcbaaa063 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:09.768024 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 445/885] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Aug 24 11:21:09 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:21:09.773862 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917521ad-46e4-444e-96ba-4cba51876ec8 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:09.881257 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917521ad-46e4-444e-96ba-4cba51876ec8 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:09.915947 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aed30b0-6d52-457a-b23a-b4fad6d9eb96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:09.916555 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aed30b0-6d52-457a-b23a-b4fad6d9eb96 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:09.916827 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aed30b0-6d52-457a-b23a-b4fad6d9eb96 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:09.917092 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aed30b0-6d52-457a-b23a-b4fad6d9eb96 None admin] PATH_INFO: `/v3/services` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:09.917726 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aed30b0-6d52-457a-b23a-b4fad6d9eb96 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:21:09.918021 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aed30b0-6d52-457a-b23a-b4fad6d9eb96 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:09.919423 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aed30b0-6d52-457a-b23a-b4fad6d9eb96 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:09.924669 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 441/886] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Aug 24 11:21:09 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:21:09.930489 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fc61ac-7133-4966-a004-caffcbaaa063 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:09.936827 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fba82e9-ca32-40bd-8227-016ac00a63dd None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:09.937106 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fba82e9-ca32-40bd-8227-016ac00a63dd None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:09.937377 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fba82e9-ca32-40bd-8227-016ac00a63dd None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:09.938955 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 442/887] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:21:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 11:21:09.944267 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2b6967-3e57-4a08-8c0b-9566e9afa2d2 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:09.944549 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2b6967-3e57-4a08-8c0b-9566e9afa2d2 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:09.944823 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2b6967-3e57-4a08-8c0b-9566e9afa2d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:09.964895 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-ab2b6967-3e57-4a08-8c0b-9566e9afa2d2 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:21:09.966136 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-ab2b6967-3e57-4a08-8c0b-9566e9afa2d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:21:10.024712 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:10.041956 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fc61ac-7133-4966-a004-caffcbaaa063 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:10.070408 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 443/888] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:21:09 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 11:21:10.070408 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33735b4-68a6-4881-b658-6a234d70cf6e None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:10.070408 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33735b4-68a6-4881-b658-6a234d70cf6e None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:10.070408 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33735b4-68a6-4881-b658-6a234d70cf6e None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:10.070408 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 444/889] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:21:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:21:10.075649 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556136d8-dc0f-48a9-bb08-3fc42e3e56ad None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:10.076240 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556136d8-dc0f-48a9-bb08-3fc42e3e56ad None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:10.076240 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556136d8-dc0f-48a9-bb08-3fc42e3e56ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:10.089860 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0f09b8-d0b4-49ca-b9de-0a381e307409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:10.091457 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0f09b8-d0b4-49ca-b9de-0a381e307409 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:10.091903 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0f09b8-d0b4-49ca-b9de-0a381e307409 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:10.092332 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0f09b8-d0b4-49ca-b9de-0a381e307409 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:10.093207 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0f09b8-d0b4-49ca-b9de-0a381e307409 None admin] RBAC: Adding query filter params (interface=public, service_id=e36699d97e3d4696a321ea52805c5daf, region_id=RegionOne) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:21:10.093696 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0f09b8-d0b4-49ca-b9de-0a381e307409 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:10.094944 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-556136d8-dc0f-48a9-bb08-3fc42e3e56ad None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:21:10.095473 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0f09b8-d0b4-49ca-b9de-0a381e307409 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:10.096184 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-556136d8-dc0f-48a9-bb08-3fc42e3e56ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:21:10.106693 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 446/890] 10.222.0.27 () {56 vars in 1251 bytes} [Wed Aug 24 11:21:09 2022] GET /identity/v3/endpoints?service_id=e36699d97e3d4696a321ea52805c5daf&interface=public®ion_id=RegionOne => generated 194 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:21:10.113798 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0f09b8-d0b4-49ca-b9de-0a381e307409 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:10.155767 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:10.190835 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 445/891] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:21:10 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 11:21:10.232232 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0f09b8-d0b4-49ca-b9de-0a381e307409 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:10.267320 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81929aa7-6cf8-43dc-9a05-aa3a512ebeb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:10.268289 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81929aa7-6cf8-43dc-9a05-aa3a512ebeb7 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:10.268820 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81929aa7-6cf8-43dc-9a05-aa3a512ebeb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:10.269290 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81929aa7-6cf8-43dc-9a05-aa3a512ebeb7 None admin] PATH_INFO: `/v3/services` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:10.270101 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81929aa7-6cf8-43dc-9a05-aa3a512ebeb7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:10.271708 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81929aa7-6cf8-43dc-9a05-aa3a512ebeb7 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:10.278428 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 447/892] 10.222.0.27 () {56 vars in 1087 bytes} [Wed Aug 24 11:21:10 2022] GET /identity/v3/services => generated 1268 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:21:10.324618 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556136d8-dc0f-48a9-bb08-3fc42e3e56ad None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:10.432905 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556136d8-dc0f-48a9-bb08-3fc42e3e56ad None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:10.442369 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:10.471639 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af1f5d7-939a-4b84-a4a2-c925707e3870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:10.471946 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81929aa7-6cf8-43dc-9a05-aa3a512ebeb7 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:10.472857 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af1f5d7-939a-4b84-a4a2-c925707e3870 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:10.473330 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af1f5d7-939a-4b84-a4a2-c925707e3870 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:10.473787 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af1f5d7-939a-4b84-a4a2-c925707e3870 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:10.474630 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af1f5d7-939a-4b84-a4a2-c925707e3870 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:10.476278 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af1f5d7-939a-4b84-a4a2-c925707e3870 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:10.489117 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-1af1f5d7-939a-4b84-a4a2-c925707e3870 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 11:21:10.489117 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:21:10.489117 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 11:21:10.489117 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 11:21:10.489117 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 11:21:10.489117 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 11:21:10.489117 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 11:21:10.489117 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 11:21:10.489117 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 11:21:10.489117 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Aug 24 11:21:10.489117 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 11:21:10.489117 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Aug 24 11:21:10.489117 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:21:10.489117 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:21:10.489117 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:21:10.489117 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:21:10.490138 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:21:10.490138 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:21:10.490138 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:21:10.490138 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:21:10.490138 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:21:10.490138 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:21:10.490138 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:21:10.490138 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 11:21:10.490138 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 11:21:10.490138 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 11:21:10.490138 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 11:21:10.490138 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:21:10.490138 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:21:10.490138 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:21:10.490138 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:21:10.490138 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:21:10.490138 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:21:10.491083 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:21:10.491083 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Aug 24 11:21:10.491083 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:21:10.491083 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:21:10.491083 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:21:10.491083 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:21:10.491083 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:21:10.491083 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:21:10.491083 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:21:10.491083 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:21:10.491083 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 11:21:10.491083 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 11:21:10.491083 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 11:21:10.491083 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Aug 24 11:21:10.494199 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 446/893] 10.222.0.27 () {56 vars in 1132 bytes} [Wed Aug 24 11:21:10 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:21:10.497224 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af1f5d7-939a-4b84-a4a2-c925707e3870 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:10.583984 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:10.587073 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81929aa7-6cf8-43dc-9a05-aa3a512ebeb7 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:10.606419 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af1f5d7-939a-4b84-a4a2-c925707e3870 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:10.621309 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4a1a97-80bb-4994-949f-50afe662a115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:10.621950 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4a1a97-80bb-4994-949f-50afe662a115 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:10.622224 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4a1a97-80bb-4994-949f-50afe662a115 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:10.622540 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4a1a97-80bb-4994-949f-50afe662a115 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:10.632934 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4a1a97-80bb-4994-949f-50afe662a115 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:21:10.637699 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-1e4a1a97-80bb-4994-949f-50afe662a115 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 11:21:10.637699 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:21:10.637699 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:21:10.637699 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:21:10.637699 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:21:10.637699 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:21:10.637699 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:21:10.637699 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:21:10.637699 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:21:10.637699 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:21:10.637699 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:21:10.637699 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:21:10.637699 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:21:10.637699 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:21:10.637699 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:21:10.637699 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:21:10.638714 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:21:10.638714 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:21:10.638714 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:21:10.638714 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:21:10.638714 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:21:10.638714 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:21:10.638714 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:21:10.638714 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:21:10.638714 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:21:10.638714 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:21:10.638714 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:21:10.638714 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Aug 24 11:21:10.638714 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:21:10.638714 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:21:10.638714 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:21:10.638714 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:21:10.639708 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:21:10.639708 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:21:10.639708 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:21:10.639708 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:21:10.639708 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:21:10.639708 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:21:10.639708 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:21:10.639708 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:21:10.639708 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:21:10.639708 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:21:10.639708 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 11:21:10.639708 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:21:10.639708 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 448/894] 10.222.0.27 () {56 vars in 1120 bytes} [Wed Aug 24 11:21:10 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 11:21:10.640514 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdd49be-79df-4190-be3d-dd64b72687ed None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:10.640696 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdd49be-79df-4190-be3d-dd64b72687ed None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:10.640971 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdd49be-79df-4190-be3d-dd64b72687ed None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:10.642441 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 449/895] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:21:10 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:21:10.647203 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdd49be-79df-4190-be3d-dd64b72687ed None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:10.654010 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1f54c3-18d7-43ab-947e-aae2bdf600bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:10.654858 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1f54c3-18d7-43ab-947e-aae2bdf600bd None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:10.655276 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1f54c3-18d7-43ab-947e-aae2bdf600bd None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:10.655705 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1f54c3-18d7-43ab-947e-aae2bdf600bd None admin] PATH_INFO: `/v3/services` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:10.656955 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1f54c3-18d7-43ab-947e-aae2bdf600bd None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:21:10.657404 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1f54c3-18d7-43ab-947e-aae2bdf600bd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:10.659467 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1f54c3-18d7-43ab-947e-aae2bdf600bd None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:10.665394 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 447/896] 10.222.0.27 () {56 vars in 1126 bytes} [Wed Aug 24 11:21:10 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:21:10.666843 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6597452c-56af-470f-9bbd-a7992298183b None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:10.667267 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6597452c-56af-470f-9bbd-a7992298183b None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:10.667681 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6597452c-56af-470f-9bbd-a7992298183b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:10.686204 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-6597452c-56af-470f-9bbd-a7992298183b None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:21:10.687429 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-6597452c-56af-470f-9bbd-a7992298183b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:21:10.716445 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:10.766555 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 448/897] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:21:10 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 11:21:10.766555 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6597452c-56af-470f-9bbd-a7992298183b None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:10.766819 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdd49be-79df-4190-be3d-dd64b72687ed None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:10.815000 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3a58d0-d0bf-45d1-9b36-2966be157586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:10.815867 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3a58d0-d0bf-45d1-9b36-2966be157586 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:10.816231 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3a58d0-d0bf-45d1-9b36-2966be157586 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:10.816572 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3a58d0-d0bf-45d1-9b36-2966be157586 None admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:10.817874 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3a58d0-d0bf-45d1-9b36-2966be157586 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:21:10.818270 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3a58d0-d0bf-45d1-9b36-2966be157586 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:10.820277 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3a58d0-d0bf-45d1-9b36-2966be157586 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:10.836495 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 450/898] 10.222.0.27 () {56 vars in 1115 bytes} [Wed Aug 24 11:21:10 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:21:10.838008 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3a58d0-d0bf-45d1-9b36-2966be157586 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:10.872502 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:10.887761 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6597452c-56af-470f-9bbd-a7992298183b None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:10.924160 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca0f380-c076-4084-901c-223191d296eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:10.924767 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca0f380-c076-4084-901c-223191d296eb None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:10.925076 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca0f380-c076-4084-901c-223191d296eb None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:10.925343 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca0f380-c076-4084-901c-223191d296eb None admin] PATH_INFO: `/v3/services` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:10.926043 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca0f380-c076-4084-901c-223191d296eb None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:21:10.926346 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca0f380-c076-4084-901c-223191d296eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:10.927770 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca0f380-c076-4084-901c-223191d296eb None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:10.937817 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 449/899] 10.222.0.27 () {56 vars in 1126 bytes} [Wed Aug 24 11:21:10 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:21:10.938769 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca0f380-c076-4084-901c-223191d296eb None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:10.967911 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:10.973969 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3a58d0-d0bf-45d1-9b36-2966be157586 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:11.017669 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a659c7af-549f-4f1f-9857-0e7164246537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:11.018833 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a659c7af-549f-4f1f-9857-0e7164246537 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:11.019678 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a659c7af-549f-4f1f-9857-0e7164246537 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:11.020143 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a659c7af-549f-4f1f-9857-0e7164246537 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:11.033820 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a659c7af-549f-4f1f-9857-0e7164246537 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:11.036166 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a659c7af-549f-4f1f-9857-0e7164246537 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:11.042685 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca0f380-c076-4084-901c-223191d296eb None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:11.053462 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-a659c7af-549f-4f1f-9857-0e7164246537 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:21:11.053462 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:21:11.053462 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:21:11.053462 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:21:11.053462 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:21:11.053462 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:21:11.053462 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:21:11.053462 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:21:11.053462 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:21:11.053462 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:21:11.053462 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:21:11.053462 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:21:11.053462 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 11:21:11.053462 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 11:21:11.053462 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 11:21:11.053462 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 11:21:11.054528 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:21:11.054528 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:21:11.054528 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:21:11.054528 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:21:11.054528 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:21:11.054528 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:21:11.054528 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:21:11.054528 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Aug 24 11:21:11.054528 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:21:11.054528 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:21:11.054528 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:21:11.054528 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:21:11.054528 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:21:11.054528 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:21:11.054528 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:21:11.054528 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:21:11.054528 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 11:21:11.060195 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 11:21:11.060195 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:21:11.060195 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:21:11.060195 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 451/900] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 11:21:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:21:11.060195 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a659c7af-549f-4f1f-9857-0e7164246537 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:11.085207 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287d32c7-d0fa-4bea-8bdc-10268786db6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:11.085845 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287d32c7-d0fa-4bea-8bdc-10268786db6c None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:11.086150 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287d32c7-d0fa-4bea-8bdc-10268786db6c None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:11.086346 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287d32c7-d0fa-4bea-8bdc-10268786db6c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:11.087132 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287d32c7-d0fa-4bea-8bdc-10268786db6c None admin] RBAC: Adding query filter params (interface=public, service_id=33141c020610404aa46528765a6fa043, region_id=RegionOne) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:21:11.087378 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287d32c7-d0fa-4bea-8bdc-10268786db6c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:11.088747 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287d32c7-d0fa-4bea-8bdc-10268786db6c None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:11.094343 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 450/901] 10.222.0.27 () {56 vars in 1251 bytes} [Wed Aug 24 11:21:10 2022] GET /identity/v3/endpoints?service_id=33141c020610404aa46528765a6fa043&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:21:11.094791 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287d32c7-d0fa-4bea-8bdc-10268786db6c None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:11.146003 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:11.171782 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a659c7af-549f-4f1f-9857-0e7164246537 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:11.195612 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:11.204761 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287d32c7-d0fa-4bea-8bdc-10268786db6c None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:11.207724 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62646db-8e9d-4d13-b354-70892df627d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:11.208107 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62646db-8e9d-4d13-b354-70892df627d6 None admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:11.208387 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62646db-8e9d-4d13-b354-70892df627d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:11.208655 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62646db-8e9d-4d13-b354-70892df627d6 None admin] PATH_INFO: `/v3/services` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:11.209300 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62646db-8e9d-4d13-b354-70892df627d6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:11.210708 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62646db-8e9d-4d13-b354-70892df627d6 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:11.230414 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 452/902] 10.222.0.27 () {60 vars in 1141 bytes} [Wed Aug 24 11:21:11 2022] POST /identity/v3/services => generated 241 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:21:11.230414 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62646db-8e9d-4d13-b354-70892df627d6 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:11.260101 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3895630-1a9b-4820-a399-09fa9b165560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:11.261288 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3895630-1a9b-4820-a399-09fa9b165560 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:11.261730 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3895630-1a9b-4820-a399-09fa9b165560 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:11.262638 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3895630-1a9b-4820-a399-09fa9b165560 None admin] PATH_INFO: `/v3/domains` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:11.263736 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3895630-1a9b-4820-a399-09fa9b165560 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:21:11.264192 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3895630-1a9b-4820-a399-09fa9b165560 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:11.266888 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3895630-1a9b-4820-a399-09fa9b165560 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:11.287632 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 451/903] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 24 11:21:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:21:11.294494 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3895630-1a9b-4820-a399-09fa9b165560 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:11.360147 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62646db-8e9d-4d13-b354-70892df627d6 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:11.403654 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decd5967-47bd-4b61-b2e6-061820e43e96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:11.404284 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decd5967-47bd-4b61-b2e6-061820e43e96 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:11.404558 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decd5967-47bd-4b61-b2e6-061820e43e96 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:11.404823 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decd5967-47bd-4b61-b2e6-061820e43e96 None admin] PATH_INFO: `/v3/services` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:11.405446 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decd5967-47bd-4b61-b2e6-061820e43e96 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:11.406966 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decd5967-47bd-4b61-b2e6-061820e43e96 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:11.408598 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:11.422434 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 453/904] 10.222.0.27 () {56 vars in 1087 bytes} [Wed Aug 24 11:21:11 2022] GET /identity/v3/services => generated 1497 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:21:11.443045 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3895630-1a9b-4820-a399-09fa9b165560 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:11.482686 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d696b7-e66c-424c-bf8b-bd0eb81ce162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:11.483350 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d696b7-e66c-424c-bf8b-bd0eb81ce162 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:11.483616 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d696b7-e66c-424c-bf8b-bd0eb81ce162 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:11.483882 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d696b7-e66c-424c-bf8b-bd0eb81ce162 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:11.492688 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d696b7-e66c-424c-bf8b-bd0eb81ce162 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:11.494177 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d696b7-e66c-424c-bf8b-bd0eb81ce162 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:11.507612 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-67d696b7-e66c-424c-bf8b-bd0eb81ce162 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 11:21:11.507612 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:21:11.507612 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:21:11.507612 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:21:11.507612 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:21:11.507612 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:21:11.507612 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:21:11.507612 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:21:11.507612 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:21:11.507612 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:21:11.507612 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:21:11.507612 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:21:11.507612 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 11:21:11.507612 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 11:21:11.507612 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 11:21:11.507612 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 11:21:11.508646 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:21:11.508646 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:21:11.508646 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 11:21:11.508646 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 11:21:11.508646 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 11:21:11.508646 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 11:21:11.508646 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:21:11.508646 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:21:11.508646 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:21:11.508646 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:21:11.508646 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:21:11.508646 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Aug 24 11:21:11.508646 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:21:11.508646 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:21:11.508646 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:21:11.508646 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:21:11.508646 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:21:11.508646 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:21:11.509992 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:21:11.509992 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:21:11.509992 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 11:21:11.509992 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 11:21:11.509992 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 11:21:11.509992 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 11:21:11.509992 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 11:21:11.509992 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 11:21:11.509992 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 11:21:11.509992 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Aug 24 11:21:11.509992 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 452/905] 10.222.0.27 () {56 vars in 1117 bytes} [Wed Aug 24 11:21:11 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:21:11.515330 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decd5967-47bd-4b61-b2e6-061820e43e96 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:11.622830 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decd5967-47bd-4b61-b2e6-061820e43e96 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:11.657672 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcecbb1-a28e-4f69-bb04-c9ac08c117a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:11.658663 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcecbb1-a28e-4f69-bb04-c9ac08c117a3 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:11.659130 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcecbb1-a28e-4f69-bb04-c9ac08c117a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:11.659778 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcecbb1-a28e-4f69-bb04-c9ac08c117a3 None admin] PATH_INFO: `/v3/users` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:11.660711 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcecbb1-a28e-4f69-bb04-c9ac08c117a3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:21:11.661220 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcecbb1-a28e-4f69-bb04-c9ac08c117a3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:11.662973 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcecbb1-a28e-4f69-bb04-c9ac08c117a3 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:11.682571 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 454/906] 10.222.0.27 () {56 vars in 1149 bytes} [Wed Aug 24 11:21:11 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:21:11.687822 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d696b7-e66c-424c-bf8b-bd0eb81ce162 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:11.701696 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:11.802050 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d696b7-e66c-424c-bf8b-bd0eb81ce162 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:11.837467 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bc67ef-6125-42c8-b096-93acffe07947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:11.838071 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bc67ef-6125-42c8-b096-93acffe07947 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:11.838342 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bc67ef-6125-42c8-b096-93acffe07947 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:11.838629 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bc67ef-6125-42c8-b096-93acffe07947 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:11.909973 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bc67ef-6125-42c8-b096-93acffe07947 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:11.911402 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bc67ef-6125-42c8-b096-93acffe07947 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:11.921768 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:12.017861 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 453/907] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 24 11:21:11 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 11:21:12.023848 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcecbb1-a28e-4f69-bb04-c9ac08c117a3 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:12.080900 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:12.133142 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcecbb1-a28e-4f69-bb04-c9ac08c117a3 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:12.170944 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776a16f6-122b-4d79-bcc5-7e60f725f923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:12.171618 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776a16f6-122b-4d79-bcc5-7e60f725f923 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:12.171857 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776a16f6-122b-4d79-bcc5-7e60f725f923 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:12.172036 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776a16f6-122b-4d79-bcc5-7e60f725f923 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:12.183188 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776a16f6-122b-4d79-bcc5-7e60f725f923 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:12.184697 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776a16f6-122b-4d79-bcc5-7e60f725f923 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:12.202296 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-776a16f6-122b-4d79-bcc5-7e60f725f923 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:21:12.202296 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:21:12.202296 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:21:12.202296 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:21:12.202296 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:21:12.202296 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:21:12.202296 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:21:12.202296 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:21:12.202296 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:21:12.202296 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:21:12.202296 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:21:12.202296 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:21:12.202296 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 11:21:12.202296 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 11:21:12.202296 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 11:21:12.202296 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 11:21:12.203269 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:21:12.203269 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:21:12.203269 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:21:12.203269 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:21:12.203269 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:21:12.203269 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:21:12.203269 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:21:12.203269 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Aug 24 11:21:12.203269 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:21:12.203269 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:21:12.203269 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:21:12.203269 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:21:12.203269 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:21:12.203269 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:21:12.203269 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:21:12.203269 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:21:12.203269 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 11:21:12.204690 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 11:21:12.204690 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:21:12.204690 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:21:12.204690 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 455/908] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 11:21:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:21:12.209249 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bc67ef-6125-42c8-b096-93acffe07947 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:12.307432 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b56048-7394-4bee-a64c-0575d8c812b7 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:12.308067 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b56048-7394-4bee-a64c-0575d8c812b7 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:12.308527 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b56048-7394-4bee-a64c-0575d8c812b7 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:12.310054 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 456/909] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:21:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 11:21:12.312448 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bc67ef-6125-42c8-b096-93acffe07947 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:12.315694 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d625842d-d642-4ec5-a602-d6e767e188a9 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:12.316214 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d625842d-d642-4ec5-a602-d6e767e188a9 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:12.316694 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d625842d-d642-4ec5-a602-d6e767e188a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:12.322893 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:12.336815 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-d625842d-d642-4ec5-a602-d6e767e188a9 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:21:12.338454 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-d625842d-d642-4ec5-a602-d6e767e188a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:21:12.349887 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890b766b-6e47-4b99-ac89-47252541bcf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:12.350937 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890b766b-6e47-4b99-ac89-47252541bcf9 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:12.351220 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890b766b-6e47-4b99-ac89-47252541bcf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:12.351529 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890b766b-6e47-4b99-ac89-47252541bcf9 None admin] PATH_INFO: `/v3/domains` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:12.352182 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890b766b-6e47-4b99-ac89-47252541bcf9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:21:12.352471 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890b766b-6e47-4b99-ac89-47252541bcf9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:12.353840 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890b766b-6e47-4b99-ac89-47252541bcf9 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:12.365910 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 454/910] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 24 11:21:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:21:12.371640 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890b766b-6e47-4b99-ac89-47252541bcf9 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:12.422485 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 457/911] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:21:12 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 11:21:12.484663 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890b766b-6e47-4b99-ac89-47252541bcf9 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:12.520124 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42647d98-b4c1-4171-9511-1803d6ad15dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:12.520996 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42647d98-b4c1-4171-9511-1803d6ad15dc None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:12.521478 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42647d98-b4c1-4171-9511-1803d6ad15dc None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:12.521879 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42647d98-b4c1-4171-9511-1803d6ad15dc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:12.529448 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42647d98-b4c1-4171-9511-1803d6ad15dc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:12.531069 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42647d98-b4c1-4171-9511-1803d6ad15dc None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:12.542340 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-42647d98-b4c1-4171-9511-1803d6ad15dc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 11:21:12.542340 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:21:12.542340 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:21:12.542340 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:21:12.542340 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:21:12.542340 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:21:12.542340 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:21:12.542340 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:21:12.542340 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:21:12.542340 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:21:12.542340 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:21:12.542340 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:21:12.542340 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 11:21:12.542340 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 11:21:12.542340 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 11:21:12.543416 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 11:21:12.543416 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:21:12.543416 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:21:12.543416 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:21:12.543416 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:21:12.543416 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:21:12.543416 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:21:12.543416 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:21:12.543416 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Aug 24 11:21:12.543416 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:21:12.543416 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:21:12.543416 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:21:12.543416 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:21:12.543416 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:21:12.543416 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:21:12.543416 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:21:12.543416 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:21:12.544524 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 11:21:12.544524 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 11:21:12.544524 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 11:21:12.544524 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 11:21:12.544524 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 11:21:12.544524 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 11:21:12.544524 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 11:21:12.544524 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Aug 24 11:21:12.546589 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 455/912] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Aug 24 11:21:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 11:21:12.552764 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d625842d-d642-4ec5-a602-d6e767e188a9 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:12.599451 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:12.668663 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d625842d-d642-4ec5-a602-d6e767e188a9 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:12.700541 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42647d98-b4c1-4171-9511-1803d6ad15dc None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:12.703632 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a77576-873d-4e47-8b18-df761c3b4d9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:12.704548 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a77576-873d-4e47-8b18-df761c3b4d9f None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:12.705730 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a77576-873d-4e47-8b18-df761c3b4d9f None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:12.706030 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a77576-873d-4e47-8b18-df761c3b4d9f None admin] PATH_INFO: `/v3/projects` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:12.706866 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a77576-873d-4e47-8b18-df761c3b4d9f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:21:12.707175 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a77576-873d-4e47-8b18-df761c3b4d9f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:12.708713 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a77576-873d-4e47-8b18-df761c3b4d9f None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:12.725428 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 458/913] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Aug 24 11:21:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:21:12.731054 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a77576-873d-4e47-8b18-df761c3b4d9f None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:12.732763 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:12.807091 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42647d98-b4c1-4171-9511-1803d6ad15dc None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:12.848212 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c2e022-da81-41ec-829a-bda78971aabd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:12.848844 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c2e022-da81-41ec-829a-bda78971aabd None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:12.849115 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c2e022-da81-41ec-829a-bda78971aabd None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:12.849377 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c2e022-da81-41ec-829a-bda78971aabd None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:12.849961 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c2e022-da81-41ec-829a-bda78971aabd None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:12.851552 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c2e022-da81-41ec-829a-bda78971aabd None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:12.855973 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:12.860607 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a77576-873d-4e47-8b18-df761c3b4d9f None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:12.860976 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-c3c2e022-da81-41ec-829a-bda78971aabd None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 11:21:12.860976 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:21:12.860976 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 11:21:12.860976 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 11:21:12.860976 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 11:21:12.860976 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 11:21:12.860976 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 11:21:12.860976 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 11:21:12.860976 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 11:21:12.860976 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Aug 24 11:21:12.860976 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 11:21:12.860976 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Aug 24 11:21:12.860976 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:21:12.860976 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:21:12.860976 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:21:12.860976 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:21:12.860976 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:21:12.861931 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:21:12.861931 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:21:12.861931 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:21:12.861931 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:21:12.861931 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:21:12.861931 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:21:12.861931 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 11:21:12.861931 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 11:21:12.861931 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 11:21:12.861931 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 11:21:12.861931 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:21:12.861931 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:21:12.861931 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:21:12.861931 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:21:12.861931 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:21:12.861931 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:21:12.863075 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:21:12.863075 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Aug 24 11:21:12.863075 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:21:12.863075 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:21:12.863075 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:21:12.863075 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:21:12.863075 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:21:12.863075 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:21:12.863075 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:21:12.863075 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:21:12.863075 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 11:21:12.863075 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 11:21:12.863075 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 11:21:12.863075 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Aug 24 11:21:12.866434 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 456/914] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Aug 24 11:21:12 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 11:21:12.869278 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c2e022-da81-41ec-829a-bda78971aabd None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:12.910973 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599572d4-f742-46f7-a85c-f57f5a746732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:12.911604 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599572d4-f742-46f7-a85c-f57f5a746732 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:12.911883 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599572d4-f742-46f7-a85c-f57f5a746732 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:12.912157 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599572d4-f742-46f7-a85c-f57f5a746732 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:12.912890 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599572d4-f742-46f7-a85c-f57f5a746732 None admin] RBAC: Adding query filter params (role.id=e59237603afa477fbb6954564862fa4a, scope.project.id=317f54a463cb48ab86648c6dcec5db0f, user.id=a5915030f01941fc89f92228ff57c7f0) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:21:12.913203 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599572d4-f742-46f7-a85c-f57f5a746732 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:12.915174 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599572d4-f742-46f7-a85c-f57f5a746732 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:12.922305 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 459/915] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Aug 24 11:21:12 2022] GET /identity/v3/role_assignments?user.id=a5915030f01941fc89f92228ff57c7f0&scope.project.id=317f54a463cb48ab86648c6dcec5db0f&role.id=e59237603afa477fbb6954564862fa4a => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:21:12.976221 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:12.987914 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c2e022-da81-41ec-829a-bda78971aabd None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:13.028257 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ee5a45-eb95-475e-86dc-db22b5e5b276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:13.028879 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ee5a45-eb95-475e-86dc-db22b5e5b276 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:13.029140 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ee5a45-eb95-475e-86dc-db22b5e5b276 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:13.029402 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ee5a45-eb95-475e-86dc-db22b5e5b276 None admin] PATH_INFO: `/v3/services` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:13.030106 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ee5a45-eb95-475e-86dc-db22b5e5b276 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:21:13.030428 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ee5a45-eb95-475e-86dc-db22b5e5b276 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:13.031895 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ee5a45-eb95-475e-86dc-db22b5e5b276 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:13.042637 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 457/916] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Aug 24 11:21:12 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:21:13.044143 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599572d4-f742-46f7-a85c-f57f5a746732 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:13.158576 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599572d4-f742-46f7-a85c-f57f5a746732 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:13.193616 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd006c2f-3631-443f-b8c5-cea71ed236ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:13.195665 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd006c2f-3631-443f-b8c5-cea71ed236ce None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:13.196143 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd006c2f-3631-443f-b8c5-cea71ed236ce None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:13.196620 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd006c2f-3631-443f-b8c5-cea71ed236ce None admin] PATH_INFO: `/v3/services` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:13.197472 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd006c2f-3631-443f-b8c5-cea71ed236ce None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:21:13.197960 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd006c2f-3631-443f-b8c5-cea71ed236ce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:13.199561 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd006c2f-3631-443f-b8c5-cea71ed236ce None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:13.209674 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 460/917] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Aug 24 11:21:13 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:21:13.211326 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ee5a45-eb95-475e-86dc-db22b5e5b276 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:13.218503 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27817633-4f9a-4935-b22f-d3ba6324f798 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:13.218790 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27817633-4f9a-4935-b22f-d3ba6324f798 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:13.219062 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27817633-4f9a-4935-b22f-d3ba6324f798 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:13.220624 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 461/918] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:21:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 11:21:13.226386 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be8e1d7-377b-41f4-a617-eb341ecfd75b None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:13.226628 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be8e1d7-377b-41f4-a617-eb341ecfd75b None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:13.226890 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be8e1d7-377b-41f4-a617-eb341ecfd75b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:13.249127 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-3be8e1d7-377b-41f4-a617-eb341ecfd75b None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:21:13.250324 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-3be8e1d7-377b-41f4-a617-eb341ecfd75b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:21:13.276091 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:13.327561 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ee5a45-eb95-475e-86dc-db22b5e5b276 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:13.335969 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 462/919] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:21:13 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 11:21:13.364953 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5a31d1-2fa1-422a-b07f-15a1be49e001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:13.365828 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5a31d1-2fa1-422a-b07f-15a1be49e001 None admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:13.366285 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5a31d1-2fa1-422a-b07f-15a1be49e001 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:13.366585 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5a31d1-2fa1-422a-b07f-15a1be49e001 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:13.367296 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5a31d1-2fa1-422a-b07f-15a1be49e001 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:13.368742 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5a31d1-2fa1-422a-b07f-15a1be49e001 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:13.394535 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 458/920] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 11:21:13 2022] POST /identity/v3/endpoints => generated 346 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 11:21:13.515367 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7745d3d5-ae6b-4ca0-be40-03c30279a3c9 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:13.515563 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7745d3d5-ae6b-4ca0-be40-03c30279a3c9 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:13.515839 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7745d3d5-ae6b-4ca0-be40-03c30279a3c9 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:13.517567 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 463/921] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:21:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:21:13.523586 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a85e2bc-ed31-41ac-aef1-1d10ed7419db None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:13.523897 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a85e2bc-ed31-41ac-aef1-1d10ed7419db None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:13.524140 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a85e2bc-ed31-41ac-aef1-1d10ed7419db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:13.544387 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-4a85e2bc-ed31-41ac-aef1-1d10ed7419db None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:21:13.545586 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-4a85e2bc-ed31-41ac-aef1-1d10ed7419db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:21:13.554629 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:13.602825 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7745d3d5-ae6b-4ca0-be40-03c30279a3c9 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:13.630030 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 459/922] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:21:13 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 11:21:13.713965 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7745d3d5-ae6b-4ca0-be40-03c30279a3c9 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:13.748288 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ef25ea-8d80-46f4-801b-30225b4133c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:13.749149 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ef25ea-8d80-46f4-801b-30225b4133c8 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:13.749569 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ef25ea-8d80-46f4-801b-30225b4133c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:13.749996 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ef25ea-8d80-46f4-801b-30225b4133c8 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:13.750754 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ef25ea-8d80-46f4-801b-30225b4133c8 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:13.752309 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ef25ea-8d80-46f4-801b-30225b4133c8 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:13.761253 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-09ef25ea-8d80-46f4-801b-30225b4133c8 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 11:21:13.761253 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:21:13.761253 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 11:21:13.761253 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 11:21:13.761253 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 11:21:13.761253 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 11:21:13.761253 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 11:21:13.761253 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 11:21:13.761253 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 11:21:13.761253 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:21:13.761253 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 11:21:13.761253 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:21:13.761253 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:21:13.761253 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:21:13.761253 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:21:13.761253 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:21:13.761253 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:21:13.762474 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:21:13.762474 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:21:13.762474 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:21:13.762474 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:21:13.762474 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:21:13.762474 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:21:13.762474 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 11:21:13.762474 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 11:21:13.762474 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 11:21:13.762474 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 11:21:13.762474 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:21:13.762474 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:21:13.762474 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:21:13.762474 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:21:13.762474 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:21:13.762474 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:21:13.763517 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:21:13.763517 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Aug 24 11:21:13.763517 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:21:13.763517 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:21:13.763517 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:21:13.763517 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:21:13.763517 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:21:13.763517 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:21:13.763517 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:21:13.763517 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:21:13.763517 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 11:21:13.763517 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 11:21:13.763517 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 11:21:13.763517 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:21:13.766021 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 464/923] 10.222.0.27 () {56 vars in 1126 bytes} [Wed Aug 24 11:21:13 2022] GET /identity/v3/services/object-store => generated 93 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 11:21:13.772253 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a85e2bc-ed31-41ac-aef1-1d10ed7419db None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:13.875573 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a85e2bc-ed31-41ac-aef1-1d10ed7419db None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:13.891701 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ef25ea-8d80-46f4-801b-30225b4133c8 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:13.914027 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3446716d-3d3e-4c9d-9cb6-fe0a69f3a31d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:13.914665 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3446716d-3d3e-4c9d-9cb6-fe0a69f3a31d None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:13.914946 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3446716d-3d3e-4c9d-9cb6-fe0a69f3a31d None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:13.915220 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3446716d-3d3e-4c9d-9cb6-fe0a69f3a31d None admin] PATH_INFO: `/v3/services` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:13.915867 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3446716d-3d3e-4c9d-9cb6-fe0a69f3a31d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:21:13.916169 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3446716d-3d3e-4c9d-9cb6-fe0a69f3a31d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:13.917558 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3446716d-3d3e-4c9d-9cb6-fe0a69f3a31d None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:13.923041 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:13.923723 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 460/924] 10.222.0.27 () {56 vars in 1122 bytes} [Wed Aug 24 11:21:13 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:21:13.933405 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3446716d-3d3e-4c9d-9cb6-fe0a69f3a31d None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:13.951293 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:14.015127 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ef25ea-8d80-46f4-801b-30225b4133c8 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:14.055308 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffce97a-b2d9-4144-bbbf-db639a61b7d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:14.055884 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffce97a-b2d9-4144-bbbf-db639a61b7d4 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:14.056146 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffce97a-b2d9-4144-bbbf-db639a61b7d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:14.056420 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffce97a-b2d9-4144-bbbf-db639a61b7d4 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:14.057004 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffce97a-b2d9-4144-bbbf-db639a61b7d4 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:14.058415 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffce97a-b2d9-4144-bbbf-db639a61b7d4 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:14.062503 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3446716d-3d3e-4c9d-9cb6-fe0a69f3a31d None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:14.067336 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-7ffce97a-b2d9-4144-bbbf-db639a61b7d4 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 11:21:14.067336 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:21:14.067336 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 11:21:14.067336 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 11:21:14.067336 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 11:21:14.067336 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 11:21:14.067336 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 11:21:14.067336 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 11:21:14.067336 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 11:21:14.067336 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:21:14.067336 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 11:21:14.067336 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:21:14.067336 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:21:14.067336 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:21:14.067336 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:21:14.067336 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:21:14.068523 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:21:14.068523 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:21:14.068523 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:21:14.068523 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:21:14.068523 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:21:14.068523 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:21:14.068523 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:21:14.068523 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 11:21:14.068523 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 11:21:14.068523 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 11:21:14.068523 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 11:21:14.068523 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:21:14.068523 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:21:14.068523 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:21:14.068523 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:21:14.068523 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:21:14.068523 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:21:14.069430 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:21:14.069430 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Aug 24 11:21:14.069430 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:21:14.069430 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:21:14.069430 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:21:14.069430 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:21:14.069430 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:21:14.069430 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:21:14.069430 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:21:14.069430 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:21:14.069430 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 11:21:14.069430 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 11:21:14.069430 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 11:21:14.069430 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:21:14.069430 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 465/925] 10.222.0.27 () {56 vars in 1132 bytes} [Wed Aug 24 11:21:13 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:21:14.075689 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffce97a-b2d9-4144-bbbf-db639a61b7d4 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:14.109086 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76997312-b9ea-41b6-9c0e-3a6d748cc3ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:14.109758 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76997312-b9ea-41b6-9c0e-3a6d748cc3ad None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:14.110038 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76997312-b9ea-41b6-9c0e-3a6d748cc3ad None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:14.110331 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76997312-b9ea-41b6-9c0e-3a6d748cc3ad None admin] PATH_INFO: `/v3/services` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:14.111264 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76997312-b9ea-41b6-9c0e-3a6d748cc3ad None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:21:14.111594 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76997312-b9ea-41b6-9c0e-3a6d748cc3ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:14.113840 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76997312-b9ea-41b6-9c0e-3a6d748cc3ad None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:14.126091 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 461/926] 10.222.0.27 () {56 vars in 1122 bytes} [Wed Aug 24 11:21:13 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:21:14.127688 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76997312-b9ea-41b6-9c0e-3a6d748cc3ad None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:14.182391 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:14.199574 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:14.199984 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffce97a-b2d9-4144-bbbf-db639a61b7d4 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:14.237332 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e913967d-0d3f-4534-9ad5-8372c3b5bfa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:14.237625 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76997312-b9ea-41b6-9c0e-3a6d748cc3ad None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:14.238064 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e913967d-0d3f-4534-9ad5-8372c3b5bfa0 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:14.238292 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e913967d-0d3f-4534-9ad5-8372c3b5bfa0 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:14.238595 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e913967d-0d3f-4534-9ad5-8372c3b5bfa0 None admin] PATH_INFO: `/v3/services` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:14.239323 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e913967d-0d3f-4534-9ad5-8372c3b5bfa0 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:21:14.239628 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e913967d-0d3f-4534-9ad5-8372c3b5bfa0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:14.241124 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e913967d-0d3f-4534-9ad5-8372c3b5bfa0 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:14.250986 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 466/927] 10.222.0.27 () {56 vars in 1126 bytes} [Wed Aug 24 11:21:14 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:21:14.252010 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e913967d-0d3f-4534-9ad5-8372c3b5bfa0 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:14.274337 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5bb2be-1d25-407f-af4e-a6f62028411f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:14.275075 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5bb2be-1d25-407f-af4e-a6f62028411f None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:14.275444 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5bb2be-1d25-407f-af4e-a6f62028411f None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:14.275835 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5bb2be-1d25-407f-af4e-a6f62028411f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:14.276979 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5bb2be-1d25-407f-af4e-a6f62028411f None admin] RBAC: Adding query filter params (interface=public, service_id=92c37dae29634c579b4a68d2bc68279a, region_id=RegionOne) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:21:14.277349 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5bb2be-1d25-407f-af4e-a6f62028411f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:14.279039 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5bb2be-1d25-407f-af4e-a6f62028411f None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:14.285064 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 462/928] 10.222.0.27 () {56 vars in 1251 bytes} [Wed Aug 24 11:21:14 2022] GET /identity/v3/endpoints?service_id=92c37dae29634c579b4a68d2bc68279a&interface=public®ion_id=RegionOne => generated 194 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:21:14.290810 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5bb2be-1d25-407f-af4e-a6f62028411f None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:14.357944 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e913967d-0d3f-4534-9ad5-8372c3b5bfa0 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:14.398663 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d457ab-5fe9-44d1-a7fe-efd82a529838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:14.399378 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d457ab-5fe9-44d1-a7fe-efd82a529838 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:14.399659 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d457ab-5fe9-44d1-a7fe-efd82a529838 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:14.399932 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d457ab-5fe9-44d1-a7fe-efd82a529838 None admin] PATH_INFO: `/v3/services` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:14.400567 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d457ab-5fe9-44d1-a7fe-efd82a529838 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:21:14.400868 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d457ab-5fe9-44d1-a7fe-efd82a529838 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:14.402849 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d457ab-5fe9-44d1-a7fe-efd82a529838 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:14.405212 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5bb2be-1d25-407f-af4e-a6f62028411f None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:14.413070 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 467/929] 10.222.0.27 () {56 vars in 1126 bytes} [Wed Aug 24 11:21:14 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:21:14.414091 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d457ab-5fe9-44d1-a7fe-efd82a529838 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:14.430927 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:14.437327 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:14.444439 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2f8f03-ab2a-4e0c-8340-4b1ace077456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:14.445395 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2f8f03-ab2a-4e0c-8340-4b1ace077456 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:14.445848 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2f8f03-ab2a-4e0c-8340-4b1ace077456 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:14.446291 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2f8f03-ab2a-4e0c-8340-4b1ace077456 None admin] PATH_INFO: `/v3/services` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:14.447218 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2f8f03-ab2a-4e0c-8340-4b1ace077456 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:14.448895 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2f8f03-ab2a-4e0c-8340-4b1ace077456 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:14.455973 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 463/930] 10.222.0.27 () {56 vars in 1087 bytes} [Wed Aug 24 11:21:14 2022] GET /identity/v3/services => generated 1497 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:21:14.529346 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d457ab-5fe9-44d1-a7fe-efd82a529838 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:14.566400 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257ee2d9-539e-4a9d-aad2-d732b12411a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:14.567041 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257ee2d9-539e-4a9d-aad2-d732b12411a8 None admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:14.567318 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257ee2d9-539e-4a9d-aad2-d732b12411a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:14.567590 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257ee2d9-539e-4a9d-aad2-d732b12411a8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:14.568272 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257ee2d9-539e-4a9d-aad2-d732b12411a8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:14.569674 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257ee2d9-539e-4a9d-aad2-d732b12411a8 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:14.593682 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 468/931] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 11:21:14 2022] POST /identity/v3/endpoints => generated 347 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:21:14.845582 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46c07d9-9d78-4386-8d5a-f56f373e4bed None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:14.845998 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46c07d9-9d78-4386-8d5a-f56f373e4bed None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:14.846113 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46c07d9-9d78-4386-8d5a-f56f373e4bed None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:14.847885 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 464/932] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:21:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:21:14.853327 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ce507b-8644-44c1-83d1-2259008efd07 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:14.853613 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ce507b-8644-44c1-83d1-2259008efd07 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:14.853884 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ce507b-8644-44c1-83d1-2259008efd07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:14.872414 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-29ce507b-8644-44c1-83d1-2259008efd07 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:21:14.873597 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-29ce507b-8644-44c1-83d1-2259008efd07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:21:14.939824 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:14.952430 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 469/933] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:21:14 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 11:21:15.221519 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46c07d9-9d78-4386-8d5a-f56f373e4bed None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:15.329018 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46c07d9-9d78-4386-8d5a-f56f373e4bed None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:15.364931 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e723091-db74-49c8-b550-d0ef75ea5d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:15.365892 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e723091-db74-49c8-b550-d0ef75ea5d04 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:15.366387 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e723091-db74-49c8-b550-d0ef75ea5d04 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:15.366890 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e723091-db74-49c8-b550-d0ef75ea5d04 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:15.377477 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e723091-db74-49c8-b550-d0ef75ea5d04 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:21:15.382431 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-8e723091-db74-49c8-b550-d0ef75ea5d04 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 11:21:15.382431 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:21:15.382431 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:21:15.382431 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:21:15.382431 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:21:15.382431 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:21:15.382431 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:21:15.382431 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:21:15.382431 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:21:15.382431 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:21:15.382431 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:21:15.382431 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:21:15.382431 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:21:15.382431 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:21:15.382431 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:21:15.382431 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:21:15.383368 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:21:15.383368 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:21:15.383368 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:21:15.383368 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:21:15.383368 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:21:15.383368 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:21:15.383368 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:21:15.383368 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:21:15.383368 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:21:15.383368 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:21:15.383368 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:21:15.383368 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Aug 24 11:21:15.383368 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:21:15.383368 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:21:15.383368 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:21:15.383368 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:21:15.384223 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:21:15.384223 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:21:15.384223 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:21:15.384223 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:21:15.384223 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:21:15.384223 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:21:15.384223 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:21:15.384223 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:21:15.384223 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:21:15.384223 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:21:15.384223 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 11:21:15.384223 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Aug 24 11:21:15.386813 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 465/934] 10.222.0.27 () {56 vars in 1120 bytes} [Wed Aug 24 11:21:15 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:21:15.395775 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ce507b-8644-44c1-83d1-2259008efd07 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:15.502569 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ce507b-8644-44c1-83d1-2259008efd07 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:15.544123 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93acc626-c527-4a67-a27f-c4f531157b20 None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:15.544443 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d87f553-ae18-422f-9485-065451237580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:15.544926 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93acc626-c527-4a67-a27f-c4f531157b20 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:15.545055 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d87f553-ae18-422f-9485-065451237580 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:15.545236 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d87f553-ae18-422f-9485-065451237580 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:15.545508 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d87f553-ae18-422f-9485-065451237580 None admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:15.545872 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93acc626-c527-4a67-a27f-c4f531157b20 None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:15.546185 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d87f553-ae18-422f-9485-065451237580 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:21:15.546513 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d87f553-ae18-422f-9485-065451237580 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:15.547913 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d87f553-ae18-422f-9485-065451237580 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:15.548417 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 466/935] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:21:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 11:21:15.554554 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6258049d-8613-464a-a96a-602ba991f9eb None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:15.555114 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6258049d-8613-464a-a96a-602ba991f9eb None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:15.555617 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6258049d-8613-464a-a96a-602ba991f9eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:15.558513 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 470/936] 10.222.0.27 () {56 vars in 1115 bytes} [Wed Aug 24 11:21:15 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:21:15.564632 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d87f553-ae18-422f-9485-065451237580 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:15.574997 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-6258049d-8613-464a-a96a-602ba991f9eb None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:21:15.576538 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-6258049d-8613-464a-a96a-602ba991f9eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:21:15.625057 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:15.632601 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:15.657072 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 467/937] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:21:15 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 11:21:15.682646 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d87f553-ae18-422f-9485-065451237580 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:15.718670 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afee4b31-d98e-4037-9526-01fe11aada96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:15.719745 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afee4b31-d98e-4037-9526-01fe11aada96 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:15.720258 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afee4b31-d98e-4037-9526-01fe11aada96 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:15.720745 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afee4b31-d98e-4037-9526-01fe11aada96 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:15.733960 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afee4b31-d98e-4037-9526-01fe11aada96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:15.735778 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afee4b31-d98e-4037-9526-01fe11aada96 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:15.750542 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-afee4b31-d98e-4037-9526-01fe11aada96 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:21:15.750542 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:21:15.750542 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:21:15.750542 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:21:15.750542 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:21:15.750542 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:21:15.750542 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:21:15.750542 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:21:15.750542 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:21:15.750542 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:21:15.750542 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:21:15.750542 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:21:15.750542 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 11:21:15.750542 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 11:21:15.750542 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 11:21:15.750542 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 11:21:15.751490 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:21:15.751490 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:21:15.751490 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:21:15.751490 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:21:15.751490 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:21:15.751490 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:21:15.751490 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:21:15.751490 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Aug 24 11:21:15.751490 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:21:15.751490 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:21:15.751490 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:21:15.751490 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:21:15.751490 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:21:15.751490 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:21:15.751490 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:21:15.751490 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:21:15.751490 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 11:21:15.752403 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 11:21:15.752403 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:21:15.752403 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:21:15.754560 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 471/938] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 11:21:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:21:15.763470 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6258049d-8613-464a-a96a-602ba991f9eb None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:15.868039 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6258049d-8613-464a-a96a-602ba991f9eb None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:15.918857 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71aa0db8-3685-437f-9ee4-158480d9b6fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:15.919393 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aa0db8-3685-437f-9ee4-158480d9b6fa None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:15.919663 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aa0db8-3685-437f-9ee4-158480d9b6fa None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:15.919928 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aa0db8-3685-437f-9ee4-158480d9b6fa None admin] PATH_INFO: `/v3/domains` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:15.920860 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71aa0db8-3685-437f-9ee4-158480d9b6fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:21:15.921043 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71aa0db8-3685-437f-9ee4-158480d9b6fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:15.921833 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afee4b31-d98e-4037-9526-01fe11aada96 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:15.922454 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71aa0db8-3685-437f-9ee4-158480d9b6fa None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:15.938197 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 468/939] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 24 11:21:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:21:15.944336 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71aa0db8-3685-437f-9ee4-158480d9b6fa None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:16.001093 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:16.051266 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afee4b31-d98e-4037-9526-01fe11aada96 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:16.063553 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:16.075127 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71aa0db8-3685-437f-9ee4-158480d9b6fa None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:16.101550 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b4f152-7ff1-49f5-a18b-2b9071728625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:16.106188 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b4f152-7ff1-49f5-a18b-2b9071728625 None admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:16.106728 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b4f152-7ff1-49f5-a18b-2b9071728625 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:16.107181 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b4f152-7ff1-49f5-a18b-2b9071728625 None admin] PATH_INFO: `/v3/projects` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:16.108768 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b4f152-7ff1-49f5-a18b-2b9071728625 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:16.114589 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b4f152-7ff1-49f5-a18b-2b9071728625 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:16.117941 dv-cinder-848899-3-smb devstack@keystone.service[81501]: WARNING keystone.server.flask.common [None req-c4b4f152-7ff1-49f5-a18b-2b9071728625 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 24 11:21:16.127200 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672b076b-0075-4520-bef9-859e5f63155d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:16.127934 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672b076b-0075-4520-bef9-859e5f63155d None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:16.128347 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672b076b-0075-4520-bef9-859e5f63155d None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:16.128684 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672b076b-0075-4520-bef9-859e5f63155d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:16.139303 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672b076b-0075-4520-bef9-859e5f63155d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:16.140885 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672b076b-0075-4520-bef9-859e5f63155d None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:16.141204 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.sql.core [None req-c4b4f152-7ff1-49f5-a18b-2b9071728625 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 24 11:21:16.141204 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 24 11:21:16.141204 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [parameters: {'id': 'f63bd1f561304d85ac3a1f4f88e6f236', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 24 11:21:16.141204 dv-cinder-848899-3-smb devstack@keystone.service[81501]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81501) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 24 11:21:16.150414 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-c4b4f152-7ff1-49f5-a18b-2b9071728625 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f63bd1f561304d85ac3a1f4f88e6f236.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f63bd1f561304d85ac3a1f4f88e6f236. Aug 24 11:21:16.150414 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:21:16.150414 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 11:21:16.150414 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 11:21:16.150414 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 11:21:16.150414 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 11:21:16.150414 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 11:21:16.150414 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 11:21:16.150414 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 11:21:16.150414 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application conn.query(q) Aug 24 11:21:16.150414 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 11:21:16.150414 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 11:21:16.150414 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 11:21:16.151241 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application result.read() Aug 24 11:21:16.151241 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 11:21:16.151241 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 11:21:16.151241 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 11:21:16.151241 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 11:21:16.151241 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 11:21:16.151241 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 11:21:16.151241 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 11:21:16.151241 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 11:21:16.151241 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 24 11:21:16.151241 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:21:16.151241 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 24 11:21:16.151241 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:21:16.151241 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:21:16.151241 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 24 11:21:16.151241 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 24 11:21:16.151241 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 24 11:21:16.151241 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 24 11:21:16.152523 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 11:21:16.152523 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application next(self.gen) Aug 24 11:21:16.152523 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 24 11:21:16.152523 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application yield resource Aug 24 11:21:16.152523 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 11:21:16.152523 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application next(self.gen) Aug 24 11:21:16.152523 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 24 11:21:16.152523 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application self.session.rollback() Aug 24 11:21:16.152523 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 11:21:16.152523 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application self.force_reraise() Aug 24 11:21:16.152523 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 11:21:16.152523 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise self.value Aug 24 11:21:16.152523 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 24 11:21:16.152523 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 24 11:21:16.152523 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 24 11:21:16.152523 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application session.commit() Aug 24 11:21:16.152523 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 24 11:21:16.153457 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 24 11:21:16.153457 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 24 11:21:16.153457 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application self._prepare_impl() Aug 24 11:21:16.153457 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 24 11:21:16.153457 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application self.session.flush() Aug 24 11:21:16.153457 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 24 11:21:16.153457 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application self._flush(objects) Aug 24 11:21:16.153457 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 24 11:21:16.153457 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 24 11:21:16.153457 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 24 11:21:16.153457 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application compat.raise_( Aug 24 11:21:16.153457 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 11:21:16.153457 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception Aug 24 11:21:16.153457 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 24 11:21:16.153457 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application flush_context.execute() Aug 24 11:21:16.153457 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 24 11:21:16.153457 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rec.execute(self) Aug 24 11:21:16.154372 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 24 11:21:16.154372 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 24 11:21:16.154372 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 24 11:21:16.154372 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 24 11:21:16.154372 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 24 11:21:16.154372 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 24 11:21:16.154372 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 24 11:21:16.154372 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 24 11:21:16.154372 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 24 11:21:16.154372 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 24 11:21:16.154372 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 24 11:21:16.154372 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 24 11:21:16.154372 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 24 11:21:16.154372 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 24 11:21:16.154372 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 24 11:21:16.155210 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 24 11:21:16.155210 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 11:21:16.155210 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception Aug 24 11:21:16.155210 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 11:21:16.155210 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 11:21:16.155210 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 11:21:16.155210 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 11:21:16.155210 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 11:21:16.155210 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 11:21:16.155210 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 11:21:16.155210 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application conn.query(q) Aug 24 11:21:16.155210 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 11:21:16.155210 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 11:21:16.155210 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 11:21:16.155210 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application result.read() Aug 24 11:21:16.155210 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 11:21:16.155210 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 11:21:16.156105 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 11:21:16.156105 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 11:21:16.156105 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 11:21:16.156105 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 11:21:16.156105 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 11:21:16.156105 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 11:21:16.156105 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 24 11:21:16.156105 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 24 11:21:16.156105 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [parameters: {'id': 'f63bd1f561304d85ac3a1f4f88e6f236', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 24 11:21:16.156105 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 24 11:21:16.156105 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:21:16.156105 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 11:21:16.156105 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:21:16.156105 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:21:16.156105 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 24 11:21:16.156897 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 24 11:21:16.156897 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 24 11:21:16.156897 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 24 11:21:16.156897 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 24 11:21:16.156897 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:21:16.156897 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 11:21:16.156897 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:21:16.156897 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:21:16.156897 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:21:16.156897 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:21:16.156897 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:21:16.156897 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:21:16.156897 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:21:16.156897 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:21:16.156897 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:21:16.156897 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:21:16.156897 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:21:16.157802 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:21:16.157802 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 24 11:21:16.157802 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 24 11:21:16.157802 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:21:16.157802 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:21:16.157802 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 24 11:21:16.157802 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 24 11:21:16.157802 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f63bd1f561304d85ac3a1f4f88e6f236. Aug 24 11:21:16.157802 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:21:16.158305 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-672b076b-0075-4520-bef9-859e5f63155d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 11:21:16.158305 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:21:16.158305 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:21:16.158305 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:21:16.158305 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:21:16.158305 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:21:16.158305 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:21:16.158305 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:21:16.158305 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:21:16.158305 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:21:16.158305 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:21:16.158305 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:21:16.158305 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 11:21:16.158305 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 11:21:16.158305 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 11:21:16.158305 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 11:21:16.162468 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:21:16.162468 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:21:16.162468 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 11:21:16.162468 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 11:21:16.162468 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 11:21:16.162468 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 11:21:16.162468 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:21:16.162468 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:21:16.162468 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:21:16.162468 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:21:16.162468 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:21:16.162468 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Aug 24 11:21:16.162468 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:21:16.162468 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:21:16.162468 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:21:16.162468 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:21:16.162468 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:21:16.162468 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:21:16.164358 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:21:16.164358 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:21:16.164358 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 11:21:16.164358 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 11:21:16.164358 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 11:21:16.164358 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 11:21:16.164358 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 11:21:16.164358 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 11:21:16.164358 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 11:21:16.164358 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Aug 24 11:21:16.164358 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 469/940] 10.222.0.27 () {56 vars in 1117 bytes} [Wed Aug 24 11:21:15 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:21:16.165546 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672b076b-0075-4520-bef9-859e5f63155d None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:16.165915 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 472/941] 10.222.0.27 () {60 vars in 1140 bytes} [Wed Aug 24 11:21:15 2022] POST /identity/v3/projects => generated 262 bytes in 244 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 24 11:21:16.172882 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b4f152-7ff1-49f5-a18b-2b9071728625 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:16.290003 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672b076b-0075-4520-bef9-859e5f63155d None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:16.293427 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:16.305661 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b4f152-7ff1-49f5-a18b-2b9071728625 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:16.338962 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d56901-8839-45a8-853d-4457950c0696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:16.340254 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d56901-8839-45a8-853d-4457950c0696 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:16.340696 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d56901-8839-45a8-853d-4457950c0696 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:16.341129 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d56901-8839-45a8-853d-4457950c0696 None admin] PATH_INFO: `/v3/users` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:16.341359 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fac4a0d-91b1-49ee-b3d3-4ba50b44d777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:16.342063 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fac4a0d-91b1-49ee-b3d3-4ba50b44d777 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:16.342437 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fac4a0d-91b1-49ee-b3d3-4ba50b44d777 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:16.342594 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d56901-8839-45a8-853d-4457950c0696 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:21:16.342822 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fac4a0d-91b1-49ee-b3d3-4ba50b44d777 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:16.343233 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d56901-8839-45a8-853d-4457950c0696 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:16.345139 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d56901-8839-45a8-853d-4457950c0696 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:16.350468 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fac4a0d-91b1-49ee-b3d3-4ba50b44d777 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:16.352208 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fac4a0d-91b1-49ee-b3d3-4ba50b44d777 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:16.363863 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-6fac4a0d-91b1-49ee-b3d3-4ba50b44d777 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 11:21:16.363863 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:21:16.363863 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:21:16.363863 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:21:16.363863 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:21:16.363863 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:21:16.363863 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:21:16.363863 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:21:16.363863 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:21:16.363863 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:21:16.363863 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:21:16.363863 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:21:16.363863 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 11:21:16.363863 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 11:21:16.363863 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 11:21:16.364780 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 11:21:16.364780 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:21:16.364780 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:21:16.364780 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:21:16.364780 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:21:16.364780 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:21:16.364780 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:21:16.364780 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:21:16.364780 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Aug 24 11:21:16.364780 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:21:16.364780 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:21:16.364780 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:21:16.364780 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:21:16.364780 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:21:16.364780 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:21:16.364780 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:21:16.364780 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:21:16.365676 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 11:21:16.365676 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 11:21:16.365676 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 11:21:16.365676 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 11:21:16.365676 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 11:21:16.365676 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 11:21:16.365676 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 11:21:16.365676 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:21:16.368685 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 470/943] 10.222.0.27 () {56 vars in 1149 bytes} [Wed Aug 24 11:21:16 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:21:16.370419 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 473/943] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Aug 24 11:21:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:21:16.373863 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d56901-8839-45a8-853d-4457950c0696 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:16.375813 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fac4a0d-91b1-49ee-b3d3-4ba50b44d777 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:16.406240 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:16.493044 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fac4a0d-91b1-49ee-b3d3-4ba50b44d777 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:16.505503 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d56901-8839-45a8-853d-4457950c0696 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:16.529838 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46def139-2431-459c-b87e-8f679a422ba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:16.530473 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46def139-2431-459c-b87e-8f679a422ba6 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:16.530771 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46def139-2431-459c-b87e-8f679a422ba6 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:16.531116 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46def139-2431-459c-b87e-8f679a422ba6 None admin] PATH_INFO: `/v3/projects` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:16.531704 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46def139-2431-459c-b87e-8f679a422ba6 None admin] RBAC: Adding query filter params (name=service) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:21:16.532206 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46def139-2431-459c-b87e-8f679a422ba6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:16.533435 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46def139-2431-459c-b87e-8f679a422ba6 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:16.543211 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d0b107-492b-4ac4-b763-d2e3073a7335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:16.543837 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d0b107-492b-4ac4-b763-d2e3073a7335 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:16.544136 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d0b107-492b-4ac4-b763-d2e3073a7335 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:16.544400 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d0b107-492b-4ac4-b763-d2e3073a7335 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:16.554774 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 474/944] 10.222.0.27 () {56 vars in 1112 bytes} [Wed Aug 24 11:21:16 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:21:16.556620 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9ce5fb-ddfb-4ce7-93f5-50970b6dcd3d None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:16.557111 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9ce5fb-ddfb-4ce7-93f5-50970b6dcd3d None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:16.557575 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9ce5fb-ddfb-4ce7-93f5-50970b6dcd3d None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:16.560151 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 475/945] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:21:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:21:16.562293 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610285fa-ac68-4809-8d08-49f44452af91 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:16.562805 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d0b107-492b-4ac4-b763-d2e3073a7335 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:16.562917 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610285fa-ac68-4809-8d08-49f44452af91 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:16.563280 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610285fa-ac68-4809-8d08-49f44452af91 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:16.564909 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d0b107-492b-4ac4-b763-d2e3073a7335 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:16.565863 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 476/946] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:21:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:21:16.567177 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12593c0a-4e5d-4ae4-bdfc-9254c180cf56 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:16.567455 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12593c0a-4e5d-4ae4-bdfc-9254c180cf56 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:16.567735 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12593c0a-4e5d-4ae4-bdfc-9254c180cf56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:16.584360 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-35d0b107-492b-4ac4-b763-d2e3073a7335 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:21:16.584360 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:21:16.584360 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:21:16.584360 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:21:16.584360 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:21:16.584360 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:21:16.584360 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:21:16.584360 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:21:16.584360 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:21:16.584360 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:21:16.584360 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:21:16.584360 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:21:16.584360 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 11:21:16.584360 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 11:21:16.584360 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 11:21:16.584360 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 11:21:16.585410 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:21:16.585410 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:21:16.585410 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:21:16.585410 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:21:16.585410 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:21:16.585410 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:21:16.585410 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:21:16.585410 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Aug 24 11:21:16.585410 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:21:16.585410 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:21:16.585410 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:21:16.585410 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:21:16.585410 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:21:16.585410 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:21:16.585410 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:21:16.585410 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:21:16.585410 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 11:21:16.586304 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 11:21:16.586304 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:21:16.586304 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Aug 24 11:21:16.586304 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 471/947] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 11:21:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 11:21:16.587322 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9f9c6b-2494-44ea-a27f-efe3ec353f25 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:16.587604 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9f9c6b-2494-44ea-a27f-efe3ec353f25 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:16.587875 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9f9c6b-2494-44ea-a27f-efe3ec353f25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:16.589759 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-12593c0a-4e5d-4ae4-bdfc-9254c180cf56 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:21:16.591759 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-12593c0a-4e5d-4ae4-bdfc-9254c180cf56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:21:16.606790 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-4d9f9c6b-2494-44ea-a27f-efe3ec353f25 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:21:16.608032 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-4d9f9c6b-2494-44ea-a27f-efe3ec353f25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:21:16.619956 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:16.671547 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 477/948] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:21:16 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 11:21:16.672764 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12593c0a-4e5d-4ae4-bdfc-9254c180cf56 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:16.695381 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:16.705143 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 472/949] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:21:16 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 11:21:16.788523 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12593c0a-4e5d-4ae4-bdfc-9254c180cf56 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:16.824509 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6147118e-47f6-4d80-ba1c-aab8e73331d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:16.825132 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6147118e-47f6-4d80-ba1c-aab8e73331d3 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:16.825407 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6147118e-47f6-4d80-ba1c-aab8e73331d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:16.825735 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6147118e-47f6-4d80-ba1c-aab8e73331d3 None admin] PATH_INFO: `/v3/domains` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:16.828056 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6147118e-47f6-4d80-ba1c-aab8e73331d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:21:16.828056 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6147118e-47f6-4d80-ba1c-aab8e73331d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:16.828244 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6147118e-47f6-4d80-ba1c-aab8e73331d3 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:16.839838 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 478/950] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 24 11:21:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:21:16.845659 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9f9c6b-2494-44ea-a27f-efe3ec353f25 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:16.942210 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6147118e-47f6-4d80-ba1c-aab8e73331d3 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:16.960556 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9f9c6b-2494-44ea-a27f-efe3ec353f25 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:17.003637 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c3022f-4b0b-4725-97b6-9c7aee981613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:17.004275 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c3022f-4b0b-4725-97b6-9c7aee981613 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:17.004553 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c3022f-4b0b-4725-97b6-9c7aee981613 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:17.004818 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c3022f-4b0b-4725-97b6-9c7aee981613 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:17.011719 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c3022f-4b0b-4725-97b6-9c7aee981613 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:17.013178 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c3022f-4b0b-4725-97b6-9c7aee981613 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:17.023551 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:17.024188 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-b9c3022f-4b0b-4725-97b6-9c7aee981613 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 11:21:17.024188 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:21:17.024188 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:21:17.024188 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:21:17.024188 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:21:17.024188 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:21:17.024188 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:21:17.024188 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:21:17.024188 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:21:17.024188 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:21:17.024188 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:21:17.024188 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:21:17.024188 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 11:21:17.024188 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 11:21:17.024188 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 11:21:17.025162 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 11:21:17.025162 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:21:17.025162 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:21:17.025162 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:21:17.025162 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:21:17.025162 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:21:17.025162 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:21:17.025162 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:21:17.025162 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Aug 24 11:21:17.025162 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:21:17.025162 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:21:17.025162 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:21:17.025162 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:21:17.025162 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:21:17.025162 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:21:17.025162 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:21:17.025162 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:21:17.026174 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 11:21:17.026174 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 11:21:17.026174 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 11:21:17.026174 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 11:21:17.026174 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 11:21:17.026174 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 11:21:17.026174 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 11:21:17.026174 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Aug 24 11:21:17.029661 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 473/951] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Aug 24 11:21:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:21:17.030383 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c3022f-4b0b-4725-97b6-9c7aee981613 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:17.035251 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:17.053307 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6147118e-47f6-4d80-ba1c-aab8e73331d3 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:17.089771 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3d70d1-d1ce-4c62-8452-2a57b55d3257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:17.090429 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3d70d1-d1ce-4c62-8452-2a57b55d3257 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:17.090705 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3d70d1-d1ce-4c62-8452-2a57b55d3257 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:17.090968 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3d70d1-d1ce-4c62-8452-2a57b55d3257 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:17.091547 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3d70d1-d1ce-4c62-8452-2a57b55d3257 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:17.092923 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3d70d1-d1ce-4c62-8452-2a57b55d3257 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:17.101926 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-cd3d70d1-d1ce-4c62-8452-2a57b55d3257 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 11:21:17.101926 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:21:17.101926 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 11:21:17.101926 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 11:21:17.101926 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 11:21:17.101926 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 11:21:17.101926 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 11:21:17.101926 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 11:21:17.101926 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 11:21:17.101926 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:21:17.101926 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 11:21:17.101926 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:21:17.101926 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:21:17.101926 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:21:17.101926 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:21:17.101926 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:21:17.101926 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:21:17.103285 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:21:17.103285 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:21:17.103285 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:21:17.103285 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:21:17.103285 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:21:17.103285 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:21:17.103285 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 11:21:17.103285 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 11:21:17.103285 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 11:21:17.103285 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 11:21:17.103285 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:21:17.103285 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:21:17.103285 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:21:17.103285 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:21:17.103285 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:21:17.103285 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:21:17.104360 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:21:17.104360 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Aug 24 11:21:17.104360 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:21:17.104360 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:21:17.104360 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:21:17.104360 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:21:17.104360 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:21:17.104360 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:21:17.104360 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:21:17.104360 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:21:17.104360 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 11:21:17.104360 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 11:21:17.104360 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 11:21:17.104360 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:21:17.109666 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 479/952] 10.222.0.27 () {56 vars in 1126 bytes} [Wed Aug 24 11:21:16 2022] GET /identity/v3/services/object-store => generated 93 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:21:17.110566 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3d70d1-d1ce-4c62-8452-2a57b55d3257 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:17.154004 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c3022f-4b0b-4725-97b6-9c7aee981613 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:17.190576 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc61b36-8f9b-4c97-9136-70e957f6b039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:17.191496 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc61b36-8f9b-4c97-9136-70e957f6b039 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:17.191798 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc61b36-8f9b-4c97-9136-70e957f6b039 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:17.192070 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc61b36-8f9b-4c97-9136-70e957f6b039 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:17.192665 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc61b36-8f9b-4c97-9136-70e957f6b039 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:17.194049 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc61b36-8f9b-4c97-9136-70e957f6b039 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:17.202798 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-2cc61b36-8f9b-4c97-9136-70e957f6b039 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 11:21:17.202798 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:21:17.202798 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 11:21:17.202798 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 11:21:17.202798 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 11:21:17.202798 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 11:21:17.202798 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 11:21:17.202798 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 11:21:17.202798 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 11:21:17.202798 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Aug 24 11:21:17.202798 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 11:21:17.202798 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Aug 24 11:21:17.202798 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:21:17.202798 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:21:17.202798 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:21:17.202798 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:21:17.202798 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:21:17.204201 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:21:17.204201 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:21:17.204201 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:21:17.204201 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:21:17.204201 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:21:17.204201 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:21:17.204201 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 11:21:17.204201 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 11:21:17.204201 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 11:21:17.204201 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 11:21:17.204201 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:21:17.204201 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:21:17.204201 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:21:17.204201 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:21:17.204201 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:21:17.204201 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:21:17.205325 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:21:17.205325 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Aug 24 11:21:17.205325 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:21:17.205325 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:21:17.205325 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:21:17.205325 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:21:17.205325 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:21:17.205325 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:21:17.205325 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:21:17.205325 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:21:17.205325 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 11:21:17.205325 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 11:21:17.205325 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 11:21:17.205325 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Aug 24 11:21:17.208968 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 474/953] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Aug 24 11:21:17 2022] GET /identity/v3/services/compute => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:21:17.209826 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc61b36-8f9b-4c97-9136-70e957f6b039 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:17.217445 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3d70d1-d1ce-4c62-8452-2a57b55d3257 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:17.253792 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7280391e-f0d4-4df2-bb3a-07e05a90af69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:17.254547 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7280391e-f0d4-4df2-bb3a-07e05a90af69 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:17.254895 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7280391e-f0d4-4df2-bb3a-07e05a90af69 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:17.255178 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7280391e-f0d4-4df2-bb3a-07e05a90af69 None admin] PATH_INFO: `/v3/projects` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:17.255866 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7280391e-f0d4-4df2-bb3a-07e05a90af69 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:21:17.256171 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7280391e-f0d4-4df2-bb3a-07e05a90af69 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:17.257614 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7280391e-f0d4-4df2-bb3a-07e05a90af69 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:17.265814 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:17.277544 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 480/954] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Aug 24 11:21:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:21:17.278544 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7280391e-f0d4-4df2-bb3a-07e05a90af69 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:17.284951 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:17.322639 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc61b36-8f9b-4c97-9136-70e957f6b039 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:17.359249 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43df38a-8e03-44fd-83ad-e08dcebf0fdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:17.359976 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43df38a-8e03-44fd-83ad-e08dcebf0fdd None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:17.360298 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43df38a-8e03-44fd-83ad-e08dcebf0fdd None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:17.360565 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43df38a-8e03-44fd-83ad-e08dcebf0fdd None admin] PATH_INFO: `/v3/services` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:17.361355 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43df38a-8e03-44fd-83ad-e08dcebf0fdd None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:21:17.361541 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43df38a-8e03-44fd-83ad-e08dcebf0fdd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:17.363014 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43df38a-8e03-44fd-83ad-e08dcebf0fdd None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:17.367920 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 475/955] 10.222.0.27 () {56 vars in 1122 bytes} [Wed Aug 24 11:21:17 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:21:17.368682 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43df38a-8e03-44fd-83ad-e08dcebf0fdd None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:17.389021 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7280391e-f0d4-4df2-bb3a-07e05a90af69 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:17.423883 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92de8b12-aa25-4fba-bfa8-f77f54ca69cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:17.424509 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92de8b12-aa25-4fba-bfa8-f77f54ca69cd None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:17.424741 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92de8b12-aa25-4fba-bfa8-f77f54ca69cd None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:17.425036 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92de8b12-aa25-4fba-bfa8-f77f54ca69cd None admin] PATH_INFO: `/v3/services` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:17.425661 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92de8b12-aa25-4fba-bfa8-f77f54ca69cd None admin] RBAC: Adding query filter params (name=compute) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:21:17.425958 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92de8b12-aa25-4fba-bfa8-f77f54ca69cd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:17.427377 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92de8b12-aa25-4fba-bfa8-f77f54ca69cd None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:17.432249 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 481/956] 10.222.0.27 () {56 vars in 1112 bytes} [Wed Aug 24 11:21:17 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:21:17.433086 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92de8b12-aa25-4fba-bfa8-f77f54ca69cd None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:17.483460 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43df38a-8e03-44fd-83ad-e08dcebf0fdd None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:17.493098 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:17.517133 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:17.524141 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519df588-f6e8-4c21-b931-1b19b494e35d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:17.524809 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519df588-f6e8-4c21-b931-1b19b494e35d None admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:17.525080 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519df588-f6e8-4c21-b931-1b19b494e35d None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:17.525346 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519df588-f6e8-4c21-b931-1b19b494e35d None admin] PATH_INFO: `/v3/projects/317f54a463cb48ab86648c6dcec5db0f/users/a5915030f01941fc89f92228ff57c7f0/roles/e59237603afa477fbb6954564862fa4a` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:17.528074 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519df588-f6e8-4c21-b931-1b19b494e35d None admin] RBAC: Authorizing `identity:create_grant(project_id=317f54a463cb48ab86648c6dcec5db0f, user_id=a5915030f01941fc89f92228ff57c7f0, role_id=e59237603afa477fbb6954564862fa4a)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:17.529509 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519df588-f6e8-4c21-b931-1b19b494e35d None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:17.533286 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92de8b12-aa25-4fba-bfa8-f77f54ca69cd None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:17.550465 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 476/957] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Aug 24 11:21:17 2022] PUT /identity/v3/projects/317f54a463cb48ab86648c6dcec5db0f/users/a5915030f01941fc89f92228ff57c7f0/roles/e59237603afa477fbb6954564862fa4a => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:21:17.551839 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519df588-f6e8-4c21-b931-1b19b494e35d None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:17.574427 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969b5549-99a3-41b7-9621-3c3f31094aac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:17.575395 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969b5549-99a3-41b7-9621-3c3f31094aac None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:17.575863 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969b5549-99a3-41b7-9621-3c3f31094aac None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:17.576368 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969b5549-99a3-41b7-9621-3c3f31094aac None admin] PATH_INFO: `/v3/services` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:17.577210 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969b5549-99a3-41b7-9621-3c3f31094aac None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:21:17.577726 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969b5549-99a3-41b7-9621-3c3f31094aac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:17.579514 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969b5549-99a3-41b7-9621-3c3f31094aac None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:17.585484 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 482/958] 10.222.0.27 () {56 vars in 1122 bytes} [Wed Aug 24 11:21:17 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:21:17.591704 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969b5549-99a3-41b7-9621-3c3f31094aac None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:17.668800 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519df588-f6e8-4c21-b931-1b19b494e35d None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:17.710155 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b67678-3e30-44a3-9809-e8636bfb6c54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:17.710892 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b67678-3e30-44a3-9809-e8636bfb6c54 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:17.711164 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b67678-3e30-44a3-9809-e8636bfb6c54 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:17.711500 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b67678-3e30-44a3-9809-e8636bfb6c54 None admin] PATH_INFO: `/v3/services` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:17.712057 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b67678-3e30-44a3-9809-e8636bfb6c54 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:21:17.712359 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b67678-3e30-44a3-9809-e8636bfb6c54 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:17.713848 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b67678-3e30-44a3-9809-e8636bfb6c54 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:17.721161 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 477/959] 10.222.0.27 () {56 vars in 1112 bytes} [Wed Aug 24 11:21:17 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:21:17.731563 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969b5549-99a3-41b7-9621-3c3f31094aac None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:17.765896 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:17.777902 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7200a7f-23d9-4242-bdd0-48ea7d87e5b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:17.778641 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7200a7f-23d9-4242-bdd0-48ea7d87e5b5 None admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:17.778922 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7200a7f-23d9-4242-bdd0-48ea7d87e5b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:17.779187 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7200a7f-23d9-4242-bdd0-48ea7d87e5b5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:17.779944 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7200a7f-23d9-4242-bdd0-48ea7d87e5b5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:17.781433 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7200a7f-23d9-4242-bdd0-48ea7d87e5b5 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:17.803442 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 483/960] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 11:21:17 2022] POST /identity/v3/endpoints => generated 349 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 11:21:18.574912 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2cf1e9-4632-4411-8393-5104e4e87f78 None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:18.575475 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2cf1e9-4632-4411-8393-5104e4e87f78 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:18.575475 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2cf1e9-4632-4411-8393-5104e4e87f78 None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:18.577033 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 478/961] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:21:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:21:18.582597 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90150ff-d733-4f03-9989-b6b29bdc712a None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:18.583023 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90150ff-d733-4f03-9989-b6b29bdc712a None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:18.583195 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90150ff-d733-4f03-9989-b6b29bdc712a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:18.601657 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-e90150ff-d733-4f03-9989-b6b29bdc712a None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:21:18.602856 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-e90150ff-d733-4f03-9989-b6b29bdc712a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:21:18.676561 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 484/962] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:21:18 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 11:21:18.942678 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2cf1e9-4632-4411-8393-5104e4e87f78 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:18.998720 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:19.045112 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2cf1e9-4632-4411-8393-5104e4e87f78 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:19.079137 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd9bd85-6e23-4942-a82f-0a2a2721fcdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:19.079755 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd9bd85-6e23-4942-a82f-0a2a2721fcdd None admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:19.080026 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd9bd85-6e23-4942-a82f-0a2a2721fcdd None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:19.080302 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd9bd85-6e23-4942-a82f-0a2a2721fcdd None admin] PATH_INFO: `/v3/users` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:19.080954 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd9bd85-6e23-4942-a82f-0a2a2721fcdd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:19.082459 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd9bd85-6e23-4942-a82f-0a2a2721fcdd None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:19.085066 dv-cinder-848899-3-smb devstack@keystone.service[81502]: WARNING keystone.server.flask.common [None req-5dd9bd85-6e23-4942-a82f-0a2a2721fcdd None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 24 11:21:19.098251 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.sql.core [None req-5dd9bd85-6e23-4942-a82f-0a2a2721fcdd None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 24 11:21:19.098251 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 24 11:21:19.098251 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [parameters: {'user_id': '87641ee7bc064dd789a45cac77ece41c', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 24 11:21:19.098251 dv-cinder-848899-3-smb devstack@keystone.service[81502]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81502) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 24 11:21:19.116493 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-5dd9bd85-6e23-4942-a82f-0a2a2721fcdd None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 24 11:21:19.116493 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:21:19.116493 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 11:21:19.116493 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 11:21:19.116493 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 11:21:19.116493 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 11:21:19.116493 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 11:21:19.116493 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 11:21:19.116493 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 11:21:19.116493 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application conn.query(q) Aug 24 11:21:19.116493 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 11:21:19.116493 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 11:21:19.116493 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 11:21:19.116493 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application result.read() Aug 24 11:21:19.116493 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 11:21:19.117463 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 11:21:19.117463 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 11:21:19.117463 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 11:21:19.117463 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 11:21:19.117463 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 11:21:19.117463 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 11:21:19.117463 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 11:21:19.117463 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 24 11:21:19.117463 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Aug 24 11:21:19.117463 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 24 11:21:19.117463 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Aug 24 11:21:19.117463 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:21:19.117463 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 24 11:21:19.117463 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 24 11:21:19.117463 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 24 11:21:19.117463 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 24 11:21:19.117463 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 11:21:19.117463 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application next(self.gen) Aug 24 11:21:19.118516 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 24 11:21:19.118516 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application yield resource Aug 24 11:21:19.118516 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 11:21:19.118516 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application next(self.gen) Aug 24 11:21:19.118516 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 24 11:21:19.118516 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application self.session.rollback() Aug 24 11:21:19.118516 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 11:21:19.118516 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application self.force_reraise() Aug 24 11:21:19.118516 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 11:21:19.118516 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise self.value Aug 24 11:21:19.118516 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 24 11:21:19.118516 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 24 11:21:19.118516 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 24 11:21:19.118516 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application session.commit() Aug 24 11:21:19.118516 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 24 11:21:19.118516 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 24 11:21:19.118516 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 24 11:21:19.119463 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application self._prepare_impl() Aug 24 11:21:19.119463 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 24 11:21:19.119463 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application self.session.flush() Aug 24 11:21:19.119463 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 24 11:21:19.119463 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application self._flush(objects) Aug 24 11:21:19.119463 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 24 11:21:19.119463 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 24 11:21:19.119463 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 24 11:21:19.119463 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application compat.raise_( Aug 24 11:21:19.119463 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 11:21:19.119463 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception Aug 24 11:21:19.119463 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 24 11:21:19.119463 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application flush_context.execute() Aug 24 11:21:19.119463 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 24 11:21:19.119463 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rec.execute(self) Aug 24 11:21:19.119463 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 24 11:21:19.119463 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 24 11:21:19.120376 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 24 11:21:19.120376 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 24 11:21:19.120376 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 24 11:21:19.120376 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 24 11:21:19.120376 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 24 11:21:19.120376 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 24 11:21:19.120376 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 24 11:21:19.120376 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 24 11:21:19.120376 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 24 11:21:19.120376 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 24 11:21:19.120376 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 24 11:21:19.120376 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 24 11:21:19.120376 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 24 11:21:19.120376 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 24 11:21:19.120376 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 11:21:19.120376 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception Aug 24 11:21:19.121269 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 11:21:19.121269 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 11:21:19.121269 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 11:21:19.121269 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 11:21:19.121269 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 11:21:19.121269 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 11:21:19.121269 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 11:21:19.121269 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application conn.query(q) Aug 24 11:21:19.121269 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 11:21:19.121269 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 11:21:19.121269 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 11:21:19.121269 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application result.read() Aug 24 11:21:19.121269 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 11:21:19.121269 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 11:21:19.121269 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 11:21:19.121269 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 11:21:19.122103 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 11:21:19.122103 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 11:21:19.122103 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 11:21:19.122103 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 11:21:19.122103 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 24 11:21:19.122103 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 24 11:21:19.122103 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [parameters: {'user_id': '87641ee7bc064dd789a45cac77ece41c', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 24 11:21:19.122103 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 24 11:21:19.122103 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Aug 24 11:21:19.122103 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 11:21:19.122103 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Aug 24 11:21:19.122103 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:21:19.122103 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:21:19.122103 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:21:19.122103 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:21:19.124498 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:21:19.124498 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:21:19.124498 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:21:19.124498 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:21:19.124498 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:21:19.124498 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:21:19.124498 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:21:19.124498 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 24 11:21:19.124498 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 24 11:21:19.124498 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:21:19.124498 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:21:19.124498 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 11:21:19.124498 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 11:21:19.124498 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 11:21:19.124498 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 11:21:19.124498 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 24 11:21:19.124498 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 24 11:21:19.125686 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 24 11:21:19.125686 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 24 11:21:19.125686 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 24 11:21:19.125686 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 24 11:21:19.125686 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 24 11:21:19.125686 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Aug 24 11:21:19.125686 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 479/963] 10.222.0.27 () {60 vars in 1131 bytes} [Wed Aug 24 11:21:18 2022] POST /identity/v3/users => generated 160 bytes in 176 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:21:19.126266 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90150ff-d733-4f03-9989-b6b29bdc712a None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:19.226631 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90150ff-d733-4f03-9989-b6b29bdc712a None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:19.236676 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:19.270988 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19201cf-374b-4882-b8a7-cfa98a122282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:19.272071 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19201cf-374b-4882-b8a7-cfa98a122282 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:19.272602 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19201cf-374b-4882-b8a7-cfa98a122282 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:19.273062 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19201cf-374b-4882-b8a7-cfa98a122282 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:19.281811 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19201cf-374b-4882-b8a7-cfa98a122282 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:19.283560 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19201cf-374b-4882-b8a7-cfa98a122282 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:19.295704 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-b19201cf-374b-4882-b8a7-cfa98a122282 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 11:21:19.295704 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:21:19.295704 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:21:19.295704 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:21:19.295704 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:21:19.295704 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:21:19.295704 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:21:19.295704 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:21:19.295704 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:21:19.295704 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:21:19.295704 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:21:19.295704 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:21:19.295704 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 11:21:19.295704 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 11:21:19.295704 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 11:21:19.295704 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 11:21:19.296714 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:21:19.296714 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:21:19.296714 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 11:21:19.296714 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 11:21:19.296714 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 11:21:19.296714 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 11:21:19.296714 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:21:19.296714 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:21:19.296714 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:21:19.296714 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:21:19.296714 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:21:19.296714 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Aug 24 11:21:19.296714 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:21:19.296714 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:21:19.296714 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:21:19.296714 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:21:19.296714 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:21:19.296714 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:21:19.297659 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:21:19.297659 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:21:19.297659 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 11:21:19.297659 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 11:21:19.297659 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 11:21:19.297659 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 11:21:19.297659 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 11:21:19.297659 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 11:21:19.297659 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 11:21:19.297659 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:21:19.300323 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 485/964] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 24 11:21:19 2022] GET /identity/v3/users/cinder => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:21:19.309637 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd9bd85-6e23-4942-a82f-0a2a2721fcdd None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:19.416832 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd9bd85-6e23-4942-a82f-0a2a2721fcdd None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:19.435227 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:19.453796 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02877abd-f58c-419e-84cc-c21629b2e009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:19.454790 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02877abd-f58c-419e-84cc-c21629b2e009 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:19.455274 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02877abd-f58c-419e-84cc-c21629b2e009 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:19.455742 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02877abd-f58c-419e-84cc-c21629b2e009 None admin] PATH_INFO: `/v3/users` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:19.456798 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02877abd-f58c-419e-84cc-c21629b2e009 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:21:19.457295 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02877abd-f58c-419e-84cc-c21629b2e009 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:19.459236 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02877abd-f58c-419e-84cc-c21629b2e009 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:19.498930 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 480/965] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Aug 24 11:21:19 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:21:19.586203 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4f235b-53eb-4e9a-b35f-9c149f84ba6c None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:19.586793 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4f235b-53eb-4e9a-b35f-9c149f84ba6c None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:19.586793 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4f235b-53eb-4e9a-b35f-9c149f84ba6c None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:19.588488 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 486/966] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:21:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:21:19.594463 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78055e0c-8457-463b-8dd0-61d8f1155df9 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:19.595335 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78055e0c-8457-463b-8dd0-61d8f1155df9 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:19.595790 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78055e0c-8457-463b-8dd0-61d8f1155df9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:19.618447 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-78055e0c-8457-463b-8dd0-61d8f1155df9 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:21:19.618447 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-78055e0c-8457-463b-8dd0-61d8f1155df9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:21:19.690649 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 481/967] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:21:19 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 11:21:19.743785 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0ac555-622a-4d54-a00e-b8dee8edc19b None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:19.744458 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0ac555-622a-4d54-a00e-b8dee8edc19b None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:19.744955 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0ac555-622a-4d54-a00e-b8dee8edc19b None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:19.746836 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 487/968] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:21:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:21:19.750173 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6a095d-5715-4177-a729-413a7e2c253c None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:19.750422 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6a095d-5715-4177-a729-413a7e2c253c None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:19.750703 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6a095d-5715-4177-a729-413a7e2c253c None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:19.752293 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 482/969] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:21:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:21:19.753272 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb3a89c-6ab5-49f3-abd3-b5e3071bc904 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:19.753634 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb3a89c-6ab5-49f3-abd3-b5e3071bc904 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:19.753981 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb3a89c-6ab5-49f3-abd3-b5e3071bc904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:19.757520 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71b9596-a0aa-4e0c-92dd-de08b2dfef15 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:19.758020 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71b9596-a0aa-4e0c-92dd-de08b2dfef15 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:19.758500 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71b9596-a0aa-4e0c-92dd-de08b2dfef15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:19.775391 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-0cb3a89c-6ab5-49f3-abd3-b5e3071bc904 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:21:19.776937 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-0cb3a89c-6ab5-49f3-abd3-b5e3071bc904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:21:19.779629 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-e71b9596-a0aa-4e0c-92dd-de08b2dfef15 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:21:19.780809 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-e71b9596-a0aa-4e0c-92dd-de08b2dfef15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:21:19.851077 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 488/970] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:21:19 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 11:21:19.852395 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 483/971] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:21:19 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 11:21:19.962847 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb3a89c-6ab5-49f3-abd3-b5e3071bc904 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:20.061316 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:20.065511 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb3a89c-6ab5-49f3-abd3-b5e3071bc904 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:20.108719 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf5ca41-a062-4069-8021-ffa4c15ab876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:20.109378 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf5ca41-a062-4069-8021-ffa4c15ab876 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:20.109630 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf5ca41-a062-4069-8021-ffa4c15ab876 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:20.109933 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf5ca41-a062-4069-8021-ffa4c15ab876 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:20.116325 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71b9596-a0aa-4e0c-92dd-de08b2dfef15 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:20.129624 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf5ca41-a062-4069-8021-ffa4c15ab876 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:21:20.134499 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-1cf5ca41-a062-4069-8021-ffa4c15ab876 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 11:21:20.134499 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:21:20.134499 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:21:20.134499 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:21:20.134499 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:21:20.134499 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:21:20.134499 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:21:20.134499 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:21:20.134499 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:21:20.134499 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:21:20.134499 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:21:20.134499 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:21:20.134499 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:21:20.134499 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:21:20.134499 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:21:20.134499 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:21:20.135472 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:21:20.135472 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:21:20.135472 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:21:20.135472 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:21:20.135472 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:21:20.135472 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:21:20.135472 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:21:20.135472 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:21:20.135472 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:21:20.135472 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:21:20.135472 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:21:20.135472 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Aug 24 11:21:20.135472 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:21:20.135472 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:21:20.135472 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:21:20.135472 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:21:20.136367 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:21:20.136367 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:21:20.136367 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:21:20.136367 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:21:20.136367 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:21:20.136367 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:21:20.136367 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:21:20.136367 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:21:20.136367 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:21:20.136367 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:21:20.136367 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 11:21:20.136367 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:21:20.136367 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 489/972] 10.222.0.27 () {56 vars in 1120 bytes} [Wed Aug 24 11:21:19 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:21:20.137098 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf5ca41-a062-4069-8021-ffa4c15ab876 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:20.154176 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:20.220462 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71b9596-a0aa-4e0c-92dd-de08b2dfef15 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:20.236188 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf5ca41-a062-4069-8021-ffa4c15ab876 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:20.254788 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159504c5-4621-44a4-ba3a-79192a8546df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:20.255437 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159504c5-4621-44a4-ba3a-79192a8546df None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:20.255703 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159504c5-4621-44a4-ba3a-79192a8546df None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:20.255964 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159504c5-4621-44a4-ba3a-79192a8546df None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:20.256540 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159504c5-4621-44a4-ba3a-79192a8546df None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:20.257937 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159504c5-4621-44a4-ba3a-79192a8546df None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:20.267035 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-159504c5-4621-44a4-ba3a-79192a8546df None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 11:21:20.267035 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:21:20.267035 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 11:21:20.267035 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 11:21:20.267035 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 11:21:20.267035 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 11:21:20.267035 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 11:21:20.267035 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 11:21:20.267035 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 11:21:20.267035 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Aug 24 11:21:20.267035 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 11:21:20.267035 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Aug 24 11:21:20.267035 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:21:20.267035 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:21:20.267035 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:21:20.267035 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:21:20.267035 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:21:20.268314 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:21:20.268314 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:21:20.268314 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:21:20.268314 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:21:20.268314 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:21:20.268314 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:21:20.268314 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 11:21:20.268314 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 11:21:20.268314 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 11:21:20.268314 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 11:21:20.268314 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:21:20.268314 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:21:20.268314 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:21:20.268314 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:21:20.268314 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:21:20.268314 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:21:20.269800 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:21:20.269800 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Aug 24 11:21:20.269800 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:21:20.269800 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:21:20.269800 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:21:20.269800 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:21:20.269800 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:21:20.269800 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:21:20.269800 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:21:20.269800 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:21:20.269800 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 11:21:20.269800 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 11:21:20.269800 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 11:21:20.269800 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Aug 24 11:21:20.269800 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 484/973] 10.222.0.27 () {56 vars in 1126 bytes} [Wed Aug 24 11:21:20 2022] GET /identity/v3/services/object-store => generated 93 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 11:21:20.270710 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159504c5-4621-44a4-ba3a-79192a8546df None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:20.273434 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16cf185-11f6-4e3c-aa23-41e731a891fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:20.274064 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16cf185-11f6-4e3c-aa23-41e731a891fb None admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:20.274339 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16cf185-11f6-4e3c-aa23-41e731a891fb None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:20.274643 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16cf185-11f6-4e3c-aa23-41e731a891fb None admin] PATH_INFO: `/v3/services` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:20.275290 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16cf185-11f6-4e3c-aa23-41e731a891fb None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:20.277092 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16cf185-11f6-4e3c-aa23-41e731a891fb None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:20.292961 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 490/974] 10.222.0.27 () {60 vars in 1141 bytes} [Wed Aug 24 11:21:20 2022] POST /identity/v3/services => generated 242 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:21:20.294418 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16cf185-11f6-4e3c-aa23-41e731a891fb None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:20.316454 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:20.384758 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:20.388277 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159504c5-4621-44a4-ba3a-79192a8546df None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:20.423293 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16cf185-11f6-4e3c-aa23-41e731a891fb None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:20.426789 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba96ee41-a429-45dc-8d3c-061af8f93382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:20.427412 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba96ee41-a429-45dc-8d3c-061af8f93382 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:20.427683 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba96ee41-a429-45dc-8d3c-061af8f93382 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:20.427946 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba96ee41-a429-45dc-8d3c-061af8f93382 None admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:20.428619 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba96ee41-a429-45dc-8d3c-061af8f93382 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:21:20.428912 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba96ee41-a429-45dc-8d3c-061af8f93382 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:20.430298 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba96ee41-a429-45dc-8d3c-061af8f93382 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:20.439746 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 485/975] 10.222.0.27 () {56 vars in 1115 bytes} [Wed Aug 24 11:21:20 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:21:20.446491 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba96ee41-a429-45dc-8d3c-061af8f93382 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:20.468672 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2381f1-26f6-4005-90dc-c36c5a928804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:20.469296 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2381f1-26f6-4005-90dc-c36c5a928804 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:20.469575 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2381f1-26f6-4005-90dc-c36c5a928804 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:20.469840 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2381f1-26f6-4005-90dc-c36c5a928804 None admin] PATH_INFO: `/v3/services` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:20.470553 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2381f1-26f6-4005-90dc-c36c5a928804 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:21:20.470810 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2381f1-26f6-4005-90dc-c36c5a928804 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:20.472438 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2381f1-26f6-4005-90dc-c36c5a928804 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:20.479179 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 491/976] 10.222.0.27 () {56 vars in 1122 bytes} [Wed Aug 24 11:21:20 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:21:20.484822 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2381f1-26f6-4005-90dc-c36c5a928804 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:20.560498 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba96ee41-a429-45dc-8d3c-061af8f93382 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:20.567763 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:20.591326 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2381f1-26f6-4005-90dc-c36c5a928804 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:20.599407 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd25784f-c4c3-400b-aa28-1a977b2e3226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:20.600049 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd25784f-c4c3-400b-aa28-1a977b2e3226 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:20.600327 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd25784f-c4c3-400b-aa28-1a977b2e3226 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:20.600597 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd25784f-c4c3-400b-aa28-1a977b2e3226 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:20.612050 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd25784f-c4c3-400b-aa28-1a977b2e3226 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:20.613583 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd25784f-c4c3-400b-aa28-1a977b2e3226 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:20.629674 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f554f446-9099-4ea8-858f-428d51e19158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:20.630289 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f554f446-9099-4ea8-858f-428d51e19158 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:20.630599 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f554f446-9099-4ea8-858f-428d51e19158 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:20.630871 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f554f446-9099-4ea8-858f-428d51e19158 None admin] PATH_INFO: `/v3/services` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:20.631506 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f554f446-9099-4ea8-858f-428d51e19158 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:21:20.631809 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f554f446-9099-4ea8-858f-428d51e19158 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:20.632179 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-fd25784f-c4c3-400b-aa28-1a977b2e3226 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:21:20.632179 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:21:20.632179 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:21:20.632179 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:21:20.632179 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:21:20.632179 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:21:20.632179 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:21:20.632179 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:21:20.632179 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:21:20.632179 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:21:20.632179 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:21:20.632179 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:21:20.632179 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 11:21:20.632179 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 11:21:20.632179 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 11:21:20.632179 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 11:21:20.633109 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:21:20.633109 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:21:20.633109 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:21:20.633109 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:21:20.633109 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:21:20.633109 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:21:20.633109 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:21:20.633109 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Aug 24 11:21:20.633109 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:21:20.633109 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:21:20.633109 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:21:20.633109 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:21:20.633109 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:21:20.633109 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:21:20.633109 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:21:20.633109 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:21:20.633109 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 11:21:20.634107 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 11:21:20.634107 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:21:20.634107 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Aug 24 11:21:20.634291 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f554f446-9099-4ea8-858f-428d51e19158 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:20.634396 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 486/977] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 11:21:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:21:20.638959 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd25784f-c4c3-400b-aa28-1a977b2e3226 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:20.639820 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 492/978] 10.222.0.27 () {56 vars in 1122 bytes} [Wed Aug 24 11:21:20 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:21:20.645669 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f554f446-9099-4ea8-858f-428d51e19158 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:20.656429 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:20.754833 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd25784f-c4c3-400b-aa28-1a977b2e3226 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:20.762772 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f554f446-9099-4ea8-858f-428d51e19158 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:20.790272 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fb956a-90fd-47cd-bc88-60690c7fb496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:20.790904 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fb956a-90fd-47cd-bc88-60690c7fb496 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:20.791179 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fb956a-90fd-47cd-bc88-60690c7fb496 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:20.791442 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fb956a-90fd-47cd-bc88-60690c7fb496 None admin] PATH_INFO: `/v3/domains` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:20.792102 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fb956a-90fd-47cd-bc88-60690c7fb496 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:21:20.792432 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fb956a-90fd-47cd-bc88-60690c7fb496 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:20.793792 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fb956a-90fd-47cd-bc88-60690c7fb496 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:20.800729 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11abb773-e756-4b5c-b1e6-a8024fd976bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:20.801847 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11abb773-e756-4b5c-b1e6-a8024fd976bf None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:20.802130 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11abb773-e756-4b5c-b1e6-a8024fd976bf None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:20.802428 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11abb773-e756-4b5c-b1e6-a8024fd976bf None admin] PATH_INFO: `/v3/endpoints` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:20.803578 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11abb773-e756-4b5c-b1e6-a8024fd976bf None admin] RBAC: Adding query filter params (interface=admin, service_id=92c37dae29634c579b4a68d2bc68279a, region_id=RegionOne) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:21:20.803960 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11abb773-e756-4b5c-b1e6-a8024fd976bf None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:20.805302 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11abb773-e756-4b5c-b1e6-a8024fd976bf None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:20.806164 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 487/979] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 24 11:21:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:21:20.811067 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 493/980] 10.222.0.27 () {56 vars in 1249 bytes} [Wed Aug 24 11:21:20 2022] GET /identity/v3/endpoints?service_id=92c37dae29634c579b4a68d2bc68279a&interface=admin®ion_id=RegionOne => generated 193 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:21:20.811659 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fb956a-90fd-47cd-bc88-60690c7fb496 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:20.816709 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11abb773-e756-4b5c-b1e6-a8024fd976bf None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:20.826726 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:20.891925 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:20.919172 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fb956a-90fd-47cd-bc88-60690c7fb496 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:20.926521 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11abb773-e756-4b5c-b1e6-a8024fd976bf None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:20.954987 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7903e88c-5aee-456a-b29e-ea6092a24731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:20.955645 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7903e88c-5aee-456a-b29e-ea6092a24731 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:20.955934 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7903e88c-5aee-456a-b29e-ea6092a24731 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:20.956262 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7903e88c-5aee-456a-b29e-ea6092a24731 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:20.963859 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7903e88c-5aee-456a-b29e-ea6092a24731 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:20.965318 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7903e88c-5aee-456a-b29e-ea6092a24731 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:20.966286 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e73696-12e6-4435-a6f3-ddb55ab2598a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:20.967185 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e73696-12e6-4435-a6f3-ddb55ab2598a None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:20.967726 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e73696-12e6-4435-a6f3-ddb55ab2598a None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:20.967995 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e73696-12e6-4435-a6f3-ddb55ab2598a None admin] PATH_INFO: `/v3/services` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:20.968609 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e73696-12e6-4435-a6f3-ddb55ab2598a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:20.969996 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e73696-12e6-4435-a6f3-ddb55ab2598a None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:20.976648 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-7903e88c-5aee-456a-b29e-ea6092a24731 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 11:21:20.976648 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:21:20.976648 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:21:20.976648 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:21:20.976648 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:21:20.976648 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:21:20.976648 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:21:20.976648 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:21:20.976648 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:21:20.976648 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:21:20.976648 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:21:20.976648 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:21:20.976648 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 11:21:20.976648 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 11:21:20.976648 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 11:21:20.976648 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 11:21:20.977599 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:21:20.977599 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:21:20.977599 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 11:21:20.977599 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 11:21:20.977599 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 11:21:20.977599 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 11:21:20.977599 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:21:20.977599 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:21:20.977599 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:21:20.977599 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:21:20.977599 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:21:20.977599 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Aug 24 11:21:20.977599 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:21:20.977599 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:21:20.977599 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:21:20.977599 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:21:20.977599 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:21:20.977599 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:21:20.983979 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:21:20.983979 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:21:20.983979 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 11:21:20.983979 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 11:21:20.983979 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 11:21:20.983979 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 11:21:20.983979 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 11:21:20.983979 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 11:21:20.983979 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 11:21:20.983979 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Aug 24 11:21:20.984667 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 494/981] 10.222.0.27 () {56 vars in 1087 bytes} [Wed Aug 24 11:21:20 2022] GET /identity/v3/services => generated 1727 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 11:21:20.984762 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 488/982] 10.222.0.27 () {56 vars in 1117 bytes} [Wed Aug 24 11:21:20 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 11:21:20.986320 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e73696-12e6-4435-a6f3-ddb55ab2598a None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:21.067993 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:21.106584 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e73696-12e6-4435-a6f3-ddb55ab2598a None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:21.144785 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15097f3-ad5a-437f-a36f-9ebb12086205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:21.145810 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15097f3-ad5a-437f-a36f-9ebb12086205 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:21.146281 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15097f3-ad5a-437f-a36f-9ebb12086205 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:21.146748 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15097f3-ad5a-437f-a36f-9ebb12086205 None admin] PATH_INFO: `/v3/users` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:21.147710 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15097f3-ad5a-437f-a36f-9ebb12086205 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:21:21.148168 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15097f3-ad5a-437f-a36f-9ebb12086205 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:21.149790 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15097f3-ad5a-437f-a36f-9ebb12086205 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:21.168941 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 495/983] 10.222.0.27 () {56 vars in 1149 bytes} [Wed Aug 24 11:21:20 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:21:21.174796 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7903e88c-5aee-456a-b29e-ea6092a24731 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:21.277728 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7903e88c-5aee-456a-b29e-ea6092a24731 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:21.322701 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594a357a-3fe3-4879-8ff5-4f879b9edfa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:21.323326 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594a357a-3fe3-4879-8ff5-4f879b9edfa4 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:21.323610 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594a357a-3fe3-4879-8ff5-4f879b9edfa4 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:21.323845 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594a357a-3fe3-4879-8ff5-4f879b9edfa4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:21.326774 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:21.396059 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594a357a-3fe3-4879-8ff5-4f879b9edfa4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:21.397804 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594a357a-3fe3-4879-8ff5-4f879b9edfa4 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:21.496943 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 489/984] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 24 11:21:21 2022] GET /identity/v3/auth/tokens => generated 1570 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 11:21:21.502658 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15097f3-ad5a-437f-a36f-9ebb12086205 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:21.612348 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15097f3-ad5a-437f-a36f-9ebb12086205 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:21.640208 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:21.649708 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db0213f-3024-4aba-b3e0-1c4b3c73bec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:21.650278 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db0213f-3024-4aba-b3e0-1c4b3c73bec7 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:21.650580 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db0213f-3024-4aba-b3e0-1c4b3c73bec7 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:21.650849 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db0213f-3024-4aba-b3e0-1c4b3c73bec7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:21.661330 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db0213f-3024-4aba-b3e0-1c4b3c73bec7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:21.662845 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db0213f-3024-4aba-b3e0-1c4b3c73bec7 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:21.677250 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-2db0213f-3024-4aba-b3e0-1c4b3c73bec7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:21:21.677250 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:21:21.677250 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:21:21.677250 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:21:21.677250 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:21:21.677250 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:21:21.677250 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:21:21.677250 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:21:21.677250 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:21:21.677250 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:21:21.677250 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:21:21.677250 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:21:21.677250 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 11:21:21.677250 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 11:21:21.677250 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 11:21:21.677250 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 11:21:21.678213 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:21:21.678213 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:21:21.678213 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:21:21.678213 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:21:21.678213 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:21:21.678213 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:21:21.678213 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:21:21.678213 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Aug 24 11:21:21.678213 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:21:21.678213 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:21:21.678213 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:21:21.678213 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:21:21.678213 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:21:21.678213 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:21:21.678213 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:21:21.678213 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:21:21.678213 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 11:21:21.684409 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 11:21:21.684409 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:21:21.684409 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:21:21.684409 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 496/985] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 11:21:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:21:21.685830 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594a357a-3fe3-4879-8ff5-4f879b9edfa4 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:21.722398 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:21.791131 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594a357a-3fe3-4879-8ff5-4f879b9edfa4 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:21.825812 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c18df9-55ec-49fe-8b1b-2adbcbbba51f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:21.826446 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c18df9-55ec-49fe-8b1b-2adbcbbba51f None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:21.826729 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c18df9-55ec-49fe-8b1b-2adbcbbba51f None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:21.827001 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c18df9-55ec-49fe-8b1b-2adbcbbba51f None admin] PATH_INFO: `/v3/domains` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:21.827673 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c18df9-55ec-49fe-8b1b-2adbcbbba51f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:21:21.827972 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c18df9-55ec-49fe-8b1b-2adbcbbba51f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:21.829359 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c18df9-55ec-49fe-8b1b-2adbcbbba51f None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:21.841105 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 490/986] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 24 11:21:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:21:21.846660 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db0213f-3024-4aba-b3e0-1c4b3c73bec7 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:21.947640 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db0213f-3024-4aba-b3e0-1c4b3c73bec7 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:21.981242 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2638fe49-cf92-4a3f-94ce-7990864e0ab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:21.981879 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2638fe49-cf92-4a3f-94ce-7990864e0ab0 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:21.982158 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2638fe49-cf92-4a3f-94ce-7990864e0ab0 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:21.982514 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2638fe49-cf92-4a3f-94ce-7990864e0ab0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:21.989339 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2638fe49-cf92-4a3f-94ce-7990864e0ab0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:21.990843 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2638fe49-cf92-4a3f-94ce-7990864e0ab0 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:22.001969 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-2638fe49-cf92-4a3f-94ce-7990864e0ab0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 11:21:22.001969 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:21:22.001969 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:21:22.001969 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:21:22.001969 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:21:22.001969 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:21:22.001969 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:21:22.001969 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:21:22.001969 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:21:22.001969 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:21:22.001969 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:21:22.001969 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:21:22.001969 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 11:21:22.001969 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 11:21:22.001969 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 11:21:22.002885 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 11:21:22.002885 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:21:22.002885 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:21:22.002885 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:21:22.002885 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:21:22.002885 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:21:22.002885 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:21:22.002885 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:21:22.002885 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Aug 24 11:21:22.002885 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:21:22.002885 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:21:22.002885 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:21:22.002885 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:21:22.002885 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:21:22.002885 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:21:22.002885 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:21:22.002885 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:21:22.004512 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 11:21:22.004512 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 11:21:22.004512 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 11:21:22.004512 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 11:21:22.004512 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 11:21:22.004512 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 11:21:22.004512 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 11:21:22.004512 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:21:22.004512 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 497/987] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Aug 24 11:21:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:21:22.009574 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c18df9-55ec-49fe-8b1b-2adbcbbba51f None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:22.116323 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:22.124448 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c18df9-55ec-49fe-8b1b-2adbcbbba51f None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:22.160660 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642ceaa8-a211-46c1-98e9-723496b277a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:22.161271 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642ceaa8-a211-46c1-98e9-723496b277a1 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:22.161551 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642ceaa8-a211-46c1-98e9-723496b277a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:22.161822 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642ceaa8-a211-46c1-98e9-723496b277a1 None admin] PATH_INFO: `/v3/projects` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:22.162549 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642ceaa8-a211-46c1-98e9-723496b277a1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:21:22.162858 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642ceaa8-a211-46c1-98e9-723496b277a1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:22.164287 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642ceaa8-a211-46c1-98e9-723496b277a1 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:22.177227 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 491/988] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Aug 24 11:21:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:21:22.183248 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2638fe49-cf92-4a3f-94ce-7990864e0ab0 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:22.201404 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460c4d4e-a595-44c3-9295-7f21f00ead0b None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:22.201617 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460c4d4e-a595-44c3-9295-7f21f00ead0b None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:22.201887 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460c4d4e-a595-44c3-9295-7f21f00ead0b None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:22.206400 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 492/989] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:21:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:21:22.208598 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbb24dd-7e0e-45d7-85aa-4d5d5e9f8088 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:22.208885 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbb24dd-7e0e-45d7-85aa-4d5d5e9f8088 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:22.209158 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbb24dd-7e0e-45d7-85aa-4d5d5e9f8088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:22.227554 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-1fbb24dd-7e0e-45d7-85aa-4d5d5e9f8088 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:21:22.228881 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-1fbb24dd-7e0e-45d7-85aa-4d5d5e9f8088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:21:22.231861 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:22.298871 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2638fe49-cf92-4a3f-94ce-7990864e0ab0 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:22.304427 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 493/990] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:21:22 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 11:21:22.334827 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1f2b46-5712-49aa-a4f6-4be30668310d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:22.335461 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1f2b46-5712-49aa-a4f6-4be30668310d None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:22.335743 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1f2b46-5712-49aa-a4f6-4be30668310d None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:22.336062 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1f2b46-5712-49aa-a4f6-4be30668310d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:22.336789 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1f2b46-5712-49aa-a4f6-4be30668310d None admin] RBAC: Adding query filter params (role.id=e59237603afa477fbb6954564862fa4a, scope.project.id=317f54a463cb48ab86648c6dcec5db0f, user.id=a5915030f01941fc89f92228ff57c7f0) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:21:22.337089 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1f2b46-5712-49aa-a4f6-4be30668310d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:22.338561 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1f2b46-5712-49aa-a4f6-4be30668310d None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:22.354654 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 498/991] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Aug 24 11:21:22 2022] GET /identity/v3/role_assignments?user.id=a5915030f01941fc89f92228ff57c7f0&scope.project.id=317f54a463cb48ab86648c6dcec5db0f&role.id=e59237603afa477fbb6954564862fa4a => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:21:22.574401 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbb24dd-7e0e-45d7-85aa-4d5d5e9f8088 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:22.663836 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:22.681399 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbb24dd-7e0e-45d7-85aa-4d5d5e9f8088 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:22.724960 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765ab838-a96f-4a4e-82f7-de0852a32d98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:22.726517 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765ab838-a96f-4a4e-82f7-de0852a32d98 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:22.727018 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765ab838-a96f-4a4e-82f7-de0852a32d98 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:22.727491 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765ab838-a96f-4a4e-82f7-de0852a32d98 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:22.728300 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765ab838-a96f-4a4e-82f7-de0852a32d98 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:22.729880 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765ab838-a96f-4a4e-82f7-de0852a32d98 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:22.748948 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-765ab838-a96f-4a4e-82f7-de0852a32d98 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 11:21:22.748948 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:21:22.748948 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 11:21:22.748948 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 11:21:22.748948 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 11:21:22.748948 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 11:21:22.748948 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 11:21:22.748948 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 11:21:22.748948 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 11:21:22.748948 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Aug 24 11:21:22.748948 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 11:21:22.748948 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Aug 24 11:21:22.748948 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:21:22.748948 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:21:22.748948 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:21:22.748948 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:21:22.748948 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:21:22.750083 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:21:22.750083 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:21:22.750083 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:21:22.750083 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:21:22.750083 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:21:22.750083 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:21:22.750083 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 11:21:22.750083 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 11:21:22.750083 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 11:21:22.750083 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 11:21:22.750083 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:21:22.750083 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:21:22.750083 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:21:22.750083 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:21:22.750083 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:21:22.750083 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:21:22.751396 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:21:22.751396 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Aug 24 11:21:22.751396 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:21:22.751396 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:21:22.751396 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:21:22.751396 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:21:22.751396 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:21:22.751396 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:21:22.751396 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:21:22.751396 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:21:22.751396 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 11:21:22.751396 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 11:21:22.751396 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 11:21:22.751396 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Aug 24 11:21:22.764726 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 494/992] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Aug 24 11:21:22 2022] GET /identity/v3/services/compute => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:21:22.765850 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1f2b46-5712-49aa-a4f6-4be30668310d None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:22.874114 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575560f7-a2ec-4587-9e30-f7b35b403dc4 None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:22.874295 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575560f7-a2ec-4587-9e30-f7b35b403dc4 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:22.874729 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575560f7-a2ec-4587-9e30-f7b35b403dc4 None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:22.876574 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1f2b46-5712-49aa-a4f6-4be30668310d None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:22.879448 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:22.880346 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 495/993] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:21:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 11:21:22.882089 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce9bb93-6b4f-4e1e-a405-2302834918fa None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:22.882383 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce9bb93-6b4f-4e1e-a405-2302834918fa None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:22.882675 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce9bb93-6b4f-4e1e-a405-2302834918fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:22.900975 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-3ce9bb93-6b4f-4e1e-a405-2302834918fa None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:21:22.902554 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-3ce9bb93-6b4f-4e1e-a405-2302834918fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:21:22.924034 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765265d7-2614-48ec-9d71-2a82a957b175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:22.924660 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765265d7-2614-48ec-9d71-2a82a957b175 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:22.925036 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765265d7-2614-48ec-9d71-2a82a957b175 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:22.925317 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765265d7-2614-48ec-9d71-2a82a957b175 None admin] PATH_INFO: `/v3/services` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:22.926257 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765265d7-2614-48ec-9d71-2a82a957b175 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:21:22.926662 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765265d7-2614-48ec-9d71-2a82a957b175 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:22.928473 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765265d7-2614-48ec-9d71-2a82a957b175 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:22.939713 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 499/994] 10.222.0.27 () {56 vars in 1112 bytes} [Wed Aug 24 11:21:22 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:21:22.940775 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765265d7-2614-48ec-9d71-2a82a957b175 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:23.006803 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 496/995] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:21:22 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 11:21:23.056810 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765265d7-2614-48ec-9d71-2a82a957b175 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:23.092804 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3772b36f-da46-490d-a530-535809a101eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:23.093487 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3772b36f-da46-490d-a530-535809a101eb None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:23.093794 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3772b36f-da46-490d-a530-535809a101eb None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:23.094063 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3772b36f-da46-490d-a530-535809a101eb None admin] PATH_INFO: `/v3/services` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:23.094813 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3772b36f-da46-490d-a530-535809a101eb None admin] RBAC: Adding query filter params (type=compute) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:21:23.095121 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3772b36f-da46-490d-a530-535809a101eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:23.096865 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3772b36f-da46-490d-a530-535809a101eb None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:23.108876 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 500/996] 10.222.0.27 () {56 vars in 1112 bytes} [Wed Aug 24 11:21:22 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:21:23.116793 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce9bb93-6b4f-4e1e-a405-2302834918fa None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:23.200090 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:23.223998 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce9bb93-6b4f-4e1e-a405-2302834918fa None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:23.258926 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a42ef0c-a66c-4731-a4a7-b3a7b837e11a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:23.259530 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a42ef0c-a66c-4731-a4a7-b3a7b837e11a None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:23.259802 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a42ef0c-a66c-4731-a4a7-b3a7b837e11a None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:23.260066 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a42ef0c-a66c-4731-a4a7-b3a7b837e11a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:23.260768 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a42ef0c-a66c-4731-a4a7-b3a7b837e11a None admin] RBAC: Adding query filter params (interface=public, service_id=0840c07130354d559b37b8f69e0e97bc, region_id=RegionOne) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:21:23.261143 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a42ef0c-a66c-4731-a4a7-b3a7b837e11a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:23.262368 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3772b36f-da46-490d-a530-535809a101eb None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:23.262548 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a42ef0c-a66c-4731-a4a7-b3a7b837e11a None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:23.269010 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 497/997] 10.222.0.27 () {56 vars in 1251 bytes} [Wed Aug 24 11:21:23 2022] GET /identity/v3/endpoints?service_id=0840c07130354d559b37b8f69e0e97bc&interface=public®ion_id=RegionOne => generated 194 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:21:23.274310 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a42ef0c-a66c-4731-a4a7-b3a7b837e11a None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:23.298963 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:23.372587 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3772b36f-da46-490d-a530-535809a101eb None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:23.385953 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a42ef0c-a66c-4731-a4a7-b3a7b837e11a None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:23.411002 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428ec78b-3983-4f45-8c2f-e1d0c9d1da2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:23.411982 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428ec78b-3983-4f45-8c2f-e1d0c9d1da2f None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:23.412477 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428ec78b-3983-4f45-8c2f-e1d0c9d1da2f None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:23.413020 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428ec78b-3983-4f45-8c2f-e1d0c9d1da2f None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:23.413897 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428ec78b-3983-4f45-8c2f-e1d0c9d1da2f None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:23.415660 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428ec78b-3983-4f45-8c2f-e1d0c9d1da2f None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:23.422114 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42f095e-ba46-4bfc-8db0-edcd35d7706c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:23.422750 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42f095e-ba46-4bfc-8db0-edcd35d7706c None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:23.423005 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42f095e-ba46-4bfc-8db0-edcd35d7706c None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:23.423298 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42f095e-ba46-4bfc-8db0-edcd35d7706c None admin] PATH_INFO: `/v3/services` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:23.423901 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42f095e-ba46-4bfc-8db0-edcd35d7706c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:23.424953 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-428ec78b-3983-4f45-8c2f-e1d0c9d1da2f None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 11:21:23.424953 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:21:23.424953 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 11:21:23.424953 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 11:21:23.424953 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 11:21:23.424953 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 11:21:23.424953 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 11:21:23.424953 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 11:21:23.424953 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 11:21:23.424953 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:21:23.424953 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 11:21:23.424953 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:21:23.424953 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:21:23.424953 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:21:23.424953 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:21:23.424953 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:21:23.424953 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:21:23.426018 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:21:23.426018 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:21:23.426018 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:21:23.426018 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:21:23.426018 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:21:23.426018 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:21:23.426018 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 11:21:23.426018 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 11:21:23.426018 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 11:21:23.426018 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 11:21:23.426018 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:21:23.426018 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:21:23.426018 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:21:23.426018 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:21:23.426018 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:21:23.426018 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:21:23.431683 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:21:23.431683 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Aug 24 11:21:23.431683 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:21:23.431683 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:21:23.431683 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:21:23.431683 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:21:23.431683 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:21:23.431683 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:21:23.431683 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:21:23.431683 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:21:23.431683 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 11:21:23.431683 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 11:21:23.431683 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 11:21:23.431683 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:21:23.432594 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42f095e-ba46-4bfc-8db0-edcd35d7706c None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:23.432683 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 501/998] 10.222.0.27 () {56 vars in 1126 bytes} [Wed Aug 24 11:21:23 2022] GET /identity/v3/services/object-store => generated 93 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:21:23.433949 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428ec78b-3983-4f45-8c2f-e1d0c9d1da2f None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:23.442764 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 498/999] 10.222.0.27 () {56 vars in 1087 bytes} [Wed Aug 24 11:21:23 2022] GET /identity/v3/services => generated 1727 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 11:21:23.546935 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:23.554770 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428ec78b-3983-4f45-8c2f-e1d0c9d1da2f None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:23.593277 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5600fead-87e2-47c7-992e-3786cc503489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:23.593890 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5600fead-87e2-47c7-992e-3786cc503489 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:23.594164 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5600fead-87e2-47c7-992e-3786cc503489 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:23.594472 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5600fead-87e2-47c7-992e-3786cc503489 None admin] PATH_INFO: `/v3/services` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:23.595123 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5600fead-87e2-47c7-992e-3786cc503489 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:21:23.595417 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5600fead-87e2-47c7-992e-3786cc503489 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:23.596936 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5600fead-87e2-47c7-992e-3786cc503489 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:23.601724 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 502/1000] 10.222.0.27 () {56 vars in 1122 bytes} [Wed Aug 24 11:21:23 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:21:23.607671 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42f095e-ba46-4bfc-8db0-edcd35d7706c None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:23.617294 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:23.710244 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42f095e-ba46-4bfc-8db0-edcd35d7706c None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:23.745745 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e0325a-6e13-42ee-808a-61a7bbd62ce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:23.746557 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e0325a-6e13-42ee-808a-61a7bbd62ce6 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:23.746652 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e0325a-6e13-42ee-808a-61a7bbd62ce6 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:23.746892 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e0325a-6e13-42ee-808a-61a7bbd62ce6 None admin] PATH_INFO: `/v3/services` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:23.747538 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e0325a-6e13-42ee-808a-61a7bbd62ce6 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:21:23.747835 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e0325a-6e13-42ee-808a-61a7bbd62ce6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:23.749214 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e0325a-6e13-42ee-808a-61a7bbd62ce6 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:23.754452 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 499/1001] 10.222.0.27 () {56 vars in 1122 bytes} [Wed Aug 24 11:21:23 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:21:23.760370 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5600fead-87e2-47c7-992e-3786cc503489 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:23.859155 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5600fead-87e2-47c7-992e-3786cc503489 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:23.894165 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399a8a28-07f4-4825-b375-50dac01e533a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:23.894813 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399a8a28-07f4-4825-b375-50dac01e533a None admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:23.895083 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399a8a28-07f4-4825-b375-50dac01e533a None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:23.895312 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399a8a28-07f4-4825-b375-50dac01e533a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:23.895999 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399a8a28-07f4-4825-b375-50dac01e533a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:23.897368 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399a8a28-07f4-4825-b375-50dac01e533a None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:23.916449 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 503/1002] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 11:21:23 2022] POST /identity/v3/endpoints => generated 325 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:21:24.307388 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6e8acf-b0d3-4dc5-add1-646cd9f234bc None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:24.307649 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6e8acf-b0d3-4dc5-add1-646cd9f234bc None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:24.307915 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6e8acf-b0d3-4dc5-add1-646cd9f234bc None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:24.309249 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 500/1003] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:21:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:21:24.314887 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d6257e-7fa6-4f23-82f9-cae1fc0dadae None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:24.315186 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d6257e-7fa6-4f23-82f9-cae1fc0dadae None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:24.315556 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d6257e-7fa6-4f23-82f9-cae1fc0dadae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:24.334651 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-a9d6257e-7fa6-4f23-82f9-cae1fc0dadae None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:21:24.335912 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-a9d6257e-7fa6-4f23-82f9-cae1fc0dadae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:21:24.351318 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:24.414516 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 504/1004] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:21:24 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 11:21:24.679652 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6e8acf-b0d3-4dc5-add1-646cd9f234bc None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:24.783326 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:24.840059 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6e8acf-b0d3-4dc5-add1-646cd9f234bc None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:24.898298 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1638b0d-af1c-42c0-9df0-53cf59443498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:24.899372 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1638b0d-af1c-42c0-9df0-53cf59443498 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:24.899853 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1638b0d-af1c-42c0-9df0-53cf59443498 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:24.900322 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1638b0d-af1c-42c0-9df0-53cf59443498 None admin] PATH_INFO: `/v3/services/image` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:24.901708 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1638b0d-af1c-42c0-9df0-53cf59443498 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:24.904264 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1638b0d-af1c-42c0-9df0-53cf59443498 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:24.920790 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-e1638b0d-af1c-42c0-9df0-53cf59443498 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 11:21:24.920790 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:21:24.920790 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 11:21:24.920790 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 11:21:24.920790 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 11:21:24.920790 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 11:21:24.920790 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 11:21:24.920790 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 11:21:24.920790 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 11:21:24.920790 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Aug 24 11:21:24.920790 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 11:21:24.920790 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Aug 24 11:21:24.920790 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:21:24.920790 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:21:24.920790 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:21:24.920790 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:21:24.920790 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:21:24.921905 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:21:24.921905 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:21:24.921905 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:21:24.921905 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:21:24.921905 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:21:24.921905 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:21:24.921905 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 11:21:24.921905 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 11:21:24.921905 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 11:21:24.921905 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 11:21:24.921905 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:21:24.921905 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:21:24.921905 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:21:24.921905 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:21:24.921905 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:21:24.921905 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:21:24.922809 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:21:24.922809 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Aug 24 11:21:24.922809 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:21:24.922809 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:21:24.922809 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:21:24.922809 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:21:24.922809 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:21:24.922809 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:21:24.922809 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:21:24.922809 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:21:24.922809 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 11:21:24.922809 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 11:21:24.922809 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 11:21:24.922809 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Aug 24 11:21:24.924290 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 501/1005] 10.222.0.27 () {56 vars in 1105 bytes} [Wed Aug 24 11:21:24 2022] GET /identity/v3/services/image => generated 86 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:21:24.931713 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d6257e-7fa6-4f23-82f9-cae1fc0dadae None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:25.058100 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d6257e-7fa6-4f23-82f9-cae1fc0dadae None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:25.094045 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed901e7b-19b1-44c4-ba66-6174c171e212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:25.094691 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed901e7b-19b1-44c4-ba66-6174c171e212 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:25.094971 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed901e7b-19b1-44c4-ba66-6174c171e212 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:25.095251 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed901e7b-19b1-44c4-ba66-6174c171e212 None admin] PATH_INFO: `/v3/services` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:25.095906 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed901e7b-19b1-44c4-ba66-6174c171e212 None admin] RBAC: Adding query filter params (name=image) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:21:25.096212 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed901e7b-19b1-44c4-ba66-6174c171e212 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:25.097782 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed901e7b-19b1-44c4-ba66-6174c171e212 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:25.110029 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 505/1006] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 11:21:24 2022] GET /identity/v3/services?name=image => generated 122 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:21:25.116545 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1638b0d-af1c-42c0-9df0-53cf59443498 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:25.219611 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1638b0d-af1c-42c0-9df0-53cf59443498 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:25.255106 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b6c405-28c6-46d4-994c-af1c7992fe7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:25.255728 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b6c405-28c6-46d4-994c-af1c7992fe7e None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:25.256003 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b6c405-28c6-46d4-994c-af1c7992fe7e None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:25.256269 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b6c405-28c6-46d4-994c-af1c7992fe7e None admin] PATH_INFO: `/v3/services` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:25.256904 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b6c405-28c6-46d4-994c-af1c7992fe7e None admin] RBAC: Adding query filter params (type=image) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:21:25.257199 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b6c405-28c6-46d4-994c-af1c7992fe7e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:25.258614 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b6c405-28c6-46d4-994c-af1c7992fe7e None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:25.259877 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:25.265694 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 502/1007] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 11:21:25 2022] GET /identity/v3/services?type=image => generated 122 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:21:25.456331 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6934cd41-455f-4b6a-8251-d41ed6751a27 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:25.456635 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6934cd41-455f-4b6a-8251-d41ed6751a27 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:25.456998 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6934cd41-455f-4b6a-8251-d41ed6751a27 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:25.458451 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 506/1008] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:21:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:21:25.463877 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5ef153-4b83-4f94-93df-4f2b8d53259d None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:25.464136 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5ef153-4b83-4f94-93df-4f2b8d53259d None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:25.464434 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5ef153-4b83-4f94-93df-4f2b8d53259d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:25.483983 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-5e5ef153-4b83-4f94-93df-4f2b8d53259d None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:21:25.485129 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-5e5ef153-4b83-4f94-93df-4f2b8d53259d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:21:25.555919 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 503/1009] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:21:25 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 11:21:25.808041 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c8adf5-527c-410e-b9ab-56bcda2fc7d5 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:25.808252 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c8adf5-527c-410e-b9ab-56bcda2fc7d5 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:25.808524 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c8adf5-527c-410e-b9ab-56bcda2fc7d5 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:25.810000 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 507/1010] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:21:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:21:25.815182 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfa7dbe-15f7-4e66-b4a3-65973c89ad35 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:25.815782 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfa7dbe-15f7-4e66-b4a3-65973c89ad35 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:25.815782 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfa7dbe-15f7-4e66-b4a3-65973c89ad35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:25.818929 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c8adf5-527c-410e-b9ab-56bcda2fc7d5 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:25.831524 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:25.834865 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-4bfa7dbe-15f7-4e66-b4a3-65973c89ad35 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:21:25.836419 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-4bfa7dbe-15f7-4e66-b4a3-65973c89ad35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:21:25.908432 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 504/1011] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:21:25 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 11:21:25.927119 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c8adf5-527c-410e-b9ab-56bcda2fc7d5 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:25.962186 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058bf8d3-3138-41e6-a9e4-702505534fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:25.962826 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058bf8d3-3138-41e6-a9e4-702505534fde None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:25.963079 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058bf8d3-3138-41e6-a9e4-702505534fde None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:25.963435 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058bf8d3-3138-41e6-a9e4-702505534fde None admin] PATH_INFO: `/v3/services/compute` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:25.964033 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058bf8d3-3138-41e6-a9e4-702505534fde None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:25.965479 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058bf8d3-3138-41e6-a9e4-702505534fde None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:25.974577 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-058bf8d3-3138-41e6-a9e4-702505534fde None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 11:21:25.974577 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:21:25.974577 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 11:21:25.974577 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 11:21:25.974577 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 11:21:25.974577 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 11:21:25.974577 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 11:21:25.974577 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 11:21:25.974577 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 11:21:25.974577 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:21:25.974577 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 11:21:25.974577 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:21:25.974577 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:21:25.974577 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:21:25.974577 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:21:25.974577 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:21:25.974577 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:21:25.975690 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:21:25.975690 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:21:25.975690 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:21:25.975690 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:21:25.975690 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:21:25.975690 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:21:25.975690 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 11:21:25.975690 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 11:21:25.975690 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 11:21:25.975690 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 11:21:25.975690 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:21:25.975690 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:21:25.975690 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:21:25.975690 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:21:25.975690 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:21:25.975690 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:21:25.976541 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:21:25.976541 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Aug 24 11:21:25.976541 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:21:25.976541 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:21:25.976541 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:21:25.976541 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:21:25.976541 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:21:25.976541 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:21:25.976541 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:21:25.976541 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:21:25.976541 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 11:21:25.976541 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 11:21:25.976541 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 11:21:25.976541 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:21:25.976541 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 508/1012] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Aug 24 11:21:25 2022] GET /identity/v3/services/compute => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 11:21:25.981699 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfa7dbe-15f7-4e66-b4a3-65973c89ad35 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:26.044068 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:26.093020 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfa7dbe-15f7-4e66-b4a3-65973c89ad35 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:26.137317 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca8ed04-359a-4876-90d4-834e610944bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:26.137964 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca8ed04-359a-4876-90d4-834e610944bf None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:26.138239 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca8ed04-359a-4876-90d4-834e610944bf None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:26.138541 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca8ed04-359a-4876-90d4-834e610944bf None admin] PATH_INFO: `/v3/services` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:26.139182 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca8ed04-359a-4876-90d4-834e610944bf None admin] RBAC: Adding query filter params (name=compute) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:21:26.139478 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca8ed04-359a-4876-90d4-834e610944bf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:26.140877 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca8ed04-359a-4876-90d4-834e610944bf None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:26.145999 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 505/1013] 10.222.0.27 () {56 vars in 1112 bytes} [Wed Aug 24 11:21:25 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:21:26.152173 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058bf8d3-3138-41e6-a9e4-702505534fde None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:26.176268 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca8ed04-359a-4876-90d4-834e610944bf None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:26.232008 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:26.260435 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058bf8d3-3138-41e6-a9e4-702505534fde None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:26.282309 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca8ed04-359a-4876-90d4-834e610944bf None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:26.297164 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3179674a-1023-4234-9ccb-89c17dd92346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:26.297787 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3179674a-1023-4234-9ccb-89c17dd92346 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:26.298066 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3179674a-1023-4234-9ccb-89c17dd92346 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:26.298330 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3179674a-1023-4234-9ccb-89c17dd92346 None admin] PATH_INFO: `/v3/services` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:26.298992 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3179674a-1023-4234-9ccb-89c17dd92346 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:21:26.299293 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3179674a-1023-4234-9ccb-89c17dd92346 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:26.300827 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3179674a-1023-4234-9ccb-89c17dd92346 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:26.305849 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 509/1014] 10.222.0.27 () {56 vars in 1112 bytes} [Wed Aug 24 11:21:26 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:21:26.311508 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3179674a-1023-4234-9ccb-89c17dd92346 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:26.312406 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:26.325114 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cefa5c1-3bb3-4c2d-aa8c-54a5d015fd58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:26.325741 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cefa5c1-3bb3-4c2d-aa8c-54a5d015fd58 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:26.326008 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cefa5c1-3bb3-4c2d-aa8c-54a5d015fd58 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:26.326273 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cefa5c1-3bb3-4c2d-aa8c-54a5d015fd58 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:26.327411 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cefa5c1-3bb3-4c2d-aa8c-54a5d015fd58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:26.328848 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cefa5c1-3bb3-4c2d-aa8c-54a5d015fd58 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:26.330740 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 506/1015] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 11:21:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:21:26.336182 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cefa5c1-3bb3-4c2d-aa8c-54a5d015fd58 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:26.423843 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3179674a-1023-4234-9ccb-89c17dd92346 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:26.455836 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cefa5c1-3bb3-4c2d-aa8c-54a5d015fd58 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:26.458161 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069bd57e-2569-4484-a9e7-3eaeff048be0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:26.458804 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069bd57e-2569-4484-a9e7-3eaeff048be0 None admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:26.459081 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069bd57e-2569-4484-a9e7-3eaeff048be0 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:26.459352 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069bd57e-2569-4484-a9e7-3eaeff048be0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:26.460013 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069bd57e-2569-4484-a9e7-3eaeff048be0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:26.461423 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069bd57e-2569-4484-a9e7-3eaeff048be0 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:26.470083 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:26.484990 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 510/1016] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 11:21:26 2022] POST /identity/v3/endpoints => generated 334 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 11:21:26.503014 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8251bb52-d84e-4314-bd8f-7f63bc7d66d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:26.503763 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8251bb52-d84e-4314-bd8f-7f63bc7d66d0 None admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:26.504084 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8251bb52-d84e-4314-bd8f-7f63bc7d66d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:26.504416 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8251bb52-d84e-4314-bd8f-7f63bc7d66d0 None admin] PATH_INFO: `/v3/projects` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:26.505144 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8251bb52-d84e-4314-bd8f-7f63bc7d66d0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:26.506720 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8251bb52-d84e-4314-bd8f-7f63bc7d66d0 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:26.546386 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 507/1017] 10.222.0.27 () {60 vars in 1141 bytes} [Wed Aug 24 11:21:26 2022] POST /identity/v3/projects => generated 311 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 11:21:27.193802 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e41719-8582-4786-8d19-1c8bbe98a9c1 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:27.194420 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e41719-8582-4786-8d19-1c8bbe98a9c1 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:27.194420 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e41719-8582-4786-8d19-1c8bbe98a9c1 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:27.195683 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 511/1018] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:21:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:21:27.201247 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102eacc7-ef81-4e60-86a2-84886336d97a None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:27.201676 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102eacc7-ef81-4e60-86a2-84886336d97a None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:27.201753 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102eacc7-ef81-4e60-86a2-84886336d97a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:27.219932 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-102eacc7-ef81-4e60-86a2-84886336d97a None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:21:27.221107 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-102eacc7-ef81-4e60-86a2-84886336d97a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:21:27.251574 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:27.292267 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 508/1019] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:21:27 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 11:21:27.555112 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e41719-8582-4786-8d19-1c8bbe98a9c1 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:27.658505 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e41719-8582-4786-8d19-1c8bbe98a9c1 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:27.692123 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8944f817-a7f1-47b2-a90a-58606ba5581e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:27.692740 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8944f817-a7f1-47b2-a90a-58606ba5581e None admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:27.693020 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8944f817-a7f1-47b2-a90a-58606ba5581e None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:27.693299 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8944f817-a7f1-47b2-a90a-58606ba5581e None admin] PATH_INFO: `/v3/services` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:27.693959 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8944f817-a7f1-47b2-a90a-58606ba5581e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:27.695386 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8944f817-a7f1-47b2-a90a-58606ba5581e None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:27.712961 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 512/1020] 10.222.0.27 () {60 vars in 1141 bytes} [Wed Aug 24 11:21:27 2022] POST /identity/v3/services => generated 242 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 11:21:28.465705 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ab3f91-ae17-4d62-834a-f4b5b530fc51 None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:28.466235 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ab3f91-ae17-4d62-834a-f4b5b530fc51 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:28.466235 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ab3f91-ae17-4d62-834a-f4b5b530fc51 None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:28.467773 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 509/1021] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:21:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:21:28.472980 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bf860c-cab0-4d17-87e0-fc514cb58ec1 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:28.473403 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bf860c-cab0-4d17-87e0-fc514cb58ec1 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:28.473543 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bf860c-cab0-4d17-87e0-fc514cb58ec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:28.492628 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-98bf860c-cab0-4d17-87e0-fc514cb58ec1 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:21:28.493835 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-98bf860c-cab0-4d17-87e0-fc514cb58ec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:21:28.543956 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0813652-d98e-4e28-89b0-d35036425e01 None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:28.544301 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0813652-d98e-4e28-89b0-d35036425e01 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:28.544756 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0813652-d98e-4e28-89b0-d35036425e01 None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:28.546818 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 510/1022] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:21:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:21:28.552013 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0515e969-b099-4baa-8d8a-f7cf41e120f4 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:28.552522 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:28.553191 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0515e969-b099-4baa-8d8a-f7cf41e120f4 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:28.553542 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0515e969-b099-4baa-8d8a-f7cf41e120f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:28.573116 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-0515e969-b099-4baa-8d8a-f7cf41e120f4 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:21:28.574299 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-0515e969-b099-4baa-8d8a-f7cf41e120f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:21:28.580613 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 513/1023] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:21:28 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 11:21:28.640110 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 511/1024] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:21:28 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 11:21:28.839876 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bf860c-cab0-4d17-87e0-fc514cb58ec1 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:28.907004 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0515e969-b099-4baa-8d8a-f7cf41e120f4 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:28.939592 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bf860c-cab0-4d17-87e0-fc514cb58ec1 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:28.974770 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b668910-b5df-436b-a153-6a9f6abced5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:28.975395 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b668910-b5df-436b-a153-6a9f6abced5b None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:28.975667 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b668910-b5df-436b-a153-6a9f6abced5b None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:28.975932 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b668910-b5df-436b-a153-6a9f6abced5b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:28.986752 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b668910-b5df-436b-a153-6a9f6abced5b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:21:28.991423 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-5b668910-b5df-436b-a153-6a9f6abced5b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 11:21:28.991423 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:21:28.991423 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:21:28.991423 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:21:28.991423 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:21:28.991423 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:21:28.991423 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:21:28.991423 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:21:28.991423 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:21:28.991423 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:21:28.991423 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:21:28.991423 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:21:28.991423 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:21:28.991423 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:21:28.991423 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:21:28.991423 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:21:28.992368 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:21:28.992368 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:21:28.992368 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:21:28.992368 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:21:28.992368 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:21:28.992368 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:21:28.992368 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:21:28.992368 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:21:28.992368 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:21:28.992368 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:21:28.992368 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:21:28.992368 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Aug 24 11:21:28.992368 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:21:28.992368 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:21:28.992368 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:21:28.992368 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:21:28.993239 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:21:28.993239 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:21:28.993239 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:21:28.993239 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:21:28.993239 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:21:28.993239 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:21:28.993239 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:21:28.993239 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:21:28.993239 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:21:28.993239 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:21:28.993239 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 11:21:28.993239 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:21:28.993239 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 514/1025] 10.222.0.27 () {56 vars in 1120 bytes} [Wed Aug 24 11:21:28 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:21:28.998542 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b668910-b5df-436b-a153-6a9f6abced5b None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:29.007970 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:29.012103 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0515e969-b099-4baa-8d8a-f7cf41e120f4 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:29.045643 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:29.047699 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fb96af-a17d-4b5f-9d31-c314ec659040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:29.048463 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fb96af-a17d-4b5f-9d31-c314ec659040 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:29.048754 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fb96af-a17d-4b5f-9d31-c314ec659040 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:29.049023 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fb96af-a17d-4b5f-9d31-c314ec659040 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:29.050222 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fb96af-a17d-4b5f-9d31-c314ec659040 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:29.051687 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fb96af-a17d-4b5f-9d31-c314ec659040 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:29.054604 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 512/1026] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 11:21:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:21:29.058951 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fb96af-a17d-4b5f-9d31-c314ec659040 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:29.122636 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b668910-b5df-436b-a153-6a9f6abced5b None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:29.163038 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95768ed-dcbf-4f7a-8bc0-d3343abc97e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:29.163659 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95768ed-dcbf-4f7a-8bc0-d3343abc97e5 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:29.163950 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95768ed-dcbf-4f7a-8bc0-d3343abc97e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:29.164204 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95768ed-dcbf-4f7a-8bc0-d3343abc97e5 None admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:29.164873 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95768ed-dcbf-4f7a-8bc0-d3343abc97e5 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:21:29.165185 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95768ed-dcbf-4f7a-8bc0-d3343abc97e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:29.166590 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95768ed-dcbf-4f7a-8bc0-d3343abc97e5 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:29.169020 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fb96af-a17d-4b5f-9d31-c314ec659040 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:29.175196 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 515/1027] 10.222.0.27 () {56 vars in 1115 bytes} [Wed Aug 24 11:21:28 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:21:29.180685 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95768ed-dcbf-4f7a-8bc0-d3343abc97e5 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:29.206611 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fb202d-ba13-48ab-bdb9-7e88048ff7a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:29.207246 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fb202d-ba13-48ab-bdb9-7e88048ff7a8 None admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:29.207532 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fb202d-ba13-48ab-bdb9-7e88048ff7a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:29.207801 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fb202d-ba13-48ab-bdb9-7e88048ff7a8 None admin] PATH_INFO: `/v3/users` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:29.208442 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fb202d-ba13-48ab-bdb9-7e88048ff7a8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:29.209884 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fb202d-ba13-48ab-bdb9-7e88048ff7a8 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:29.233330 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 513/1028] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Aug 24 11:21:29 2022] POST /identity/v3/users => generated 285 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 11:21:29.301046 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95768ed-dcbf-4f7a-8bc0-d3343abc97e5 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:29.302873 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:29.339340 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b67363-ee7f-4c7c-8aab-7a65dd10ff88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:29.339984 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b67363-ee7f-4c7c-8aab-7a65dd10ff88 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:29.340258 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b67363-ee7f-4c7c-8aab-7a65dd10ff88 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:29.340526 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b67363-ee7f-4c7c-8aab-7a65dd10ff88 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:29.352714 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b67363-ee7f-4c7c-8aab-7a65dd10ff88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:29.354286 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b67363-ee7f-4c7c-8aab-7a65dd10ff88 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:29.369910 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-a3b67363-ee7f-4c7c-8aab-7a65dd10ff88 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:21:29.369910 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:21:29.369910 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:21:29.369910 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:21:29.369910 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:21:29.369910 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:21:29.369910 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:21:29.369910 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:21:29.369910 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:21:29.369910 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:21:29.369910 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:21:29.369910 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:21:29.369910 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 11:21:29.369910 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 11:21:29.369910 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 11:21:29.369910 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 11:21:29.371029 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:21:29.371029 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:21:29.371029 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:21:29.371029 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:21:29.371029 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:21:29.371029 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:21:29.371029 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:21:29.371029 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Aug 24 11:21:29.371029 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:21:29.371029 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:21:29.371029 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:21:29.371029 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:21:29.371029 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:21:29.371029 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:21:29.371029 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:21:29.371029 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:21:29.371029 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 11:21:29.371964 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 11:21:29.371964 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:21:29.371964 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:21:29.374726 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 516/1029] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 11:21:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 11:21:29.377038 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fb202d-ba13-48ab-bdb9-7e88048ff7a8 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:29.409663 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:29.491423 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fb202d-ba13-48ab-bdb9-7e88048ff7a8 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:29.525009 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ce7c25-586c-4edb-b0c9-c5b803679ec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:29.525620 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ce7c25-586c-4edb-b0c9-c5b803679ec9 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:29.525895 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ce7c25-586c-4edb-b0c9-c5b803679ec9 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:29.526546 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ce7c25-586c-4edb-b0c9-c5b803679ec9 None admin] PATH_INFO: `/v3/domains` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:29.527193 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ce7c25-586c-4edb-b0c9-c5b803679ec9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:21:29.527493 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ce7c25-586c-4edb-b0c9-c5b803679ec9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:29.528895 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ce7c25-586c-4edb-b0c9-c5b803679ec9 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:29.541252 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 514/1030] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 24 11:21:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:21:29.547112 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b67363-ee7f-4c7c-8aab-7a65dd10ff88 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:29.609120 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fd066f-1caf-4d06-ae26-0eab023e34ee None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:29.609326 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fd066f-1caf-4d06-ae26-0eab023e34ee None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:29.609569 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fd066f-1caf-4d06-ae26-0eab023e34ee None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:29.610943 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 515/1031] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:21:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 11:21:29.615884 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecbc32c-ecb9-4b74-b3e7-c85cf5c6ac30 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:29.616134 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecbc32c-ecb9-4b74-b3e7-c85cf5c6ac30 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:29.616420 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecbc32c-ecb9-4b74-b3e7-c85cf5c6ac30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:29.635931 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-9ecbc32c-ecb9-4b74-b3e7-c85cf5c6ac30 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:21:29.637106 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-9ecbc32c-ecb9-4b74-b3e7-c85cf5c6ac30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:21:29.657635 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b67363-ee7f-4c7c-8aab-7a65dd10ff88 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:29.694292 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e709da9c-9ba6-48b6-b722-2928d0e16bc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:29.694961 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e709da9c-9ba6-48b6-b722-2928d0e16bc1 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:29.695237 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e709da9c-9ba6-48b6-b722-2928d0e16bc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:29.695512 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e709da9c-9ba6-48b6-b722-2928d0e16bc1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:29.703198 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e709da9c-9ba6-48b6-b722-2928d0e16bc1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:29.704659 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e709da9c-9ba6-48b6-b722-2928d0e16bc1 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:29.705937 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 516/1032] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:21:29 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 11:21:29.716202 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-e709da9c-9ba6-48b6-b722-2928d0e16bc1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 11:21:29.716202 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:21:29.716202 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:21:29.716202 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:21:29.716202 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:21:29.716202 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:21:29.716202 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:21:29.716202 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:21:29.716202 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:21:29.716202 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:21:29.716202 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:21:29.716202 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:21:29.716202 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 11:21:29.716202 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 11:21:29.716202 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 11:21:29.716202 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 11:21:29.717183 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:21:29.717183 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:21:29.717183 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 11:21:29.717183 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 11:21:29.717183 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 11:21:29.717183 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 11:21:29.717183 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:21:29.717183 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:21:29.717183 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:21:29.717183 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:21:29.717183 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:21:29.717183 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Aug 24 11:21:29.717183 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:21:29.717183 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:21:29.717183 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:21:29.717183 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:21:29.717183 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:21:29.717183 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:21:29.718747 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:21:29.718747 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:21:29.718747 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 11:21:29.718747 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 11:21:29.718747 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 11:21:29.718747 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 11:21:29.718747 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 11:21:29.718747 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 11:21:29.718747 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 11:21:29.718747 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:21:29.722335 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 517/1033] 10.222.0.27 () {56 vars in 1093 bytes} [Wed Aug 24 11:21:29 2022] GET /identity/v3/users/nova => generated 82 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:21:29.723154 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecbc32c-ecb9-4b74-b3e7-c85cf5c6ac30 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:29.739165 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:29.829191 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecbc32c-ecb9-4b74-b3e7-c85cf5c6ac30 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:29.863608 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59dc3f8-6a2b-43e0-bb07-9e7a1816d6a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:29.864133 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59dc3f8-6a2b-43e0-bb07-9e7a1816d6a3 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:29.864407 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59dc3f8-6a2b-43e0-bb07-9e7a1816d6a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:29.864673 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59dc3f8-6a2b-43e0-bb07-9e7a1816d6a3 None admin] PATH_INFO: `/v3/users` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:29.865455 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59dc3f8-6a2b-43e0-bb07-9e7a1816d6a3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:21:29.865756 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59dc3f8-6a2b-43e0-bb07-9e7a1816d6a3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:29.867222 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59dc3f8-6a2b-43e0-bb07-9e7a1816d6a3 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:29.885651 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 517/1034] 10.222.0.27 () {56 vars in 1133 bytes} [Wed Aug 24 11:21:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:21:29.891372 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e709da9c-9ba6-48b6-b722-2928d0e16bc1 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:29.908286 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:29.975157 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59dc3f8-6a2b-43e0-bb07-9e7a1816d6a3 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:29.995358 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e709da9c-9ba6-48b6-b722-2928d0e16bc1 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:30.033200 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1122d5da-ae1c-4b0b-895b-a69216caf05e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:30.033817 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1122d5da-ae1c-4b0b-895b-a69216caf05e None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:30.034126 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1122d5da-ae1c-4b0b-895b-a69216caf05e None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:30.034427 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1122d5da-ae1c-4b0b-895b-a69216caf05e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:30.051600 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:30.084907 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59dc3f8-6a2b-43e0-bb07-9e7a1816d6a3 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:30.108330 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1122d5da-ae1c-4b0b-895b-a69216caf05e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:30.109818 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1122d5da-ae1c-4b0b-895b-a69216caf05e None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:30.127445 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cfd8c2-bba6-4107-85ed-9513e06730ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:30.127641 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:30.128063 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cfd8c2-bba6-4107-85ed-9513e06730ec None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:30.128341 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cfd8c2-bba6-4107-85ed-9513e06730ec None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:30.128612 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cfd8c2-bba6-4107-85ed-9513e06730ec None admin] PATH_INFO: `/v3/services/image` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:30.129287 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cfd8c2-bba6-4107-85ed-9513e06730ec None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:30.130890 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cfd8c2-bba6-4107-85ed-9513e06730ec None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:30.139919 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-f8cfd8c2-bba6-4107-85ed-9513e06730ec None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 11:21:30.139919 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:21:30.139919 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 11:21:30.139919 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 11:21:30.139919 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 11:21:30.139919 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 11:21:30.139919 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 11:21:30.139919 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 11:21:30.139919 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 11:21:30.139919 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Aug 24 11:21:30.139919 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 11:21:30.139919 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Aug 24 11:21:30.139919 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:21:30.139919 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:21:30.139919 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:21:30.139919 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:21:30.139919 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:21:30.140972 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:21:30.140972 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:21:30.140972 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:21:30.140972 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:21:30.140972 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:21:30.140972 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:21:30.140972 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 11:21:30.140972 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 11:21:30.140972 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 11:21:30.140972 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 11:21:30.140972 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:21:30.140972 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:21:30.140972 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:21:30.140972 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:21:30.140972 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:21:30.140972 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:21:30.141835 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:21:30.141835 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Aug 24 11:21:30.141835 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:21:30.141835 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:21:30.141835 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:21:30.141835 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:21:30.141835 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:21:30.141835 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:21:30.141835 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:21:30.141835 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:21:30.141835 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 11:21:30.141835 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 11:21:30.141835 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 11:21:30.141835 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Aug 24 11:21:30.141835 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 518/1035] 10.222.0.27 () {56 vars in 1105 bytes} [Wed Aug 24 11:21:29 2022] GET /identity/v3/services/image => generated 86 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:21:30.147211 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cfd8c2-bba6-4107-85ed-9513e06730ec None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:30.221345 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 518/1036] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 24 11:21:29 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 24 11:21:30.227193 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1122d5da-ae1c-4b0b-895b-a69216caf05e None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:30.252594 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cfd8c2-bba6-4107-85ed-9513e06730ec None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:30.287861 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a3b15d-79d5-49a7-bec1-2106dc03397d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:30.288748 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a3b15d-79d5-49a7-bec1-2106dc03397d None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:30.289174 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a3b15d-79d5-49a7-bec1-2106dc03397d None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:30.289585 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a3b15d-79d5-49a7-bec1-2106dc03397d None admin] PATH_INFO: `/v3/services` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:30.290399 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a3b15d-79d5-49a7-bec1-2106dc03397d None admin] RBAC: Adding query filter params (name=image) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:21:30.290693 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a3b15d-79d5-49a7-bec1-2106dc03397d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:30.292154 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a3b15d-79d5-49a7-bec1-2106dc03397d None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:30.294253 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:30.305131 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 519/1037] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 11:21:30 2022] GET /identity/v3/services?name=image => generated 122 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:21:30.306028 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a3b15d-79d5-49a7-bec1-2106dc03397d None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:30.332867 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1122d5da-ae1c-4b0b-895b-a69216caf05e None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:30.348488 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:30.370782 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab51af48-efa9-499d-86f5-249e416e2ea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:30.371445 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab51af48-efa9-499d-86f5-249e416e2ea4 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:30.371768 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab51af48-efa9-499d-86f5-249e416e2ea4 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:30.372031 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab51af48-efa9-499d-86f5-249e416e2ea4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:30.383604 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab51af48-efa9-499d-86f5-249e416e2ea4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:30.385006 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab51af48-efa9-499d-86f5-249e416e2ea4 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:30.399969 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-ab51af48-efa9-499d-86f5-249e416e2ea4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:21:30.399969 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:21:30.399969 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:21:30.399969 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:21:30.399969 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:21:30.399969 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:21:30.399969 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:21:30.399969 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:21:30.399969 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:21:30.399969 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:21:30.399969 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:21:30.399969 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:21:30.399969 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 11:21:30.399969 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 11:21:30.399969 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 11:21:30.399969 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 11:21:30.401499 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:21:30.401499 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:21:30.401499 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:21:30.401499 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:21:30.401499 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:21:30.401499 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:21:30.401499 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:21:30.401499 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Aug 24 11:21:30.401499 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:21:30.401499 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:21:30.401499 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:21:30.401499 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:21:30.401499 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:21:30.401499 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:21:30.401499 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:21:30.401499 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:21:30.401499 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 11:21:30.402599 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 11:21:30.402599 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:21:30.402599 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:21:30.402599 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 519/1038] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 11:21:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 11:21:30.407113 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab51af48-efa9-499d-86f5-249e416e2ea4 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:30.419797 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a3b15d-79d5-49a7-bec1-2106dc03397d None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:30.457296 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959e131d-fedd-4155-b61a-151c3eeaec0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:30.457927 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959e131d-fedd-4155-b61a-151c3eeaec0f None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:30.458203 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959e131d-fedd-4155-b61a-151c3eeaec0f None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:30.458504 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959e131d-fedd-4155-b61a-151c3eeaec0f None admin] PATH_INFO: `/v3/services` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:30.459139 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959e131d-fedd-4155-b61a-151c3eeaec0f None admin] RBAC: Adding query filter params (type=image) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:21:30.459447 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959e131d-fedd-4155-b61a-151c3eeaec0f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:30.461166 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959e131d-fedd-4155-b61a-151c3eeaec0f None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:30.466290 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 520/1039] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 11:21:30 2022] GET /identity/v3/services?type=image => generated 350 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:21:30.472284 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959e131d-fedd-4155-b61a-151c3eeaec0f None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:30.513890 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab51af48-efa9-499d-86f5-249e416e2ea4 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:30.541627 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:30.552176 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c122143-1153-4fbc-952b-ff200b40c8b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:30.552789 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c122143-1153-4fbc-952b-ff200b40c8b2 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:30.553142 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c122143-1153-4fbc-952b-ff200b40c8b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:30.555494 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c122143-1153-4fbc-952b-ff200b40c8b2 None admin] PATH_INFO: `/v3/domains` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:30.555494 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c122143-1153-4fbc-952b-ff200b40c8b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:21:30.555494 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c122143-1153-4fbc-952b-ff200b40c8b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:30.555894 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c122143-1153-4fbc-952b-ff200b40c8b2 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:30.568540 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 520/1040] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 24 11:21:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:21:30.574146 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c122143-1153-4fbc-952b-ff200b40c8b2 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:30.595703 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959e131d-fedd-4155-b61a-151c3eeaec0f None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:30.602884 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:30.631236 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71b46f3-4949-4471-b446-14c62d24e3b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:30.631858 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71b46f3-4949-4471-b446-14c62d24e3b2 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:30.632136 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71b46f3-4949-4471-b446-14c62d24e3b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:30.632747 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71b46f3-4949-4471-b446-14c62d24e3b2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:30.633109 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71b46f3-4949-4471-b446-14c62d24e3b2 None admin] RBAC: Adding query filter params (interface=public, service_id=96c17b6af70342f78457a37c81c27877, region_id=RegionOne) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:21:30.633413 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71b46f3-4949-4471-b446-14c62d24e3b2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:30.634892 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71b46f3-4949-4471-b446-14c62d24e3b2 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:30.640713 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 521/1041] 10.222.0.27 () {56 vars in 1251 bytes} [Wed Aug 24 11:21:30 2022] GET /identity/v3/endpoints?service_id=96c17b6af70342f78457a37c81c27877&interface=public®ion_id=RegionOne => generated 194 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:21:30.645938 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71b46f3-4949-4471-b446-14c62d24e3b2 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:30.685931 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c122143-1153-4fbc-952b-ff200b40c8b2 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:30.725195 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a0a46a-d4e2-41e7-95e5-1f8f4fefd194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:30.726129 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a0a46a-d4e2-41e7-95e5-1f8f4fefd194 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:30.726548 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a0a46a-d4e2-41e7-95e5-1f8f4fefd194 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:30.726850 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a0a46a-d4e2-41e7-95e5-1f8f4fefd194 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:30.733839 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a0a46a-d4e2-41e7-95e5-1f8f4fefd194 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:30.735348 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a0a46a-d4e2-41e7-95e5-1f8f4fefd194 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:30.746644 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-74a0a46a-d4e2-41e7-95e5-1f8f4fefd194 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 11:21:30.746644 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:21:30.746644 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:21:30.746644 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:21:30.746644 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:21:30.746644 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:21:30.746644 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:21:30.746644 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:21:30.746644 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:21:30.746644 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:21:30.746644 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:21:30.746644 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:21:30.746644 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 11:21:30.746644 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 11:21:30.746644 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 11:21:30.747623 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 11:21:30.747623 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:21:30.747623 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:21:30.747623 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:21:30.747623 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:21:30.747623 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:21:30.747623 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:21:30.747623 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:21:30.747623 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Aug 24 11:21:30.747623 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:21:30.747623 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:21:30.747623 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:21:30.747623 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:21:30.747623 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:21:30.747623 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:21:30.747623 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:21:30.747623 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:21:30.748641 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 11:21:30.748641 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 11:21:30.748641 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 11:21:30.748641 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 11:21:30.748641 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 11:21:30.748641 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 11:21:30.748641 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 11:21:30.748641 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:21:30.748641 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 521/1042] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Aug 24 11:21:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:21:30.751925 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71b46f3-4949-4471-b446-14c62d24e3b2 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:30.753838 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a0a46a-d4e2-41e7-95e5-1f8f4fefd194 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:30.781218 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:30.791218 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb6811f-e3df-4f07-b541-496801911ba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:30.791843 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb6811f-e3df-4f07-b541-496801911ba8 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:30.792119 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb6811f-e3df-4f07-b541-496801911ba8 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:30.792384 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb6811f-e3df-4f07-b541-496801911ba8 None admin] PATH_INFO: `/v3/services` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:30.792988 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb6811f-e3df-4f07-b541-496801911ba8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:30.794448 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb6811f-e3df-4f07-b541-496801911ba8 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:30.801191 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 522/1043] 10.222.0.27 () {56 vars in 1087 bytes} [Wed Aug 24 11:21:30 2022] GET /identity/v3/services => generated 1957 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 11:21:30.847467 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:30.865394 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a0a46a-d4e2-41e7-95e5-1f8f4fefd194 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:30.904993 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca480e3-124b-4bd9-a592-94eaa2bff3a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:30.905525 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca480e3-124b-4bd9-a592-94eaa2bff3a5 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:30.905799 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca480e3-124b-4bd9-a592-94eaa2bff3a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:30.906065 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca480e3-124b-4bd9-a592-94eaa2bff3a5 None admin] PATH_INFO: `/v3/projects` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:30.906804 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca480e3-124b-4bd9-a592-94eaa2bff3a5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:21:30.907109 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca480e3-124b-4bd9-a592-94eaa2bff3a5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:30.908570 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca480e3-124b-4bd9-a592-94eaa2bff3a5 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:30.928252 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 522/1044] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Aug 24 11:21:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:21:30.930035 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb6811f-e3df-4f07-b541-496801911ba8 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:31.034267 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb6811f-e3df-4f07-b541-496801911ba8 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:31.068502 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4feb594-2fe3-4c98-af2c-8445d82d2058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:31.069108 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4feb594-2fe3-4c98-af2c-8445d82d2058 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:31.069387 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4feb594-2fe3-4c98-af2c-8445d82d2058 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:31.069649 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4feb594-2fe3-4c98-af2c-8445d82d2058 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:31.070400 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4feb594-2fe3-4c98-af2c-8445d82d2058 None admin] RBAC: Adding query filter params (role.id=e59237603afa477fbb6954564862fa4a, scope.project.id=317f54a463cb48ab86648c6dcec5db0f, user.id=282ec32864d046b2bea170f6a3845cc0) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:21:31.070698 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4feb594-2fe3-4c98-af2c-8445d82d2058 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:31.072137 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4feb594-2fe3-4c98-af2c-8445d82d2058 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:31.077887 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 523/1045] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Aug 24 11:21:30 2022] GET /identity/v3/role_assignments?user.id=282ec32864d046b2bea170f6a3845cc0&scope.project.id=317f54a463cb48ab86648c6dcec5db0f&role.id=e59237603afa477fbb6954564862fa4a => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:21:31.195648 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646355b7-e584-4c68-b55a-4330f70e0426 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:31.195835 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646355b7-e584-4c68-b55a-4330f70e0426 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:31.196121 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646355b7-e584-4c68-b55a-4330f70e0426 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:31.197562 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 523/1046] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:21:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:21:31.203584 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ab3423-3aaa-484a-8021-c48e03864576 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:31.203893 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ab3423-3aaa-484a-8021-c48e03864576 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:31.204135 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ab3423-3aaa-484a-8021-c48e03864576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:31.223593 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-a7ab3423-3aaa-484a-8021-c48e03864576 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:21:31.224790 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-a7ab3423-3aaa-484a-8021-c48e03864576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:21:31.277485 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:31.295618 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 524/1047] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:21:31 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 11:21:31.556514 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646355b7-e584-4c68-b55a-4330f70e0426 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:31.660027 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646355b7-e584-4c68-b55a-4330f70e0426 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:31.694382 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6cdc1c-b632-4ba0-88df-7a22bc48b3e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:31.695047 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6cdc1c-b632-4ba0-88df-7a22bc48b3e6 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:31.695323 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6cdc1c-b632-4ba0-88df-7a22bc48b3e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:31.695592 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6cdc1c-b632-4ba0-88df-7a22bc48b3e6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:31.705728 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6cdc1c-b632-4ba0-88df-7a22bc48b3e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:21:31.710495 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-ea6cdc1c-b632-4ba0-88df-7a22bc48b3e6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 11:21:31.710495 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:21:31.710495 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:21:31.710495 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:21:31.710495 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:21:31.710495 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:21:31.710495 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:21:31.710495 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:21:31.710495 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:21:31.710495 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:21:31.710495 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:21:31.710495 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:21:31.710495 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:21:31.710495 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:21:31.710495 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:21:31.710495 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:21:31.711476 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:21:31.711476 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:21:31.711476 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:21:31.711476 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:21:31.711476 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:21:31.711476 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:21:31.711476 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:21:31.711476 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:21:31.711476 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:21:31.711476 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:21:31.711476 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:21:31.711476 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Aug 24 11:21:31.711476 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:21:31.711476 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:21:31.711476 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:21:31.711476 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:21:31.712326 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:21:31.712326 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:21:31.712326 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:21:31.712326 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:21:31.712326 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:21:31.712326 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:21:31.712326 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:21:31.712326 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:21:31.712326 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:21:31.712326 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:21:31.712326 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 11:21:31.712326 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:21:31.714807 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 524/1048] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Aug 24 11:21:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:21:31.717706 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ab3423-3aaa-484a-8021-c48e03864576 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:31.823740 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ab3423-3aaa-484a-8021-c48e03864576 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:31.857781 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7362c197-91e0-4e7f-b81c-dcc8809827f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:31.858673 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7362c197-91e0-4e7f-b81c-dcc8809827f5 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:31.858945 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7362c197-91e0-4e7f-b81c-dcc8809827f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:31.859209 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7362c197-91e0-4e7f-b81c-dcc8809827f5 None admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:31.859870 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7362c197-91e0-4e7f-b81c-dcc8809827f5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:21:31.860163 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7362c197-91e0-4e7f-b81c-dcc8809827f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:31.861542 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7362c197-91e0-4e7f-b81c-dcc8809827f5 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:31.871178 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 525/1049] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 24 11:21:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:21:31.877130 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6cdc1c-b632-4ba0-88df-7a22bc48b3e6 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:31.887107 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:31.977660 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6cdc1c-b632-4ba0-88df-7a22bc48b3e6 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:32.010810 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb730f7e-f6d4-4fbc-bf60-6eddd7db985a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:32.011431 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb730f7e-f6d4-4fbc-bf60-6eddd7db985a None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:32.011702 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb730f7e-f6d4-4fbc-bf60-6eddd7db985a None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:32.011967 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb730f7e-f6d4-4fbc-bf60-6eddd7db985a None admin] PATH_INFO: `/v3/users/3a3604eee5704d10b17b0b1a6f497fd1` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:32.025096 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb730f7e-f6d4-4fbc-bf60-6eddd7db985a None admin] RBAC: Authorizing `identity:get_user(user_id=3a3604eee5704d10b17b0b1a6f497fd1)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:32.026933 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb730f7e-f6d4-4fbc-bf60-6eddd7db985a None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:32.028712 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 525/1050] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Aug 24 11:21:31 2022] GET /identity/v3/users/3a3604eee5704d10b17b0b1a6f497fd1 => generated 285 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:21:32.034552 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7362c197-91e0-4e7f-b81c-dcc8809827f5 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:32.081218 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:32.143707 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7362c197-91e0-4e7f-b81c-dcc8809827f5 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:32.180269 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b631086d-2505-450e-9281-cba3401a3cc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:32.180881 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b631086d-2505-450e-9281-cba3401a3cc9 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:32.181153 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b631086d-2505-450e-9281-cba3401a3cc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:32.181416 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b631086d-2505-450e-9281-cba3401a3cc9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:32.253048 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b631086d-2505-450e-9281-cba3401a3cc9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:32.254592 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b631086d-2505-450e-9281-cba3401a3cc9 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:32.300250 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:32.357997 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 526/1051] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 24 11:21:32 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 11:21:32.360357 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb730f7e-f6d4-4fbc-bf60-6eddd7db985a None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:32.425164 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:32.465069 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb730f7e-f6d4-4fbc-bf60-6eddd7db985a None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:32.499272 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfb804d-af9e-44c9-be9a-cdd0833e9487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:32.499916 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfb804d-af9e-44c9-be9a-cdd0833e9487 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:32.500187 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfb804d-af9e-44c9-be9a-cdd0833e9487 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:32.500462 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfb804d-af9e-44c9-be9a-cdd0833e9487 None admin] PATH_INFO: `/v3/projects/6a9cfbc69a6f40f8968f550d9b8e90d6` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:32.501605 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfb804d-af9e-44c9-be9a-cdd0833e9487 None admin] RBAC: Authorizing `identity:get_project(project_id=6a9cfbc69a6f40f8968f550d9b8e90d6)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:32.503185 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfb804d-af9e-44c9-be9a-cdd0833e9487 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:32.504988 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 526/1052] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Aug 24 11:21:32 2022] GET /identity/v3/projects/6a9cfbc69a6f40f8968f550d9b8e90d6 => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:21:32.511038 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b631086d-2505-450e-9281-cba3401a3cc9 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:32.614838 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b631086d-2505-450e-9281-cba3401a3cc9 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:32.648883 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4738a22-35f8-4280-90a3-2c0f428a1395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:32.649484 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4738a22-35f8-4280-90a3-2c0f428a1395 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:32.649752 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4738a22-35f8-4280-90a3-2c0f428a1395 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:32.650011 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4738a22-35f8-4280-90a3-2c0f428a1395 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:32.650764 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4738a22-35f8-4280-90a3-2c0f428a1395 None admin] RBAC: Adding query filter params (role.id=30bb1e97257f4ca5b90c88545777317b, scope.project.id=6a9cfbc69a6f40f8968f550d9b8e90d6, user.id=3a3604eee5704d10b17b0b1a6f497fd1) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:21:32.651431 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4738a22-35f8-4280-90a3-2c0f428a1395 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:32.652850 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4738a22-35f8-4280-90a3-2c0f428a1395 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:32.658429 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 527/1053] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Aug 24 11:21:32 2022] GET /identity/v3/role_assignments?user.id=3a3604eee5704d10b17b0b1a6f497fd1&scope.project.id=6a9cfbc69a6f40f8968f550d9b8e90d6&role.id=30bb1e97257f4ca5b90c88545777317b => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:21:32.735931 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c60e62-daa7-4fa5-8d4f-554a27c3ba38 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:32.736497 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c60e62-daa7-4fa5-8d4f-554a27c3ba38 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:32.736497 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c60e62-daa7-4fa5-8d4f-554a27c3ba38 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:32.738216 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 527/1054] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:21:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:21:32.744088 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bcbd3c-7e94-45a6-96f1-38a8d636c876 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:32.744606 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bcbd3c-7e94-45a6-96f1-38a8d636c876 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:32.744606 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bcbd3c-7e94-45a6-96f1-38a8d636c876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:32.764834 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-86bcbd3c-7e94-45a6-96f1-38a8d636c876 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:21:32.766061 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-86bcbd3c-7e94-45a6-96f1-38a8d636c876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:21:32.771607 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:32.841297 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 528/1055] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:21:32 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 11:21:33.004626 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8876e4-41b1-42af-b804-4d7418154e77 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:33.004984 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8876e4-41b1-42af-b804-4d7418154e77 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:33.005164 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8876e4-41b1-42af-b804-4d7418154e77 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:33.006714 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 528/1056] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:21:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:21:33.012001 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0099cb-b4ff-430b-a1fe-533a5a37c4dc None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:33.012295 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0099cb-b4ff-430b-a1fe-533a5a37c4dc None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:33.012581 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0099cb-b4ff-430b-a1fe-533a5a37c4dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:33.032081 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-5e0099cb-b4ff-430b-a1fe-533a5a37c4dc None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:21:33.033289 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-5e0099cb-b4ff-430b-a1fe-533a5a37c4dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:21:33.103199 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8876e4-41b1-42af-b804-4d7418154e77 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:33.106073 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 529/1057] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:21:33 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 11:21:33.211379 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8876e4-41b1-42af-b804-4d7418154e77 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:33.240960 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:33.247221 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce467e5b-92b2-4ee1-a52b-9618d1d622b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:33.247854 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce467e5b-92b2-4ee1-a52b-9618d1d622b4 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:33.248126 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce467e5b-92b2-4ee1-a52b-9618d1d622b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:33.248388 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce467e5b-92b2-4ee1-a52b-9618d1d622b4 None admin] PATH_INFO: `/v3/services/image` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:33.248970 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce467e5b-92b2-4ee1-a52b-9618d1d622b4 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:33.250382 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce467e5b-92b2-4ee1-a52b-9618d1d622b4 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:33.259310 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-ce467e5b-92b2-4ee1-a52b-9618d1d622b4 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 11:21:33.259310 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:21:33.259310 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 11:21:33.259310 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 11:21:33.259310 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 11:21:33.259310 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 11:21:33.259310 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 11:21:33.259310 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 11:21:33.259310 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 11:21:33.259310 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:21:33.259310 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 11:21:33.259310 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:21:33.259310 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:21:33.259310 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:21:33.259310 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:21:33.259310 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:21:33.259310 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:21:33.260387 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:21:33.260387 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:21:33.260387 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:21:33.260387 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:21:33.260387 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:21:33.260387 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:21:33.260387 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 11:21:33.260387 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 11:21:33.260387 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 11:21:33.260387 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 11:21:33.260387 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:21:33.260387 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:21:33.260387 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:21:33.260387 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:21:33.260387 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:21:33.260387 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:21:33.261248 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:21:33.261248 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Aug 24 11:21:33.261248 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:21:33.261248 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:21:33.261248 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:21:33.261248 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:21:33.261248 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:21:33.261248 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:21:33.261248 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:21:33.261248 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:21:33.261248 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 11:21:33.261248 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 11:21:33.261248 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 11:21:33.261248 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:21:33.261248 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 529/1058] 10.222.0.27 () {56 vars in 1105 bytes} [Wed Aug 24 11:21:33 2022] GET /identity/v3/services/image => generated 86 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:21:33.266264 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0099cb-b4ff-430b-a1fe-533a5a37c4dc None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:33.338793 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:33.370609 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0099cb-b4ff-430b-a1fe-533a5a37c4dc None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:33.372080 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce467e5b-92b2-4ee1-a52b-9618d1d622b4 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:33.407264 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5603f67-f804-452d-bdda-b252c3743323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:33.408046 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5603f67-f804-452d-bdda-b252c3743323 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:33.409129 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5603f67-f804-452d-bdda-b252c3743323 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:33.409422 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5603f67-f804-452d-bdda-b252c3743323 None admin] PATH_INFO: `/v3/services` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:33.410088 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5603f67-f804-452d-bdda-b252c3743323 None admin] RBAC: Adding query filter params (name=image) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:21:33.410415 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5603f67-f804-452d-bdda-b252c3743323 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:33.411813 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5603f67-f804-452d-bdda-b252c3743323 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:33.422737 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 530/1059] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 11:21:33 2022] GET /identity/v3/services?name=image => generated 122 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:21:33.423796 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5603f67-f804-452d-bdda-b252c3743323 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:33.481783 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce467e5b-92b2-4ee1-a52b-9618d1d622b4 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:33.518325 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80d1761-12b3-4135-b3cf-9341fa06e994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:33.518969 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80d1761-12b3-4135-b3cf-9341fa06e994 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:33.519260 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80d1761-12b3-4135-b3cf-9341fa06e994 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:33.519577 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80d1761-12b3-4135-b3cf-9341fa06e994 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:33.526553 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5603f67-f804-452d-bdda-b252c3743323 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:33.531610 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80d1761-12b3-4135-b3cf-9341fa06e994 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:21:33.536550 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-f80d1761-12b3-4135-b3cf-9341fa06e994 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 11:21:33.536550 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:21:33.536550 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:21:33.536550 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:21:33.536550 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:21:33.536550 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:21:33.536550 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:21:33.536550 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:21:33.536550 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:21:33.536550 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:21:33.536550 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:21:33.536550 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:21:33.536550 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:21:33.536550 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:21:33.536550 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:21:33.536550 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:21:33.537501 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:21:33.537501 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:21:33.537501 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:21:33.537501 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:21:33.537501 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:21:33.537501 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:21:33.537501 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:21:33.537501 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:21:33.537501 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:21:33.537501 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:21:33.537501 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:21:33.537501 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Aug 24 11:21:33.537501 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:21:33.537501 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:21:33.537501 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:21:33.537501 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:21:33.538397 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:21:33.538397 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:21:33.538397 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:21:33.538397 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:21:33.538397 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:21:33.538397 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:21:33.538397 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:21:33.538397 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:21:33.538397 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:21:33.538397 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:21:33.538397 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 11:21:33.538397 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:21:33.538397 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 530/1060] 10.222.0.27 () {56 vars in 1120 bytes} [Wed Aug 24 11:21:33 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 11:21:33.544004 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80d1761-12b3-4135-b3cf-9341fa06e994 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:33.563929 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f74890-f702-4819-a45e-d724ba55aeb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:33.564534 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f74890-f702-4819-a45e-d724ba55aeb6 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:33.564806 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f74890-f702-4819-a45e-d724ba55aeb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:33.565074 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f74890-f702-4819-a45e-d724ba55aeb6 None admin] PATH_INFO: `/v3/services` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:33.565773 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f74890-f702-4819-a45e-d724ba55aeb6 None admin] RBAC: Adding query filter params (type=image) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:21:33.566328 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f74890-f702-4819-a45e-d724ba55aeb6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:33.567474 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f74890-f702-4819-a45e-d724ba55aeb6 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:33.568964 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:33.578998 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 531/1061] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 11:21:33 2022] GET /identity/v3/services?type=image => generated 350 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:21:33.580053 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f74890-f702-4819-a45e-d724ba55aeb6 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:33.604236 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:33.650483 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80d1761-12b3-4135-b3cf-9341fa06e994 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:33.682370 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f74890-f702-4819-a45e-d724ba55aeb6 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:33.686875 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505f29f3-661e-454b-b3b3-2a8a790b6cdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:33.687492 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505f29f3-661e-454b-b3b3-2a8a790b6cdd None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:33.687767 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505f29f3-661e-454b-b3b3-2a8a790b6cdd None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:33.688171 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505f29f3-661e-454b-b3b3-2a8a790b6cdd None admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:33.688846 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505f29f3-661e-454b-b3b3-2a8a790b6cdd None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:21:33.689148 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505f29f3-661e-454b-b3b3-2a8a790b6cdd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:33.690631 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505f29f3-661e-454b-b3b3-2a8a790b6cdd None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:33.700076 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 531/1062] 10.222.0.27 () {56 vars in 1115 bytes} [Wed Aug 24 11:21:33 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:21:33.706278 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505f29f3-661e-454b-b3b3-2a8a790b6cdd None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:33.724349 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c40480-e3c9-4f7d-8561-bd981ae5346e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:33.724978 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c40480-e3c9-4f7d-8561-bd981ae5346e None admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:33.725276 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c40480-e3c9-4f7d-8561-bd981ae5346e None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:33.725512 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c40480-e3c9-4f7d-8561-bd981ae5346e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:33.726183 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c40480-e3c9-4f7d-8561-bd981ae5346e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:33.727607 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c40480-e3c9-4f7d-8561-bd981ae5346e None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:33.758387 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 532/1063] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 11:21:33 2022] POST /identity/v3/endpoints => generated 327 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 11:21:33.814720 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505f29f3-661e-454b-b3b3-2a8a790b6cdd None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:33.834034 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:33.861390 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f38719-d7f8-4e5c-a1bd-824b02da70ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:33.862134 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f38719-d7f8-4e5c-a1bd-824b02da70ad None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:33.862431 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f38719-d7f8-4e5c-a1bd-824b02da70ad None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:33.862697 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f38719-d7f8-4e5c-a1bd-824b02da70ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:33.874711 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f38719-d7f8-4e5c-a1bd-824b02da70ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:33.876245 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f38719-d7f8-4e5c-a1bd-824b02da70ad None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:33.892095 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-e9f38719-d7f8-4e5c-a1bd-824b02da70ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:21:33.892095 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:21:33.892095 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:21:33.892095 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:21:33.892095 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:21:33.892095 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:21:33.892095 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:21:33.892095 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:21:33.892095 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:21:33.892095 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:21:33.892095 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:21:33.892095 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:21:33.892095 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 11:21:33.892095 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 11:21:33.892095 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 11:21:33.892095 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 11:21:33.893125 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:21:33.893125 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:21:33.893125 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:21:33.893125 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:21:33.893125 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:21:33.893125 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:21:33.893125 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:21:33.893125 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Aug 24 11:21:33.893125 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:21:33.893125 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:21:33.893125 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:21:33.893125 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:21:33.893125 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:21:33.893125 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:21:33.893125 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:21:33.893125 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:21:33.893125 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 11:21:33.894143 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 11:21:33.894143 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:21:33.894143 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:21:33.894143 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 532/1064] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 11:21:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 11:21:33.899428 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c40480-e3c9-4f7d-8561-bd981ae5346e None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:33.957182 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:34.003759 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c40480-e3c9-4f7d-8561-bd981ae5346e None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:34.038413 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea4b964-2adf-4f59-9034-4ac9d83cad4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:34.039032 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea4b964-2adf-4f59-9034-4ac9d83cad4f None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:34.039304 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea4b964-2adf-4f59-9034-4ac9d83cad4f None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:34.039577 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea4b964-2adf-4f59-9034-4ac9d83cad4f None admin] PATH_INFO: `/v3/domains` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:34.040252 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea4b964-2adf-4f59-9034-4ac9d83cad4f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:21:34.040548 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea4b964-2adf-4f59-9034-4ac9d83cad4f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:34.041927 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea4b964-2adf-4f59-9034-4ac9d83cad4f None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:34.054419 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 533/1065] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 24 11:21:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:21:34.060208 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f38719-d7f8-4e5c-a1bd-824b02da70ad None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:34.172198 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f38719-d7f8-4e5c-a1bd-824b02da70ad None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:34.206968 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed77fec-ce31-4813-b157-36c69291a05e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:34.207602 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed77fec-ce31-4813-b157-36c69291a05e None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:34.207880 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed77fec-ce31-4813-b157-36c69291a05e None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:34.208146 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed77fec-ce31-4813-b157-36c69291a05e None admin] PATH_INFO: `/v3/users/nova` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:34.215751 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed77fec-ce31-4813-b157-36c69291a05e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:34.217218 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed77fec-ce31-4813-b157-36c69291a05e None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:34.229068 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-1ed77fec-ce31-4813-b157-36c69291a05e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 11:21:34.229068 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:21:34.229068 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:21:34.229068 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:21:34.229068 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:21:34.229068 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:21:34.229068 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:21:34.229068 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:21:34.229068 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:21:34.229068 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:21:34.229068 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:21:34.229068 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:21:34.229068 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 11:21:34.229068 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 11:21:34.229068 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 11:21:34.229068 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 11:21:34.230041 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:21:34.230041 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:21:34.230041 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 11:21:34.230041 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 11:21:34.230041 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 11:21:34.230041 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 11:21:34.230041 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:21:34.230041 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:21:34.230041 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:21:34.230041 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:21:34.230041 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:21:34.230041 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Aug 24 11:21:34.230041 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:21:34.230041 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:21:34.230041 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:21:34.230041 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:21:34.230041 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:21:34.230041 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:21:34.231430 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:21:34.231430 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:21:34.231430 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 11:21:34.231430 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 11:21:34.231430 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 11:21:34.231430 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 11:21:34.231430 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 11:21:34.231430 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 11:21:34.231430 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 11:21:34.231430 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:21:34.234444 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 533/1066] 10.222.0.27 () {56 vars in 1093 bytes} [Wed Aug 24 11:21:34 2022] GET /identity/v3/users/nova => generated 82 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:21:34.236099 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea4b964-2adf-4f59-9034-4ac9d83cad4f None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:34.343441 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea4b964-2adf-4f59-9034-4ac9d83cad4f None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:34.358344 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:34.381352 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2376b19a-b5ef-4094-92ea-4d0529c0d033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:34.381966 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2376b19a-b5ef-4094-92ea-4d0529c0d033 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:34.382236 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2376b19a-b5ef-4094-92ea-4d0529c0d033 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:34.382535 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2376b19a-b5ef-4094-92ea-4d0529c0d033 None admin] PATH_INFO: `/v3/users` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:34.383246 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2376b19a-b5ef-4094-92ea-4d0529c0d033 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:21:34.383548 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2376b19a-b5ef-4094-92ea-4d0529c0d033 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:34.385156 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2376b19a-b5ef-4094-92ea-4d0529c0d033 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:34.403907 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 534/1067] 10.222.0.27 () {56 vars in 1133 bytes} [Wed Aug 24 11:21:34 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:21:34.409500 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed77fec-ce31-4813-b157-36c69291a05e None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:34.440305 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:34.515930 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed77fec-ce31-4813-b157-36c69291a05e None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:34.527454 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a98dee6-8d95-4b8b-b8dd-0dc8bb69b3aa None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:34.527736 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a98dee6-8d95-4b8b-b8dd-0dc8bb69b3aa None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:34.527998 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a98dee6-8d95-4b8b-b8dd-0dc8bb69b3aa None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:34.529470 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 535/1068] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:21:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 11:21:34.534123 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715bfbee-971e-4923-a7a7-20e8e89dd7be None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:34.534432 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715bfbee-971e-4923-a7a7-20e8e89dd7be None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:34.534710 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715bfbee-971e-4923-a7a7-20e8e89dd7be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:34.552190 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-715bfbee-971e-4923-a7a7-20e8e89dd7be None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:21:34.553132 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916f7bf6-7ea2-4008-85ce-8e038f2f6513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:34.553363 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-715bfbee-971e-4923-a7a7-20e8e89dd7be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:21:34.553767 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916f7bf6-7ea2-4008-85ce-8e038f2f6513 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:34.554046 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916f7bf6-7ea2-4008-85ce-8e038f2f6513 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:34.554321 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916f7bf6-7ea2-4008-85ce-8e038f2f6513 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:34.565042 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916f7bf6-7ea2-4008-85ce-8e038f2f6513 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:34.566576 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916f7bf6-7ea2-4008-85ce-8e038f2f6513 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:34.580552 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-916f7bf6-7ea2-4008-85ce-8e038f2f6513 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:21:34.580552 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:21:34.580552 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:21:34.580552 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:21:34.580552 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:21:34.580552 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:21:34.580552 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:21:34.580552 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:21:34.580552 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:21:34.580552 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:21:34.580552 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:21:34.580552 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:21:34.580552 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 11:21:34.580552 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 11:21:34.580552 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 11:21:34.580552 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 11:21:34.581728 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:21:34.581728 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:21:34.581728 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:21:34.581728 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:21:34.581728 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:21:34.581728 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:21:34.581728 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:21:34.581728 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Aug 24 11:21:34.581728 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:21:34.581728 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:21:34.581728 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:21:34.581728 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:21:34.581728 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:21:34.581728 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:21:34.581728 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:21:34.581728 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:21:34.581728 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 11:21:34.582652 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 11:21:34.582652 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:21:34.582652 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:21:34.582652 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 534/1069] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 11:21:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:21:34.587520 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916f7bf6-7ea2-4008-85ce-8e038f2f6513 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:34.633247 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 536/1070] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:21:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 11:21:34.672701 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:34.695212 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916f7bf6-7ea2-4008-85ce-8e038f2f6513 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:34.730269 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44940ae3-df74-4507-a132-5cefaaa42106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:34.730906 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44940ae3-df74-4507-a132-5cefaaa42106 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:34.731188 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44940ae3-df74-4507-a132-5cefaaa42106 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:34.731457 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44940ae3-df74-4507-a132-5cefaaa42106 None admin] PATH_INFO: `/v3/domains` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:34.732099 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44940ae3-df74-4507-a132-5cefaaa42106 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:21:34.732404 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44940ae3-df74-4507-a132-5cefaaa42106 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:34.733798 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44940ae3-df74-4507-a132-5cefaaa42106 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:34.746122 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 535/1071] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 24 11:21:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:21:34.751728 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715bfbee-971e-4923-a7a7-20e8e89dd7be None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:34.854273 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715bfbee-971e-4923-a7a7-20e8e89dd7be None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:34.856006 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:34.891666 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44940ae3-df74-4507-a132-5cefaaa42106 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:34.894412 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfd8e2f-0015-4274-86ae-491036ff77e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:34.895055 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfd8e2f-0015-4274-86ae-491036ff77e1 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:34.895329 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfd8e2f-0015-4274-86ae-491036ff77e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:34.896415 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfd8e2f-0015-4274-86ae-491036ff77e1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:34.903588 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfd8e2f-0015-4274-86ae-491036ff77e1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:34.905046 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfd8e2f-0015-4274-86ae-491036ff77e1 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:34.916767 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-edfd8e2f-0015-4274-86ae-491036ff77e1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 11:21:34.916767 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:21:34.916767 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:21:34.916767 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:21:34.916767 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:21:34.916767 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:21:34.916767 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:21:34.916767 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:21:34.916767 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:21:34.916767 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:21:34.916767 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:21:34.916767 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:21:34.916767 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 11:21:34.916767 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 11:21:34.916767 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 11:21:34.917862 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 11:21:34.917862 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:21:34.917862 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:21:34.917862 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:21:34.917862 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:21:34.917862 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:21:34.917862 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:21:34.917862 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:21:34.917862 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Aug 24 11:21:34.917862 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:21:34.917862 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:21:34.917862 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:21:34.917862 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:21:34.917862 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:21:34.917862 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:21:34.917862 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:21:34.917862 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:21:34.918868 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 11:21:34.918868 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 11:21:34.918868 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 11:21:34.918868 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 11:21:34.918868 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 11:21:34.918868 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 11:21:34.918868 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 11:21:34.918868 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Aug 24 11:21:34.918868 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 537/1072] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Aug 24 11:21:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:21:34.923582 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfd8e2f-0015-4274-86ae-491036ff77e1 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:35.003013 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44940ae3-df74-4507-a132-5cefaaa42106 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:35.024612 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfd8e2f-0015-4274-86ae-491036ff77e1 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:35.037956 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093fd8fc-624f-46c4-a76d-c71697c21807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:35.038632 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093fd8fc-624f-46c4-a76d-c71697c21807 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:35.038903 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093fd8fc-624f-46c4-a76d-c71697c21807 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:35.039177 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093fd8fc-624f-46c4-a76d-c71697c21807 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:35.045760 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:35.050051 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093fd8fc-624f-46c4-a76d-c71697c21807 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:21:35.055123 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-093fd8fc-624f-46c4-a76d-c71697c21807 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 11:21:35.055123 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:21:35.055123 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:21:35.055123 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:21:35.055123 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:21:35.055123 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:21:35.055123 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:21:35.055123 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:21:35.055123 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:21:35.055123 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:21:35.055123 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:21:35.055123 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:21:35.055123 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:21:35.055123 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:21:35.055123 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:21:35.055123 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:21:35.056068 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:21:35.056068 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:21:35.056068 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:21:35.056068 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:21:35.056068 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:21:35.056068 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:21:35.056068 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:21:35.056068 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:21:35.056068 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:21:35.056068 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:21:35.056068 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:21:35.056068 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Aug 24 11:21:35.056068 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:21:35.056068 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:21:35.056068 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:21:35.056068 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:21:35.056916 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:21:35.056916 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:21:35.056916 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:21:35.056916 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:21:35.056916 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:21:35.056916 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:21:35.056916 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:21:35.056916 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:21:35.056916 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:21:35.056916 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:21:35.056916 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 11:21:35.056916 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:21:35.056916 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 536/1073] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Aug 24 11:21:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:21:35.062065 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093fd8fc-624f-46c4-a76d-c71697c21807 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:35.065995 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f755ed8-620d-4e42-9497-0fc83cacf32f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:35.066634 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f755ed8-620d-4e42-9497-0fc83cacf32f None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:35.066906 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f755ed8-620d-4e42-9497-0fc83cacf32f None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:35.067173 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f755ed8-620d-4e42-9497-0fc83cacf32f None admin] PATH_INFO: `/v3/projects` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:35.067859 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f755ed8-620d-4e42-9497-0fc83cacf32f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:21:35.068153 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f755ed8-620d-4e42-9497-0fc83cacf32f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:35.069585 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f755ed8-620d-4e42-9497-0fc83cacf32f None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:35.087101 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 538/1074] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Aug 24 11:21:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:21:35.088169 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f755ed8-620d-4e42-9497-0fc83cacf32f None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:35.117199 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:35.179395 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093fd8fc-624f-46c4-a76d-c71697c21807 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:35.196964 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f755ed8-620d-4e42-9497-0fc83cacf32f None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:35.215302 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9223a3a8-263b-41a4-8b6d-1023757809e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:35.215930 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9223a3a8-263b-41a4-8b6d-1023757809e8 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:35.216201 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9223a3a8-263b-41a4-8b6d-1023757809e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:35.216470 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9223a3a8-263b-41a4-8b6d-1023757809e8 None admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:35.217126 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9223a3a8-263b-41a4-8b6d-1023757809e8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:21:35.217423 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9223a3a8-263b-41a4-8b6d-1023757809e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:35.218877 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9223a3a8-263b-41a4-8b6d-1023757809e8 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:35.227738 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 537/1075] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 24 11:21:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:21:35.232985 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0358d7ff-0af6-4c1e-be38-8fb1e3f73b3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:35.233236 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9223a3a8-263b-41a4-8b6d-1023757809e8 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:35.233655 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0358d7ff-0af6-4c1e-be38-8fb1e3f73b3b None admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:35.233926 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0358d7ff-0af6-4c1e-be38-8fb1e3f73b3b None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:35.234202 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0358d7ff-0af6-4c1e-be38-8fb1e3f73b3b None admin] PATH_INFO: `/v3/projects/317f54a463cb48ab86648c6dcec5db0f/users/282ec32864d046b2bea170f6a3845cc0/roles/e59237603afa477fbb6954564862fa4a` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:35.236487 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0358d7ff-0af6-4c1e-be38-8fb1e3f73b3b None admin] RBAC: Authorizing `identity:create_grant(project_id=317f54a463cb48ab86648c6dcec5db0f, user_id=282ec32864d046b2bea170f6a3845cc0, role_id=e59237603afa477fbb6954564862fa4a)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:35.238029 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0358d7ff-0af6-4c1e-be38-8fb1e3f73b3b None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:35.252454 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 539/1076] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Aug 24 11:21:35 2022] PUT /identity/v3/projects/317f54a463cb48ab86648c6dcec5db0f/users/282ec32864d046b2bea170f6a3845cc0/roles/e59237603afa477fbb6954564862fa4a => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:21:35.299805 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:35.348433 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9223a3a8-263b-41a4-8b6d-1023757809e8 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:35.385701 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d6b0e4-c264-4935-824d-989a60e50c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:35.386391 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d6b0e4-c264-4935-824d-989a60e50c52 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:35.386676 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d6b0e4-c264-4935-824d-989a60e50c52 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:35.386916 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d6b0e4-c264-4935-824d-989a60e50c52 None admin] PATH_INFO: `/v3/users/3a3604eee5704d10b17b0b1a6f497fd1` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:35.388245 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d6b0e4-c264-4935-824d-989a60e50c52 None admin] RBAC: Authorizing `identity:get_user(user_id=3a3604eee5704d10b17b0b1a6f497fd1)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:35.389735 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d6b0e4-c264-4935-824d-989a60e50c52 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:35.391626 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 538/1077] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Aug 24 11:21:35 2022] GET /identity/v3/users/3a3604eee5704d10b17b0b1a6f497fd1 => generated 285 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:21:35.398013 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0358d7ff-0af6-4c1e-be38-8fb1e3f73b3b None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:35.488724 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:35.508957 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0358d7ff-0af6-4c1e-be38-8fb1e3f73b3b None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:35.544390 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd46599-0a46-44d7-86a5-9aebe0604919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:35.545083 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd46599-0a46-44d7-86a5-9aebe0604919 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:35.545365 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd46599-0a46-44d7-86a5-9aebe0604919 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:35.545634 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd46599-0a46-44d7-86a5-9aebe0604919 None admin] PATH_INFO: `/v3/projects/6a9cfbc69a6f40f8968f550d9b8e90d6` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:35.546797 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd46599-0a46-44d7-86a5-9aebe0604919 None admin] RBAC: Authorizing `identity:get_project(project_id=6a9cfbc69a6f40f8968f550d9b8e90d6)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:35.548251 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd46599-0a46-44d7-86a5-9aebe0604919 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:35.554389 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 540/1078] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Aug 24 11:21:35 2022] GET /identity/v3/projects/6a9cfbc69a6f40f8968f550d9b8e90d6 => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:21:35.556361 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d6b0e4-c264-4935-824d-989a60e50c52 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:35.657633 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d6b0e4-c264-4935-824d-989a60e50c52 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:35.684811 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:35.694246 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4357603-78b8-4264-a530-a1254f1be9dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:35.694944 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4357603-78b8-4264-a530-a1254f1be9dd None admin] REQUEST_METHOD: `PUT` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:35.695221 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4357603-78b8-4264-a530-a1254f1be9dd None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:35.695493 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4357603-78b8-4264-a530-a1254f1be9dd None admin] PATH_INFO: `/v3/projects/6a9cfbc69a6f40f8968f550d9b8e90d6/users/3a3604eee5704d10b17b0b1a6f497fd1/roles/30bb1e97257f4ca5b90c88545777317b` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:35.698736 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4357603-78b8-4264-a530-a1254f1be9dd None admin] RBAC: Authorizing `identity:create_grant(project_id=6a9cfbc69a6f40f8968f550d9b8e90d6, user_id=3a3604eee5704d10b17b0b1a6f497fd1, role_id=30bb1e97257f4ca5b90c88545777317b)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:35.698933 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4357603-78b8-4264-a530-a1254f1be9dd None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:35.712445 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 539/1079] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Aug 24 11:21:35 2022] PUT /identity/v3/projects/6a9cfbc69a6f40f8968f550d9b8e90d6/users/3a3604eee5704d10b17b0b1a6f497fd1/roles/30bb1e97257f4ca5b90c88545777317b => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 11:21:35.717504 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9e1570-97e2-4bd4-9bf9-358c0a6a46a5 None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:35.717799 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9e1570-97e2-4bd4-9bf9-358c0a6a46a5 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:35.718075 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9e1570-97e2-4bd4-9bf9-358c0a6a46a5 None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:35.719719 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 541/1080] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:21:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 11:21:35.725796 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21385fd8-e0df-4949-b2cb-899ea1ae4960 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:35.726140 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21385fd8-e0df-4949-b2cb-899ea1ae4960 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:35.726383 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21385fd8-e0df-4949-b2cb-899ea1ae4960 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:35.748118 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-21385fd8-e0df-4949-b2cb-899ea1ae4960 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:21:35.749267 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-21385fd8-e0df-4949-b2cb-899ea1ae4960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:21:35.825432 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 540/1081] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:21:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 11:21:36.091542 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9e1570-97e2-4bd4-9bf9-358c0a6a46a5 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:36.207315 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9e1570-97e2-4bd4-9bf9-358c0a6a46a5 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:36.243022 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb050407-6265-4f70-98f2-b5977903c6b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:36.243631 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb050407-6265-4f70-98f2-b5977903c6b1 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:36.243906 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb050407-6265-4f70-98f2-b5977903c6b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:36.244172 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb050407-6265-4f70-98f2-b5977903c6b1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:36.264533 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:36.326775 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb050407-6265-4f70-98f2-b5977903c6b1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:36.328261 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb050407-6265-4f70-98f2-b5977903c6b1 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:36.432224 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 542/1082] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 24 11:21:36 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 11:21:36.438029 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21385fd8-e0df-4949-b2cb-899ea1ae4960 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:36.540042 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21385fd8-e0df-4949-b2cb-899ea1ae4960 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:36.557511 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:36.579698 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9152153b-9cfd-425b-80bf-ecf2d6b9252b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:36.580335 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9152153b-9cfd-425b-80bf-ecf2d6b9252b None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:36.580608 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9152153b-9cfd-425b-80bf-ecf2d6b9252b None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:36.580902 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9152153b-9cfd-425b-80bf-ecf2d6b9252b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:36.591289 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9152153b-9cfd-425b-80bf-ecf2d6b9252b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:36.592761 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9152153b-9cfd-425b-80bf-ecf2d6b9252b None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:36.607236 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-9152153b-9cfd-425b-80bf-ecf2d6b9252b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:21:36.607236 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:21:36.607236 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:21:36.607236 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:21:36.607236 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:21:36.607236 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:21:36.607236 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:21:36.607236 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:21:36.607236 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:21:36.607236 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:21:36.607236 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:21:36.607236 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:21:36.607236 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 11:21:36.607236 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 11:21:36.607236 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 11:21:36.607236 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 11:21:36.608210 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:21:36.608210 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:21:36.608210 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:21:36.608210 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:21:36.608210 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:21:36.608210 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:21:36.608210 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:21:36.608210 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Aug 24 11:21:36.608210 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:21:36.608210 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:21:36.608210 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:21:36.608210 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:21:36.608210 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:21:36.608210 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:21:36.608210 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:21:36.608210 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:21:36.608210 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 11:21:36.614251 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 11:21:36.614251 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:21:36.614251 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:21:36.614251 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 541/1083] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 11:21:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:21:36.615896 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb050407-6265-4f70-98f2-b5977903c6b1 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:36.670683 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:36.722560 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb050407-6265-4f70-98f2-b5977903c6b1 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:36.756997 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b947e283-0778-4bed-8a84-945ead91a3e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:36.757617 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b947e283-0778-4bed-8a84-945ead91a3e2 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:36.757889 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b947e283-0778-4bed-8a84-945ead91a3e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:36.758157 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b947e283-0778-4bed-8a84-945ead91a3e2 None admin] PATH_INFO: `/v3/domains` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:36.758831 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b947e283-0778-4bed-8a84-945ead91a3e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:21:36.759142 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b947e283-0778-4bed-8a84-945ead91a3e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:36.760515 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b947e283-0778-4bed-8a84-945ead91a3e2 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:36.772719 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 543/1084] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 24 11:21:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:21:37.148499 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d057ebc1-baae-42b2-8f48-622f09caaefe None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:37.148751 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d057ebc1-baae-42b2-8f48-622f09caaefe None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:37.149032 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d057ebc1-baae-42b2-8f48-622f09caaefe None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:37.150391 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 542/1085] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:21:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:21:37.156323 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b556b7c9-c8b5-4ebf-bb99-1833d92bffb5 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:37.156808 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b556b7c9-c8b5-4ebf-bb99-1833d92bffb5 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:37.156808 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b556b7c9-c8b5-4ebf-bb99-1833d92bffb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:37.175977 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-b556b7c9-c8b5-4ebf-bb99-1833d92bffb5 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:21:37.177167 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-b556b7c9-c8b5-4ebf-bb99-1833d92bffb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:21:37.245393 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 544/1086] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:21:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 11:21:37.509218 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d057ebc1-baae-42b2-8f48-622f09caaefe None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:37.600597 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204b97ca-8153-4756-9df7-5e6cd961446b None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:37.601001 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204b97ca-8153-4756-9df7-5e6cd961446b None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:37.601274 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204b97ca-8153-4756-9df7-5e6cd961446b None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:37.602709 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 545/1087] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:21:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:21:37.607667 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed4db29-c9cd-4305-b621-929ddb4996ea None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:37.607933 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed4db29-c9cd-4305-b621-929ddb4996ea None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:37.608202 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed4db29-c9cd-4305-b621-929ddb4996ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:37.618160 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d057ebc1-baae-42b2-8f48-622f09caaefe None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:37.626744 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-3ed4db29-c9cd-4305-b621-929ddb4996ea None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:21:37.628033 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-3ed4db29-c9cd-4305-b621-929ddb4996ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:21:37.651890 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce6c20c-423b-4a66-8ef9-3b8c92da1e2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:37.652505 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce6c20c-423b-4a66-8ef9-3b8c92da1e2a None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:37.652791 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce6c20c-423b-4a66-8ef9-3b8c92da1e2a None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:37.653064 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce6c20c-423b-4a66-8ef9-3b8c92da1e2a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:37.663782 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce6c20c-423b-4a66-8ef9-3b8c92da1e2a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:21:37.663918 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:37.668565 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-8ce6c20c-423b-4a66-8ef9-3b8c92da1e2a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 11:21:37.668565 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:21:37.668565 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:21:37.668565 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:21:37.668565 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:21:37.668565 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:21:37.668565 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:21:37.668565 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:21:37.668565 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:21:37.668565 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:21:37.668565 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:21:37.668565 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:21:37.668565 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:21:37.668565 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:21:37.668565 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:21:37.668565 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:21:37.669552 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:21:37.669552 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:21:37.669552 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:21:37.669552 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:21:37.669552 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:21:37.669552 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:21:37.669552 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:21:37.669552 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:21:37.669552 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:21:37.669552 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:21:37.669552 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:21:37.669552 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Aug 24 11:21:37.669552 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:21:37.669552 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:21:37.669552 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:21:37.669552 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:21:37.670839 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:21:37.670839 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:21:37.670839 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:21:37.670839 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:21:37.670839 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:21:37.670839 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:21:37.670839 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:21:37.670839 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:21:37.670839 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:21:37.670839 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:21:37.670839 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 11:21:37.670839 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:21:37.670839 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 543/1088] 10.222.0.27 () {56 vars in 1120 bytes} [Wed Aug 24 11:21:37 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:21:37.675699 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce6c20c-423b-4a66-8ef9-3b8c92da1e2a None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:37.699466 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 546/1089] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:21:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 11:21:37.707235 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:37.777251 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce6c20c-423b-4a66-8ef9-3b8c92da1e2a None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:37.814180 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d96c1ae-f0c0-45b5-95e0-1e14e7d31a6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:37.814816 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d96c1ae-f0c0-45b5-95e0-1e14e7d31a6f None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:37.815074 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d96c1ae-f0c0-45b5-95e0-1e14e7d31a6f None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:37.815368 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d96c1ae-f0c0-45b5-95e0-1e14e7d31a6f None admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:37.816049 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d96c1ae-f0c0-45b5-95e0-1e14e7d31a6f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:21:37.816361 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d96c1ae-f0c0-45b5-95e0-1e14e7d31a6f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:37.817811 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d96c1ae-f0c0-45b5-95e0-1e14e7d31a6f None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:37.826114 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 544/1090] 10.222.0.27 () {56 vars in 1115 bytes} [Wed Aug 24 11:21:37 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:21:37.832282 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed4db29-c9cd-4305-b621-929ddb4996ea None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:37.934653 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed4db29-c9cd-4305-b621-929ddb4996ea None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:37.962904 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d96c1ae-f0c0-45b5-95e0-1e14e7d31a6f None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:37.969615 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724dccbe-7dab-40ee-bc91-a2bd72ab50c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:37.970243 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724dccbe-7dab-40ee-bc91-a2bd72ab50c6 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:37.970551 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724dccbe-7dab-40ee-bc91-a2bd72ab50c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:37.970822 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724dccbe-7dab-40ee-bc91-a2bd72ab50c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:37.981390 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724dccbe-7dab-40ee-bc91-a2bd72ab50c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:37.982890 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724dccbe-7dab-40ee-bc91-a2bd72ab50c6 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:37.998558 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-724dccbe-7dab-40ee-bc91-a2bd72ab50c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:21:37.998558 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:21:37.998558 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:21:37.998558 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:21:37.998558 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:21:37.998558 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:21:37.998558 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:21:37.998558 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:21:37.998558 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:21:37.998558 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:21:37.998558 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:21:37.998558 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:21:37.998558 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 11:21:37.998558 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 11:21:37.998558 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 11:21:37.998558 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 11:21:37.999589 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:21:37.999589 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:21:37.999589 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:21:37.999589 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:21:37.999589 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:21:37.999589 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:21:37.999589 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:21:37.999589 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Aug 24 11:21:37.999589 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:21:37.999589 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:21:37.999589 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:21:37.999589 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:21:37.999589 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:21:37.999589 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:21:37.999589 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:21:37.999589 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:21:37.999589 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 11:21:38.001089 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 11:21:38.001089 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:21:38.001089 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Aug 24 11:21:38.001089 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 547/1091] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 11:21:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:21:38.005501 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724dccbe-7dab-40ee-bc91-a2bd72ab50c6 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:38.031177 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:38.061315 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:38.070212 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d96c1ae-f0c0-45b5-95e0-1e14e7d31a6f None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:38.105762 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724dccbe-7dab-40ee-bc91-a2bd72ab50c6 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:38.106904 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccec389-82cb-452d-8c50-761f71be82db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:38.107644 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccec389-82cb-452d-8c50-761f71be82db None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:38.108656 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccec389-82cb-452d-8c50-761f71be82db None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:38.108656 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccec389-82cb-452d-8c50-761f71be82db None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:38.120134 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccec389-82cb-452d-8c50-761f71be82db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:21:38.124822 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-3ccec389-82cb-452d-8c50-761f71be82db None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 11:21:38.124822 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:21:38.124822 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:21:38.124822 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:21:38.124822 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:21:38.124822 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:21:38.124822 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:21:38.124822 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:21:38.124822 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:21:38.124822 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:21:38.124822 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:21:38.124822 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:21:38.124822 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:21:38.124822 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:21:38.124822 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:21:38.124822 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:21:38.125805 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:21:38.125805 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:21:38.125805 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:21:38.125805 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:21:38.125805 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:21:38.125805 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:21:38.125805 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:21:38.125805 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:21:38.125805 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:21:38.125805 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:21:38.125805 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:21:38.125805 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Aug 24 11:21:38.125805 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:21:38.125805 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:21:38.125805 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:21:38.125805 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:21:38.126710 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:21:38.126710 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:21:38.126710 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:21:38.126710 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:21:38.126710 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:21:38.126710 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:21:38.126710 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:21:38.126710 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:21:38.126710 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:21:38.126710 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:21:38.126710 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 11:21:38.126710 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:21:38.126710 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 545/1092] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Aug 24 11:21:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:21:38.131998 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccec389-82cb-452d-8c50-761f71be82db None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:38.141810 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50a8e77-cbc9-4242-b0dd-0aa8aea56b01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:38.142440 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50a8e77-cbc9-4242-b0dd-0aa8aea56b01 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:38.142712 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50a8e77-cbc9-4242-b0dd-0aa8aea56b01 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:38.142968 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50a8e77-cbc9-4242-b0dd-0aa8aea56b01 None admin] PATH_INFO: `/v3/domains` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:38.143640 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50a8e77-cbc9-4242-b0dd-0aa8aea56b01 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:21:38.143932 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50a8e77-cbc9-4242-b0dd-0aa8aea56b01 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:38.145295 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50a8e77-cbc9-4242-b0dd-0aa8aea56b01 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:38.157402 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 548/1093] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 24 11:21:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:21:38.163119 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50a8e77-cbc9-4242-b0dd-0aa8aea56b01 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:38.233994 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccec389-82cb-452d-8c50-761f71be82db None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:38.244451 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:38.263290 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50a8e77-cbc9-4242-b0dd-0aa8aea56b01 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:38.267214 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09629157-7073-4a02-9ce8-fe8d2c3a4ba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:38.267819 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09629157-7073-4a02-9ce8-fe8d2c3a4ba5 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:38.268098 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09629157-7073-4a02-9ce8-fe8d2c3a4ba5 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:38.268398 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09629157-7073-4a02-9ce8-fe8d2c3a4ba5 None admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:38.269065 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09629157-7073-4a02-9ce8-fe8d2c3a4ba5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:21:38.269369 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09629157-7073-4a02-9ce8-fe8d2c3a4ba5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:38.270801 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09629157-7073-4a02-9ce8-fe8d2c3a4ba5 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:38.280080 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 546/1094] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 24 11:21:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:21:38.286058 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09629157-7073-4a02-9ce8-fe8d2c3a4ba5 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:38.296863 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488a7497-6c3c-4738-9519-7ba41e8247a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:38.297491 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488a7497-6c3c-4738-9519-7ba41e8247a9 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:38.297765 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488a7497-6c3c-4738-9519-7ba41e8247a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:38.298029 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488a7497-6c3c-4738-9519-7ba41e8247a9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:38.302160 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:38.305393 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488a7497-6c3c-4738-9519-7ba41e8247a9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:38.306898 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488a7497-6c3c-4738-9519-7ba41e8247a9 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:38.318303 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-488a7497-6c3c-4738-9519-7ba41e8247a9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 11:21:38.318303 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:21:38.318303 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:21:38.318303 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:21:38.318303 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:21:38.318303 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:21:38.318303 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:21:38.318303 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:21:38.318303 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:21:38.318303 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:21:38.318303 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:21:38.318303 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:21:38.318303 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 11:21:38.318303 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 11:21:38.318303 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 11:21:38.318303 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 11:21:38.319443 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:21:38.319443 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:21:38.319443 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 11:21:38.319443 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 11:21:38.319443 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 11:21:38.319443 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 11:21:38.319443 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:21:38.319443 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:21:38.319443 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:21:38.319443 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:21:38.319443 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:21:38.319443 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Aug 24 11:21:38.319443 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:21:38.319443 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:21:38.319443 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:21:38.319443 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:21:38.319443 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:21:38.319443 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:21:38.320807 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:21:38.320807 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:21:38.320807 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 11:21:38.320807 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 11:21:38.320807 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 11:21:38.320807 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 11:21:38.320807 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 11:21:38.320807 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 11:21:38.320807 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 11:21:38.320807 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Aug 24 11:21:38.320807 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 549/1095] 10.222.0.27 () {56 vars in 1093 bytes} [Wed Aug 24 11:21:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 11:21:38.325129 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488a7497-6c3c-4738-9519-7ba41e8247a9 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:38.390589 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09629157-7073-4a02-9ce8-fe8d2c3a4ba5 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:38.423610 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488a7497-6c3c-4738-9519-7ba41e8247a9 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:38.426306 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680060cd-fbbc-49df-8231-43da5a60843f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:38.426978 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680060cd-fbbc-49df-8231-43da5a60843f None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:38.427250 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680060cd-fbbc-49df-8231-43da5a60843f None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:38.427518 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680060cd-fbbc-49df-8231-43da5a60843f None admin] PATH_INFO: `/v3/users/3a3604eee5704d10b17b0b1a6f497fd1` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:38.428658 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680060cd-fbbc-49df-8231-43da5a60843f None admin] RBAC: Authorizing `identity:get_user(user_id=3a3604eee5704d10b17b0b1a6f497fd1)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:38.430111 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680060cd-fbbc-49df-8231-43da5a60843f None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:38.431751 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 547/1096] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Aug 24 11:21:38 2022] GET /identity/v3/users/3a3604eee5704d10b17b0b1a6f497fd1 => generated 285 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:21:38.437514 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680060cd-fbbc-49df-8231-43da5a60843f None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:38.456591 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ebed4b-707f-4cf4-a0cf-384cd123eeb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:38.457196 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ebed4b-707f-4cf4-a0cf-384cd123eeb3 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:38.457470 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ebed4b-707f-4cf4-a0cf-384cd123eeb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:38.457734 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ebed4b-707f-4cf4-a0cf-384cd123eeb3 None admin] PATH_INFO: `/v3/users` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:38.458493 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ebed4b-707f-4cf4-a0cf-384cd123eeb3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:21:38.458787 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ebed4b-707f-4cf4-a0cf-384cd123eeb3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:38.460272 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ebed4b-707f-4cf4-a0cf-384cd123eeb3 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:38.474282 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:38.478390 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 550/1097] 10.222.0.27 () {56 vars in 1133 bytes} [Wed Aug 24 11:21:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:21:38.483853 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ebed4b-707f-4cf4-a0cf-384cd123eeb3 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:38.522491 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:38.541037 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680060cd-fbbc-49df-8231-43da5a60843f None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:38.573819 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cec62ad-a0e1-4ad1-ad12-6c75ffbc38f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:38.574453 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cec62ad-a0e1-4ad1-ad12-6c75ffbc38f9 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:38.574730 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cec62ad-a0e1-4ad1-ad12-6c75ffbc38f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:38.574990 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cec62ad-a0e1-4ad1-ad12-6c75ffbc38f9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:38.581531 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ebed4b-707f-4cf4-a0cf-384cd123eeb3 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:38.614350 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a19e75a-69b2-4909-8410-7b7933d0f6fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:38.614968 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a19e75a-69b2-4909-8410-7b7933d0f6fd None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:38.615235 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a19e75a-69b2-4909-8410-7b7933d0f6fd None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:38.615497 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a19e75a-69b2-4909-8410-7b7933d0f6fd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:38.641805 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cec62ad-a0e1-4ad1-ad12-6c75ffbc38f9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:38.643381 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cec62ad-a0e1-4ad1-ad12-6c75ffbc38f9 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:38.681471 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:38.684054 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a19e75a-69b2-4909-8410-7b7933d0f6fd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:38.685884 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a19e75a-69b2-4909-8410-7b7933d0f6fd None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:38.721898 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:38.740382 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 548/1098] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 24 11:21:38 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 24 11:21:38.746676 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cec62ad-a0e1-4ad1-ad12-6c75ffbc38f9 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:38.783780 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 551/1099] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 24 11:21:38 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 24 11:21:38.789752 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a19e75a-69b2-4909-8410-7b7933d0f6fd None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:38.843120 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cec62ad-a0e1-4ad1-ad12-6c75ffbc38f9 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:38.878429 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0338d5-658a-4c83-ba1a-9ff45310c22e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:38.879053 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0338d5-658a-4c83-ba1a-9ff45310c22e None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:38.879332 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0338d5-658a-4c83-ba1a-9ff45310c22e None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:38.879597 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0338d5-658a-4c83-ba1a-9ff45310c22e None admin] PATH_INFO: `/v3/projects/6a9cfbc69a6f40f8968f550d9b8e90d6` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:38.880701 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0338d5-658a-4c83-ba1a-9ff45310c22e None admin] RBAC: Authorizing `identity:get_project(project_id=6a9cfbc69a6f40f8968f550d9b8e90d6)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:38.882155 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0338d5-658a-4c83-ba1a-9ff45310c22e None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:38.883073 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:38.883812 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 549/1100] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Aug 24 11:21:38 2022] GET /identity/v3/projects/6a9cfbc69a6f40f8968f550d9b8e90d6 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:21:38.886240 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a19e75a-69b2-4909-8410-7b7933d0f6fd None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:38.890129 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0338d5-658a-4c83-ba1a-9ff45310c22e None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:38.921020 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6087febf-b8bf-4dae-b739-ce9b4ef440bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:38.921638 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6087febf-b8bf-4dae-b739-ce9b4ef440bb None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:38.921908 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6087febf-b8bf-4dae-b739-ce9b4ef440bb None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:38.922176 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6087febf-b8bf-4dae-b739-ce9b4ef440bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:38.932235 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6087febf-b8bf-4dae-b739-ce9b4ef440bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:38.933688 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6087febf-b8bf-4dae-b739-ce9b4ef440bb None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:38.939107 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:38.948566 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-6087febf-b8bf-4dae-b739-ce9b4ef440bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:21:38.948566 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:21:38.948566 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:21:38.948566 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:21:38.948566 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:21:38.948566 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:21:38.948566 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:21:38.948566 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:21:38.948566 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:21:38.948566 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:21:38.948566 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:21:38.948566 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:21:38.948566 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 11:21:38.948566 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 11:21:38.948566 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 11:21:38.948566 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 11:21:38.949734 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:21:38.949734 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:21:38.949734 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:21:38.949734 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:21:38.949734 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:21:38.949734 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:21:38.949734 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:21:38.949734 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Aug 24 11:21:38.949734 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:21:38.949734 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:21:38.949734 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:21:38.949734 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:21:38.949734 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:21:38.949734 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:21:38.949734 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:21:38.949734 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:21:38.949734 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 11:21:38.950982 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 11:21:38.950982 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:21:38.950982 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Aug 24 11:21:38.950982 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 552/1101] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 11:21:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 11:21:38.955438 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6087febf-b8bf-4dae-b739-ce9b4ef440bb None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:38.992936 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0338d5-658a-4c83-ba1a-9ff45310c22e None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:39.025498 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59af8448-dab7-46d0-bcf1-41930d6957b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:39.026632 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59af8448-dab7-46d0-bcf1-41930d6957b2 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:39.026909 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59af8448-dab7-46d0-bcf1-41930d6957b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:39.027174 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59af8448-dab7-46d0-bcf1-41930d6957b2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:39.027897 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59af8448-dab7-46d0-bcf1-41930d6957b2 None admin] RBAC: Adding query filter params (role.id=30bb1e97257f4ca5b90c88545777317b, scope.project.id=6a9cfbc69a6f40f8968f550d9b8e90d6, user.id=3a3604eee5704d10b17b0b1a6f497fd1) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:21:39.028193 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59af8448-dab7-46d0-bcf1-41930d6957b2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:39.029657 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59af8448-dab7-46d0-bcf1-41930d6957b2 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:39.035538 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 550/1102] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Aug 24 11:21:38 2022] GET /identity/v3/role_assignments?user.id=3a3604eee5704d10b17b0b1a6f497fd1&scope.project.id=6a9cfbc69a6f40f8968f550d9b8e90d6&role.id=30bb1e97257f4ca5b90c88545777317b => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:21:39.055255 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6087febf-b8bf-4dae-b739-ce9b4ef440bb None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:39.093826 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54cabaf-4ece-4c59-bee3-db8ad54ff7e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:39.094386 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54cabaf-4ece-4c59-bee3-db8ad54ff7e2 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:39.094663 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54cabaf-4ece-4c59-bee3-db8ad54ff7e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:39.094934 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54cabaf-4ece-4c59-bee3-db8ad54ff7e2 None admin] PATH_INFO: `/v3/domains` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:39.095598 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54cabaf-4ece-4c59-bee3-db8ad54ff7e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:21:39.095903 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54cabaf-4ece-4c59-bee3-db8ad54ff7e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:39.097449 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54cabaf-4ece-4c59-bee3-db8ad54ff7e2 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:39.116380 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 553/1103] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 24 11:21:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:21:39.117669 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59af8448-dab7-46d0-bcf1-41930d6957b2 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:39.227108 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59af8448-dab7-46d0-bcf1-41930d6957b2 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:39.241066 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:39.260971 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a9aa43-b249-4b11-9fcb-af8f93a667fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:39.261606 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a9aa43-b249-4b11-9fcb-af8f93a667fa None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:39.261881 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a9aa43-b249-4b11-9fcb-af8f93a667fa None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:39.262149 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a9aa43-b249-4b11-9fcb-af8f93a667fa None admin] PATH_INFO: `/v3/projects/service` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:39.268752 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a9aa43-b249-4b11-9fcb-af8f93a667fa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:39.270222 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a9aa43-b249-4b11-9fcb-af8f93a667fa None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:39.281788 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-67a9aa43-b249-4b11-9fcb-af8f93a667fa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 11:21:39.281788 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:21:39.281788 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:21:39.281788 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:21:39.281788 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:21:39.281788 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:21:39.281788 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:21:39.281788 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:21:39.281788 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:21:39.281788 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:21:39.281788 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:21:39.281788 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:21:39.281788 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 11:21:39.281788 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 11:21:39.281788 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 11:21:39.282781 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 11:21:39.282781 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:21:39.282781 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:21:39.282781 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:21:39.282781 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:21:39.282781 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:21:39.282781 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:21:39.282781 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:21:39.282781 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Aug 24 11:21:39.282781 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:21:39.282781 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:21:39.282781 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:21:39.282781 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:21:39.282781 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:21:39.282781 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:21:39.282781 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:21:39.282781 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:21:39.283693 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 11:21:39.283693 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 11:21:39.283693 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 11:21:39.283693 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 11:21:39.283693 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 11:21:39.283693 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 11:21:39.283693 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 11:21:39.283693 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:21:39.283693 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 551/1104] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Aug 24 11:21:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:21:39.289219 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54cabaf-4ece-4c59-bee3-db8ad54ff7e2 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:39.305600 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:39.396028 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54cabaf-4ece-4c59-bee3-db8ad54ff7e2 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:39.431005 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0639f7a3-928f-4414-8139-2e04faf984de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:39.431617 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0639f7a3-928f-4414-8139-2e04faf984de None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:39.431894 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0639f7a3-928f-4414-8139-2e04faf984de None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:39.432165 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0639f7a3-928f-4414-8139-2e04faf984de None admin] PATH_INFO: `/v3/projects` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:39.432864 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0639f7a3-928f-4414-8139-2e04faf984de None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:21:39.433163 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0639f7a3-928f-4414-8139-2e04faf984de None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:39.434635 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0639f7a3-928f-4414-8139-2e04faf984de None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:39.446416 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 554/1105] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Aug 24 11:21:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:21:39.452691 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a9aa43-b249-4b11-9fcb-af8f93a667fa None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:39.559136 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a9aa43-b249-4b11-9fcb-af8f93a667fa None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:39.593659 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05f4d3d-1d32-4c29-ba28-c8109cb11ab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:39.594260 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05f4d3d-1d32-4c29-ba28-c8109cb11ab2 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:39.594559 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05f4d3d-1d32-4c29-ba28-c8109cb11ab2 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:39.594825 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05f4d3d-1d32-4c29-ba28-c8109cb11ab2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:39.595539 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05f4d3d-1d32-4c29-ba28-c8109cb11ab2 None admin] RBAC: Adding query filter params (role.id=e59237603afa477fbb6954564862fa4a, scope.project.id=317f54a463cb48ab86648c6dcec5db0f, user.id=282ec32864d046b2bea170f6a3845cc0) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:21:39.595844 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05f4d3d-1d32-4c29-ba28-c8109cb11ab2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:39.597422 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05f4d3d-1d32-4c29-ba28-c8109cb11ab2 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:39.603279 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 552/1106] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Aug 24 11:21:39 2022] GET /identity/v3/role_assignments?user.id=282ec32864d046b2bea170f6a3845cc0&scope.project.id=317f54a463cb48ab86648c6dcec5db0f&role.id=e59237603afa477fbb6954564862fa4a => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:21:40.959949 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97f68ed-db18-43aa-b9d6-d068b5ff02a3 None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:40.960541 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97f68ed-db18-43aa-b9d6-d068b5ff02a3 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:40.960541 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97f68ed-db18-43aa-b9d6-d068b5ff02a3 None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:40.961858 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 555/1107] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:21:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:21:40.968389 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcefce99-aa7d-48d9-9075-95dbf20cc2fe None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:40.969149 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcefce99-aa7d-48d9-9075-95dbf20cc2fe None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:40.969276 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcefce99-aa7d-48d9-9075-95dbf20cc2fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:41.008730 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-dcefce99-aa7d-48d9-9075-95dbf20cc2fe None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:21:41.009939 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-dcefce99-aa7d-48d9-9075-95dbf20cc2fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:21:41.044969 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:41.093958 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 553/1108] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:21:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 11:21:41.363429 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97f68ed-db18-43aa-b9d6-d068b5ff02a3 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:41.440307 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:41.481304 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97f68ed-db18-43aa-b9d6-d068b5ff02a3 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:41.519678 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7be872-e3c8-4a25-8a30-4cc9c0f87f95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:41.520316 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7be872-e3c8-4a25-8a30-4cc9c0f87f95 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:41.520588 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7be872-e3c8-4a25-8a30-4cc9c0f87f95 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:41.520811 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7be872-e3c8-4a25-8a30-4cc9c0f87f95 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:41.522036 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7be872-e3c8-4a25-8a30-4cc9c0f87f95 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:41.523550 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7be872-e3c8-4a25-8a30-4cc9c0f87f95 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:41.525136 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 556/1109] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 11:21:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:21:41.535085 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcefce99-aa7d-48d9-9075-95dbf20cc2fe None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:41.640248 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcefce99-aa7d-48d9-9075-95dbf20cc2fe None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:41.681917 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7d66b4-c784-4542-8d97-02d03019906b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:41.682572 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7d66b4-c784-4542-8d97-02d03019906b None admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:41.682859 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7d66b4-c784-4542-8d97-02d03019906b None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:41.683130 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7d66b4-c784-4542-8d97-02d03019906b None admin] PATH_INFO: `/v3/users` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:41.683835 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7d66b4-c784-4542-8d97-02d03019906b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:41.685303 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7d66b4-c784-4542-8d97-02d03019906b None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:41.713088 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 554/1110] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Aug 24 11:21:41 2022] POST /identity/v3/users => generated 286 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:21:43.644830 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b1974c-0d47-4870-a3c9-8f02a3c1d3cc None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:43.645721 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b1974c-0d47-4870-a3c9-8f02a3c1d3cc None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:43.645721 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b1974c-0d47-4870-a3c9-8f02a3c1d3cc None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:43.647891 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 557/1111] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:21:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:21:43.657217 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0411da1-3aea-4daf-84fb-59b132ee57a4 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:43.657635 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0411da1-3aea-4daf-84fb-59b132ee57a4 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:43.657817 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0411da1-3aea-4daf-84fb-59b132ee57a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:43.679323 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-e0411da1-3aea-4daf-84fb-59b132ee57a4 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:21:43.680515 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-e0411da1-3aea-4daf-84fb-59b132ee57a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:21:43.699206 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:43.750706 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 555/1112] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:21:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 11:21:44.018075 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b1974c-0d47-4870-a3c9-8f02a3c1d3cc None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:44.132168 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b1974c-0d47-4870-a3c9-8f02a3c1d3cc None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:44.168768 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ad7c7c-cd4f-44b4-a082-a153a97dedf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:44.169379 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ad7c7c-cd4f-44b4-a082-a153a97dedf1 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:44.169649 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ad7c7c-cd4f-44b4-a082-a153a97dedf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:44.169915 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ad7c7c-cd4f-44b4-a082-a153a97dedf1 None admin] PATH_INFO: `/v3/roles/96f07e9110194606acccfbd8467649a7` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:44.171416 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ad7c7c-cd4f-44b4-a082-a153a97dedf1 None admin] RBAC: Authorizing `identity:get_role(role_id=96f07e9110194606acccfbd8467649a7)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:44.172818 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ad7c7c-cd4f-44b4-a082-a153a97dedf1 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:44.174143 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 558/1113] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Aug 24 11:21:44 2022] GET /identity/v3/roles/96f07e9110194606acccfbd8467649a7 => generated 223 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:21:44.180398 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0411da1-3aea-4daf-84fb-59b132ee57a4 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:44.286158 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0411da1-3aea-4daf-84fb-59b132ee57a4 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:44.320451 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c9a9ff-367a-44e4-b729-0ee5921f50ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:44.321053 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c9a9ff-367a-44e4-b729-0ee5921f50ce None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:44.321323 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c9a9ff-367a-44e4-b729-0ee5921f50ce None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:44.321584 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c9a9ff-367a-44e4-b729-0ee5921f50ce None admin] PATH_INFO: `/v3/users/16450ad9829d4c11a31ea8b2c7565735` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:44.334849 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c9a9ff-367a-44e4-b729-0ee5921f50ce None admin] RBAC: Authorizing `identity:get_user(user_id=16450ad9829d4c11a31ea8b2c7565735)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:44.336306 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c9a9ff-367a-44e4-b729-0ee5921f50ce None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:44.337875 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 556/1114] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Aug 24 11:21:44 2022] GET /identity/v3/users/16450ad9829d4c11a31ea8b2c7565735 => generated 286 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:21:44.344436 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ad7c7c-cd4f-44b4-a082-a153a97dedf1 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:44.357524 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:44.454968 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ad7c7c-cd4f-44b4-a082-a153a97dedf1 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:44.493421 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7112e637-8dff-4928-8c9b-bc5ef50c326d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:44.494013 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7112e637-8dff-4928-8c9b-bc5ef50c326d None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:44.494280 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7112e637-8dff-4928-8c9b-bc5ef50c326d None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:44.494580 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7112e637-8dff-4928-8c9b-bc5ef50c326d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:44.565841 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7112e637-8dff-4928-8c9b-bc5ef50c326d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:44.567233 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7112e637-8dff-4928-8c9b-bc5ef50c326d None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:44.576514 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:44.669239 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 559/1115] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 24 11:21:44 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 11:21:44.676262 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c9a9ff-367a-44e4-b729-0ee5921f50ce None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:44.691411 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:44.779015 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c9a9ff-367a-44e4-b729-0ee5921f50ce None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:44.813946 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9244b129-4a5b-4a1f-8e6e-1ca803dd2da1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:44.814586 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9244b129-4a5b-4a1f-8e6e-1ca803dd2da1 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:44.814857 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9244b129-4a5b-4a1f-8e6e-1ca803dd2da1 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:44.815176 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9244b129-4a5b-4a1f-8e6e-1ca803dd2da1 None admin] PATH_INFO: `/v3/projects/6a9cfbc69a6f40f8968f550d9b8e90d6` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:44.816395 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9244b129-4a5b-4a1f-8e6e-1ca803dd2da1 None admin] RBAC: Authorizing `identity:get_project(project_id=6a9cfbc69a6f40f8968f550d9b8e90d6)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:44.817783 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9244b129-4a5b-4a1f-8e6e-1ca803dd2da1 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:44.819414 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 557/1116] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Aug 24 11:21:44 2022] GET /identity/v3/projects/6a9cfbc69a6f40f8968f550d9b8e90d6 => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:21:44.828663 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7112e637-8dff-4928-8c9b-bc5ef50c326d None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:44.927914 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7112e637-8dff-4928-8c9b-bc5ef50c326d None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:44.937099 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:44.963736 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333f0bbf-76fd-4bc8-b50d-0f3770ec7cee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:44.964318 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333f0bbf-76fd-4bc8-b50d-0f3770ec7cee None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:44.964587 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333f0bbf-76fd-4bc8-b50d-0f3770ec7cee None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:44.964849 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333f0bbf-76fd-4bc8-b50d-0f3770ec7cee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:44.965567 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333f0bbf-76fd-4bc8-b50d-0f3770ec7cee None admin] RBAC: Adding query filter params (role.id=96f07e9110194606acccfbd8467649a7, scope.project.id=6a9cfbc69a6f40f8968f550d9b8e90d6, user.id=16450ad9829d4c11a31ea8b2c7565735) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:21:44.965868 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333f0bbf-76fd-4bc8-b50d-0f3770ec7cee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:44.967313 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333f0bbf-76fd-4bc8-b50d-0f3770ec7cee None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:44.972813 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 560/1117] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Aug 24 11:21:44 2022] GET /identity/v3/role_assignments?user.id=16450ad9829d4c11a31ea8b2c7565735&scope.project.id=6a9cfbc69a6f40f8968f550d9b8e90d6&role.id=96f07e9110194606acccfbd8467649a7 => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:21:46.842179 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7493b5-35f7-4281-8037-8a538838feaa None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:46.843160 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7493b5-35f7-4281-8037-8a538838feaa None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:46.843160 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7493b5-35f7-4281-8037-8a538838feaa None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:46.845297 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 558/1118] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:21:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:21:46.851655 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eb58ae-bb19-4b22-95b0-05765b0f201e None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:46.852358 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eb58ae-bb19-4b22-95b0-05765b0f201e None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:46.852502 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eb58ae-bb19-4b22-95b0-05765b0f201e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:46.875273 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-67eb58ae-bb19-4b22-95b0-05765b0f201e None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:21:46.876467 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-67eb58ae-bb19-4b22-95b0-05765b0f201e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:21:46.946747 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 561/1119] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:21:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 11:21:47.217527 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7493b5-35f7-4281-8037-8a538838feaa None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:47.303964 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:47.326462 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7493b5-35f7-4281-8037-8a538838feaa None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:47.361744 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e466579a-d37f-4818-808f-47a5091554bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:47.362320 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e466579a-d37f-4818-808f-47a5091554bf None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:47.362625 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e466579a-d37f-4818-808f-47a5091554bf None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:47.362888 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e466579a-d37f-4818-808f-47a5091554bf None admin] PATH_INFO: `/v3/roles/96f07e9110194606acccfbd8467649a7` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:47.364384 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e466579a-d37f-4818-808f-47a5091554bf None admin] RBAC: Authorizing `identity:get_role(role_id=96f07e9110194606acccfbd8467649a7)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:47.365771 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e466579a-d37f-4818-808f-47a5091554bf None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:47.367088 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 559/1120] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Aug 24 11:21:47 2022] GET /identity/v3/roles/96f07e9110194606acccfbd8467649a7 => generated 223 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:21:47.376469 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67eb58ae-bb19-4b22-95b0-05765b0f201e None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:47.480135 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67eb58ae-bb19-4b22-95b0-05765b0f201e None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:47.481715 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:47.534572 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799d0633-22c5-4777-a8a6-a16cb4b80dfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:47.535219 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799d0633-22c5-4777-a8a6-a16cb4b80dfd None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:47.535488 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799d0633-22c5-4777-a8a6-a16cb4b80dfd None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:47.535747 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799d0633-22c5-4777-a8a6-a16cb4b80dfd None admin] PATH_INFO: `/v3/users/16450ad9829d4c11a31ea8b2c7565735` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:47.536858 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799d0633-22c5-4777-a8a6-a16cb4b80dfd None admin] RBAC: Authorizing `identity:get_user(user_id=16450ad9829d4c11a31ea8b2c7565735)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:47.538286 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799d0633-22c5-4777-a8a6-a16cb4b80dfd None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:47.539955 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 562/1121] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Aug 24 11:21:47 2022] GET /identity/v3/users/16450ad9829d4c11a31ea8b2c7565735 => generated 286 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:21:47.545964 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e466579a-d37f-4818-808f-47a5091554bf None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:47.661034 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e466579a-d37f-4818-808f-47a5091554bf None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:47.699533 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a9898b-4cf6-4444-b942-3f5b28fd0356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:47.700166 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a9898b-4cf6-4444-b942-3f5b28fd0356 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:47.700459 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a9898b-4cf6-4444-b942-3f5b28fd0356 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:47.700730 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a9898b-4cf6-4444-b942-3f5b28fd0356 None admin] PATH_INFO: `/v3/projects/6a9cfbc69a6f40f8968f550d9b8e90d6` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:47.701981 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a9898b-4cf6-4444-b942-3f5b28fd0356 None admin] RBAC: Authorizing `identity:get_project(project_id=6a9cfbc69a6f40f8968f550d9b8e90d6)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:47.703470 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a9898b-4cf6-4444-b942-3f5b28fd0356 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:47.705101 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 560/1122] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Aug 24 11:21:47 2022] GET /identity/v3/projects/6a9cfbc69a6f40f8968f550d9b8e90d6 => generated 311 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:21:47.711674 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799d0633-22c5-4777-a8a6-a16cb4b80dfd None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:47.817904 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799d0633-22c5-4777-a8a6-a16cb4b80dfd None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:47.854232 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebf1adc-3b84-4d78-bf75-fe90dad847b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:47.855023 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebf1adc-3b84-4d78-bf75-fe90dad847b6 None admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:47.855168 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebf1adc-3b84-4d78-bf75-fe90dad847b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:47.855464 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebf1adc-3b84-4d78-bf75-fe90dad847b6 None admin] PATH_INFO: `/v3/projects/6a9cfbc69a6f40f8968f550d9b8e90d6/users/16450ad9829d4c11a31ea8b2c7565735/roles/96f07e9110194606acccfbd8467649a7` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:47.857783 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebf1adc-3b84-4d78-bf75-fe90dad847b6 None admin] RBAC: Authorizing `identity:create_grant(project_id=6a9cfbc69a6f40f8968f550d9b8e90d6, user_id=16450ad9829d4c11a31ea8b2c7565735, role_id=96f07e9110194606acccfbd8467649a7)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:47.859255 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebf1adc-3b84-4d78-bf75-fe90dad847b6 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:47.874637 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 563/1123] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Aug 24 11:21:47 2022] PUT /identity/v3/projects/6a9cfbc69a6f40f8968f550d9b8e90d6/users/16450ad9829d4c11a31ea8b2c7565735/roles/96f07e9110194606acccfbd8467649a7 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 11:21:49.738713 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4367e73b-dc6d-4912-b311-0c375d24b4cf None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:49.739341 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4367e73b-dc6d-4912-b311-0c375d24b4cf None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:49.739341 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4367e73b-dc6d-4912-b311-0c375d24b4cf None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:49.740664 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 561/1124] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:21:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:21:49.747362 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e8db01-3406-451b-b6dd-a57a7f31c661 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:49.748133 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e8db01-3406-451b-b6dd-a57a7f31c661 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:49.748285 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e8db01-3406-451b-b6dd-a57a7f31c661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:49.775343 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-16e8db01-3406-451b-b6dd-a57a7f31c661 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:21:49.776934 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-16e8db01-3406-451b-b6dd-a57a7f31c661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:21:49.801579 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:49.860395 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 564/1125] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:21:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 11:21:50.125605 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4367e73b-dc6d-4912-b311-0c375d24b4cf None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:50.145082 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:50.230725 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4367e73b-dc6d-4912-b311-0c375d24b4cf None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:50.270134 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8131c5c-980d-4c85-8f49-aff11cc3b71c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:50.270789 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8131c5c-980d-4c85-8f49-aff11cc3b71c None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:50.271067 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8131c5c-980d-4c85-8f49-aff11cc3b71c None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:50.271334 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8131c5c-980d-4c85-8f49-aff11cc3b71c None admin] PATH_INFO: `/v3/roles/96f07e9110194606acccfbd8467649a7` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:50.272824 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8131c5c-980d-4c85-8f49-aff11cc3b71c None admin] RBAC: Authorizing `identity:get_role(role_id=96f07e9110194606acccfbd8467649a7)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:50.274224 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8131c5c-980d-4c85-8f49-aff11cc3b71c None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:50.275577 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 562/1126] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Aug 24 11:21:50 2022] GET /identity/v3/roles/96f07e9110194606acccfbd8467649a7 => generated 223 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:21:50.282448 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e8db01-3406-451b-b6dd-a57a7f31c661 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:50.387183 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e8db01-3406-451b-b6dd-a57a7f31c661 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:50.422911 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb45d84-d168-43ca-8b44-e3ac675dd203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:50.423531 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb45d84-d168-43ca-8b44-e3ac675dd203 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:50.423806 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb45d84-d168-43ca-8b44-e3ac675dd203 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:50.424079 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb45d84-d168-43ca-8b44-e3ac675dd203 None admin] PATH_INFO: `/v3/users/16450ad9829d4c11a31ea8b2c7565735` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:50.425373 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb45d84-d168-43ca-8b44-e3ac675dd203 None admin] RBAC: Authorizing `identity:get_user(user_id=16450ad9829d4c11a31ea8b2c7565735)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:50.426858 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb45d84-d168-43ca-8b44-e3ac675dd203 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:50.428423 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 565/1127] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Aug 24 11:21:50 2022] GET /identity/v3/users/16450ad9829d4c11a31ea8b2c7565735 => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:21:50.434642 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8131c5c-980d-4c85-8f49-aff11cc3b71c None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:50.522590 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:50.539901 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8131c5c-980d-4c85-8f49-aff11cc3b71c None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:50.575822 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a4821a-24da-4cb9-bc6d-acc5dad92ab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:50.576423 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a4821a-24da-4cb9-bc6d-acc5dad92ab0 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:50.576697 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a4821a-24da-4cb9-bc6d-acc5dad92ab0 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:50.576967 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a4821a-24da-4cb9-bc6d-acc5dad92ab0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:50.645559 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a4821a-24da-4cb9-bc6d-acc5dad92ab0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:50.646985 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a4821a-24da-4cb9-bc6d-acc5dad92ab0 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:50.729878 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:50.750945 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 563/1128] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 24 11:21:50 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 11:21:50.757257 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb45d84-d168-43ca-8b44-e3ac675dd203 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:50.787604 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:50.861721 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb45d84-d168-43ca-8b44-e3ac675dd203 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:50.896835 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba038579-c39a-42e8-b035-0b7dc70b3db6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:50.897390 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba038579-c39a-42e8-b035-0b7dc70b3db6 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:50.897664 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba038579-c39a-42e8-b035-0b7dc70b3db6 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:50.897931 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba038579-c39a-42e8-b035-0b7dc70b3db6 None admin] PATH_INFO: `/v3/projects/6a9cfbc69a6f40f8968f550d9b8e90d6` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:50.899127 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba038579-c39a-42e8-b035-0b7dc70b3db6 None admin] RBAC: Authorizing `identity:get_project(project_id=6a9cfbc69a6f40f8968f550d9b8e90d6)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:50.900561 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba038579-c39a-42e8-b035-0b7dc70b3db6 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:50.902570 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 566/1129] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Aug 24 11:21:50 2022] GET /identity/v3/projects/6a9cfbc69a6f40f8968f550d9b8e90d6 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:21:50.909675 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a4821a-24da-4cb9-bc6d-acc5dad92ab0 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:51.036995 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a4821a-24da-4cb9-bc6d-acc5dad92ab0 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:51.072499 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c13f1c6-50a0-45c1-ab58-18194a7ed701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:51.073085 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c13f1c6-50a0-45c1-ab58-18194a7ed701 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:51.073364 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c13f1c6-50a0-45c1-ab58-18194a7ed701 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:51.073619 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c13f1c6-50a0-45c1-ab58-18194a7ed701 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:51.074331 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c13f1c6-50a0-45c1-ab58-18194a7ed701 None admin] RBAC: Adding query filter params (role.id=96f07e9110194606acccfbd8467649a7, scope.project.id=6a9cfbc69a6f40f8968f550d9b8e90d6, user.id=16450ad9829d4c11a31ea8b2c7565735) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:21:51.074663 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c13f1c6-50a0-45c1-ab58-18194a7ed701 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:51.076096 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c13f1c6-50a0-45c1-ab58-18194a7ed701 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:51.081909 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 564/1130] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Aug 24 11:21:50 2022] GET /identity/v3/role_assignments?user.id=16450ad9829d4c11a31ea8b2c7565735&scope.project.id=6a9cfbc69a6f40f8968f550d9b8e90d6&role.id=96f07e9110194606acccfbd8467649a7 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:21:52.990384 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f70ccc6-30aa-45ef-be48-5748f3eca4b7 None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:52.991276 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f70ccc6-30aa-45ef-be48-5748f3eca4b7 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:52.991276 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f70ccc6-30aa-45ef-be48-5748f3eca4b7 None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:52.993471 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 567/1131] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:21:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:21:52.999956 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a865da-88d7-474e-8c30-7c47ecfc2bfa None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:53.000660 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a865da-88d7-474e-8c30-7c47ecfc2bfa None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:53.000862 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a865da-88d7-474e-8c30-7c47ecfc2bfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:53.027424 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-a0a865da-88d7-474e-8c30-7c47ecfc2bfa None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:21:53.028706 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-a0a865da-88d7-474e-8c30-7c47ecfc2bfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:21:53.075059 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:53.100221 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 565/1132] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:21:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 11:21:53.364693 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f70ccc6-30aa-45ef-be48-5748f3eca4b7 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:53.467886 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:53.476212 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f70ccc6-30aa-45ef-be48-5748f3eca4b7 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:53.510576 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2fc378-fa10-45ca-9eb4-afba3833f20f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:53.511193 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2fc378-fa10-45ca-9eb4-afba3833f20f None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:53.511466 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2fc378-fa10-45ca-9eb4-afba3833f20f None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:53.511731 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2fc378-fa10-45ca-9eb4-afba3833f20f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:53.512852 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2fc378-fa10-45ca-9eb4-afba3833f20f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:53.514296 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2fc378-fa10-45ca-9eb4-afba3833f20f None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:53.515886 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 568/1133] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 11:21:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:21:53.522569 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a865da-88d7-474e-8c30-7c47ecfc2bfa None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:53.628176 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a865da-88d7-474e-8c30-7c47ecfc2bfa None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:53.665982 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a550a4-a268-4f33-93e0-e7440a49378f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:53.666676 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a550a4-a268-4f33-93e0-e7440a49378f None admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:53.666956 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a550a4-a268-4f33-93e0-e7440a49378f None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:53.667231 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a550a4-a268-4f33-93e0-e7440a49378f None admin] PATH_INFO: `/v3/projects` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:53.667887 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a550a4-a268-4f33-93e0-e7440a49378f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:53.669347 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a550a4-a268-4f33-93e0-e7440a49378f None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:53.705264 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 566/1134] 10.222.0.27 () {60 vars in 1141 bytes} [Wed Aug 24 11:21:53 2022] POST /identity/v3/projects => generated 311 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:21:55.587137 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e501fe7-d0f1-4b3e-b0d1-15d12a44ebc8 None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:55.587963 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e501fe7-d0f1-4b3e-b0d1-15d12a44ebc8 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:55.587963 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e501fe7-d0f1-4b3e-b0d1-15d12a44ebc8 None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:55.590086 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 569/1135] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:21:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:21:55.596502 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c558d37b-f5c6-417c-8a19-518bae4b96b9 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:55.596969 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c558d37b-f5c6-417c-8a19-518bae4b96b9 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:55.597063 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c558d37b-f5c6-417c-8a19-518bae4b96b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:55.616781 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-c558d37b-f5c6-417c-8a19-518bae4b96b9 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:21:55.617977 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-c558d37b-f5c6-417c-8a19-518bae4b96b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:21:55.643770 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:55.694770 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 567/1136] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:21:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 11:21:55.959567 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e501fe7-d0f1-4b3e-b0d1-15d12a44ebc8 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:56.075191 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e501fe7-d0f1-4b3e-b0d1-15d12a44ebc8 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:56.111721 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aa494d-62aa-4b6b-a7d1-439670beca41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:56.112335 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aa494d-62aa-4b6b-a7d1-439670beca41 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:56.112604 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aa494d-62aa-4b6b-a7d1-439670beca41 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:56.112862 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aa494d-62aa-4b6b-a7d1-439670beca41 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:56.113994 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87aa494d-62aa-4b6b-a7d1-439670beca41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:56.115449 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87aa494d-62aa-4b6b-a7d1-439670beca41 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:56.117004 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 570/1137] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 11:21:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:21:56.126421 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c558d37b-f5c6-417c-8a19-518bae4b96b9 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:56.228122 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c558d37b-f5c6-417c-8a19-518bae4b96b9 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:56.262817 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c10d1f5-c970-4c0e-a517-6ac3e6b13fa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:56.263409 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c10d1f5-c970-4c0e-a517-6ac3e6b13fa6 None admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:56.263678 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c10d1f5-c970-4c0e-a517-6ac3e6b13fa6 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:56.263949 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c10d1f5-c970-4c0e-a517-6ac3e6b13fa6 None admin] PATH_INFO: `/v3/users` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:56.264590 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c10d1f5-c970-4c0e-a517-6ac3e6b13fa6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:56.266027 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c10d1f5-c970-4c0e-a517-6ac3e6b13fa6 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:56.295066 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 568/1138] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Aug 24 11:21:56 2022] POST /identity/v3/users => generated 286 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:21:58.196070 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8823d570-3e1e-4ee0-a1c0-50c85eb82746 None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:58.196934 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8823d570-3e1e-4ee0-a1c0-50c85eb82746 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:58.196934 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8823d570-3e1e-4ee0-a1c0-50c85eb82746 None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:58.199170 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 571/1139] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:21:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:21:58.204864 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c626d475-c73c-49eb-9913-d8c840bffd90 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:58.205400 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c626d475-c73c-49eb-9913-d8c840bffd90 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:58.205400 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c626d475-c73c-49eb-9913-d8c840bffd90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:58.232843 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-c626d475-c73c-49eb-9913-d8c840bffd90 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:21:58.234793 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-c626d475-c73c-49eb-9913-d8c840bffd90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:21:58.246642 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:58.324476 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 569/1140] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:21:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 11:21:58.587422 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8823d570-3e1e-4ee0-a1c0-50c85eb82746 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:58.631079 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:58.704885 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8823d570-3e1e-4ee0-a1c0-50c85eb82746 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:58.749412 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5f071c-0975-4adc-96d7-d54443f57d80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:58.750053 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5f071c-0975-4adc-96d7-d54443f57d80 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:58.750330 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5f071c-0975-4adc-96d7-d54443f57d80 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:58.750632 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5f071c-0975-4adc-96d7-d54443f57d80 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:58.762767 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5f071c-0975-4adc-96d7-d54443f57d80 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:21:58.767413 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-3b5f071c-0975-4adc-96d7-d54443f57d80 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 11:21:58.767413 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:21:58.767413 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:21:58.767413 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:21:58.767413 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:21:58.767413 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:21:58.767413 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:21:58.767413 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:21:58.767413 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:21:58.767413 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:21:58.767413 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:21:58.767413 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:21:58.767413 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:21:58.767413 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:21:58.767413 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:21:58.767413 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:21:58.768702 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:21:58.768702 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:21:58.768702 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:21:58.768702 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:21:58.768702 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:21:58.768702 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:21:58.768702 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:21:58.768702 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:21:58.768702 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:21:58.768702 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:21:58.768702 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:21:58.768702 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Aug 24 11:21:58.768702 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:21:58.768702 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:21:58.768702 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:21:58.768702 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:21:58.769836 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:21:58.769836 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:21:58.769836 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:21:58.769836 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:21:58.769836 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:21:58.769836 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:21:58.769836 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:21:58.769836 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:21:58.769836 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:21:58.769836 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:21:58.769836 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 11:21:58.769836 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Aug 24 11:21:58.769836 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 572/1141] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Aug 24 11:21:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:21:58.774952 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c626d475-c73c-49eb-9913-d8c840bffd90 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:58.874988 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c626d475-c73c-49eb-9913-d8c840bffd90 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:58.911095 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91534ea-23bc-44bc-bdae-05526cb3ff1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:58.911690 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91534ea-23bc-44bc-bdae-05526cb3ff1c None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:58.911966 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91534ea-23bc-44bc-bdae-05526cb3ff1c None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:58.912239 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91534ea-23bc-44bc-bdae-05526cb3ff1c None admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:58.912933 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91534ea-23bc-44bc-bdae-05526cb3ff1c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:21:58.913242 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91534ea-23bc-44bc-bdae-05526cb3ff1c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:58.914656 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91534ea-23bc-44bc-bdae-05526cb3ff1c None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:58.922797 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 570/1142] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 24 11:21:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:21:58.928850 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5f071c-0975-4adc-96d7-d54443f57d80 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:59.022728 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:59.032627 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5f071c-0975-4adc-96d7-d54443f57d80 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:59.066535 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681e76bb-6064-4784-998e-6c73ac86810a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:59.067148 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681e76bb-6064-4784-998e-6c73ac86810a None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:59.067428 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681e76bb-6064-4784-998e-6c73ac86810a None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:59.067702 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681e76bb-6064-4784-998e-6c73ac86810a None admin] PATH_INFO: `/v3/users/2cf87623ae3b4b508ad6813ab8ec781d` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:59.081242 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681e76bb-6064-4784-998e-6c73ac86810a None admin] RBAC: Authorizing `identity:get_user(user_id=2cf87623ae3b4b508ad6813ab8ec781d)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:59.082723 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681e76bb-6064-4784-998e-6c73ac86810a None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:59.084319 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 573/1143] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Aug 24 11:21:58 2022] GET /identity/v3/users/2cf87623ae3b4b508ad6813ab8ec781d => generated 286 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:21:59.090381 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91534ea-23bc-44bc-bdae-05526cb3ff1c None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:59.102813 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:59.197916 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91534ea-23bc-44bc-bdae-05526cb3ff1c None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:59.232866 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bfc33b-7ac1-474b-af05-32881a2b686c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:59.233475 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bfc33b-7ac1-474b-af05-32881a2b686c None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:59.233756 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bfc33b-7ac1-474b-af05-32881a2b686c None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:59.234027 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bfc33b-7ac1-474b-af05-32881a2b686c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:59.302243 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bfc33b-7ac1-474b-af05-32881a2b686c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:59.303777 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bfc33b-7ac1-474b-af05-32881a2b686c None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:59.314012 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:59.425063 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 571/1144] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 24 11:21:59 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 11:21:59.434706 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681e76bb-6064-4784-998e-6c73ac86810a None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:59.547149 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681e76bb-6064-4784-998e-6c73ac86810a None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:59.582336 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463fced5-a877-4187-a6ca-386aecec74e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:59.582973 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463fced5-a877-4187-a6ca-386aecec74e6 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:59.583241 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463fced5-a877-4187-a6ca-386aecec74e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:59.583502 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463fced5-a877-4187-a6ca-386aecec74e6 None admin] PATH_INFO: `/v3/projects/087e1478f14d4d32bf0e56d605a9a549` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:59.584732 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463fced5-a877-4187-a6ca-386aecec74e6 None admin] RBAC: Authorizing `identity:get_project(project_id=087e1478f14d4d32bf0e56d605a9a549)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:59.586168 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463fced5-a877-4187-a6ca-386aecec74e6 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:59.587822 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 574/1145] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Aug 24 11:21:59 2022] GET /identity/v3/projects/087e1478f14d4d32bf0e56d605a9a549 => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:21:59.595021 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bfc33b-7ac1-474b-af05-32881a2b686c None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:21:59.709758 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bfc33b-7ac1-474b-af05-32881a2b686c None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:21:59.721044 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:59.754688 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a3d7c7-629a-4647-9fba-f4e0b9eb8d96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:21:59.755331 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a3d7c7-629a-4647-9fba-f4e0b9eb8d96 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:21:59.755601 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a3d7c7-629a-4647-9fba-f4e0b9eb8d96 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:21:59.755868 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a3d7c7-629a-4647-9fba-f4e0b9eb8d96 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:21:59.756592 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a3d7c7-629a-4647-9fba-f4e0b9eb8d96 None admin] RBAC: Adding query filter params (role.id=30bb1e97257f4ca5b90c88545777317b, scope.project.id=087e1478f14d4d32bf0e56d605a9a549, user.id=2cf87623ae3b4b508ad6813ab8ec781d) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:21:59.756892 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a3d7c7-629a-4647-9fba-f4e0b9eb8d96 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:21:59.758346 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a3d7c7-629a-4647-9fba-f4e0b9eb8d96 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:21:59.764016 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 572/1146] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Aug 24 11:21:59 2022] GET /identity/v3/role_assignments?user.id=2cf87623ae3b4b508ad6813ab8ec781d&scope.project.id=087e1478f14d4d32bf0e56d605a9a549&role.id=30bb1e97257f4ca5b90c88545777317b => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:22:01.598420 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fff4b8f-90c8-4c1c-abb3-e910a2d46d8e None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:22:01.599335 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fff4b8f-90c8-4c1c-abb3-e910a2d46d8e None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:22:01.599433 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fff4b8f-90c8-4c1c-abb3-e910a2d46d8e None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:22:01.601518 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 575/1147] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:22:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:22:01.606910 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6055bf7-fb76-45a3-a152-13287e153f53 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:22:01.607351 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6055bf7-fb76-45a3-a152-13287e153f53 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:22:01.607455 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6055bf7-fb76-45a3-a152-13287e153f53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:22:01.627324 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-b6055bf7-fb76-45a3-a152-13287e153f53 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:22:01.628499 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-b6055bf7-fb76-45a3-a152-13287e153f53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:22:01.696966 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 573/1148] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:22:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 11:22:01.957978 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fff4b8f-90c8-4c1c-abb3-e910a2d46d8e None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:22:01.988518 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:22:02.076685 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fff4b8f-90c8-4c1c-abb3-e910a2d46d8e None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:22:02.113011 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21644dc-7757-459f-b3ac-62b9e7eb0c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:22:02.113649 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21644dc-7757-459f-b3ac-62b9e7eb0c3a None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:22:02.113927 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21644dc-7757-459f-b3ac-62b9e7eb0c3a None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:22:02.114192 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21644dc-7757-459f-b3ac-62b9e7eb0c3a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:22:02.125416 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21644dc-7757-459f-b3ac-62b9e7eb0c3a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:22:02.130125 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-e21644dc-7757-459f-b3ac-62b9e7eb0c3a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 11:22:02.130125 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:22:02.130125 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:22:02.130125 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:22:02.130125 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:22:02.130125 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:22:02.130125 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:22:02.130125 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:22:02.130125 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:22:02.130125 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:22:02.130125 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:22:02.130125 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:22:02.130125 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:22:02.130125 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:22:02.130125 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:22:02.130125 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:22:02.131284 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:22:02.131284 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:22:02.131284 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:22:02.131284 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:22:02.131284 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:22:02.131284 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:22:02.131284 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:22:02.131284 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:22:02.131284 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:22:02.131284 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:22:02.131284 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:22:02.131284 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Aug 24 11:22:02.131284 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:22:02.131284 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:22:02.131284 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:22:02.131284 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:22:02.132318 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:22:02.132318 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:22:02.132318 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:22:02.132318 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:22:02.132318 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:22:02.132318 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:22:02.132318 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:22:02.132318 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:22:02.132318 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:22:02.132318 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:22:02.132318 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 11:22:02.132318 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Aug 24 11:22:02.132318 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 576/1149] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Aug 24 11:22:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:22:02.137554 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6055bf7-fb76-45a3-a152-13287e153f53 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:22:02.245804 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6055bf7-fb76-45a3-a152-13287e153f53 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:22:02.247378 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:22:02.283443 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f342dfa-ea29-44e0-aa83-1f1419dfa229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:22:02.284086 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f342dfa-ea29-44e0-aa83-1f1419dfa229 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:22:02.284359 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f342dfa-ea29-44e0-aa83-1f1419dfa229 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:22:02.284628 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f342dfa-ea29-44e0-aa83-1f1419dfa229 None admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:22:02.285266 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f342dfa-ea29-44e0-aa83-1f1419dfa229 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:22:02.285568 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f342dfa-ea29-44e0-aa83-1f1419dfa229 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:22:02.286985 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f342dfa-ea29-44e0-aa83-1f1419dfa229 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:22:02.295034 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 574/1150] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 24 11:22:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:22:02.301718 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21644dc-7757-459f-b3ac-62b9e7eb0c3a None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:22:02.397215 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:22:02.423945 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21644dc-7757-459f-b3ac-62b9e7eb0c3a None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:22:02.459460 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f95d8d-7caf-4fa5-b580-853197464be9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:22:02.460090 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f95d8d-7caf-4fa5-b580-853197464be9 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:22:02.460360 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f95d8d-7caf-4fa5-b580-853197464be9 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:22:02.460631 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f95d8d-7caf-4fa5-b580-853197464be9 None admin] PATH_INFO: `/v3/users/2cf87623ae3b4b508ad6813ab8ec781d` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:22:02.461800 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f95d8d-7caf-4fa5-b580-853197464be9 None admin] RBAC: Authorizing `identity:get_user(user_id=2cf87623ae3b4b508ad6813ab8ec781d)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:22:02.463296 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f95d8d-7caf-4fa5-b580-853197464be9 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:22:02.464872 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 577/1151] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Aug 24 11:22:02 2022] GET /identity/v3/users/2cf87623ae3b4b508ad6813ab8ec781d => generated 286 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:22:02.471225 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f342dfa-ea29-44e0-aa83-1f1419dfa229 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:22:02.572654 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f342dfa-ea29-44e0-aa83-1f1419dfa229 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:22:02.609915 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4f867a-6b75-4dab-a26b-bf33356e0385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:22:02.610540 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4f867a-6b75-4dab-a26b-bf33356e0385 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:22:02.610955 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4f867a-6b75-4dab-a26b-bf33356e0385 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:22:02.611303 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4f867a-6b75-4dab-a26b-bf33356e0385 None admin] PATH_INFO: `/v3/projects/087e1478f14d4d32bf0e56d605a9a549` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:22:02.613237 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4f867a-6b75-4dab-a26b-bf33356e0385 None admin] RBAC: Authorizing `identity:get_project(project_id=087e1478f14d4d32bf0e56d605a9a549)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:22:02.615585 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4f867a-6b75-4dab-a26b-bf33356e0385 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:22:02.618120 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 575/1152] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Aug 24 11:22:02 2022] GET /identity/v3/projects/087e1478f14d4d32bf0e56d605a9a549 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:22:02.624353 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f95d8d-7caf-4fa5-b580-853197464be9 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:22:02.730174 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f95d8d-7caf-4fa5-b580-853197464be9 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:22:02.764748 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6862d6-45cd-4f50-aa8c-5dc79f1e0fb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:22:02.765387 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6862d6-45cd-4f50-aa8c-5dc79f1e0fb8 None admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:22:02.765664 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6862d6-45cd-4f50-aa8c-5dc79f1e0fb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:22:02.765933 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6862d6-45cd-4f50-aa8c-5dc79f1e0fb8 None admin] PATH_INFO: `/v3/projects/087e1478f14d4d32bf0e56d605a9a549/users/2cf87623ae3b4b508ad6813ab8ec781d/roles/30bb1e97257f4ca5b90c88545777317b` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:22:02.768149 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6862d6-45cd-4f50-aa8c-5dc79f1e0fb8 None admin] RBAC: Authorizing `identity:create_grant(project_id=087e1478f14d4d32bf0e56d605a9a549, user_id=2cf87623ae3b4b508ad6813ab8ec781d, role_id=30bb1e97257f4ca5b90c88545777317b)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:22:02.769579 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6862d6-45cd-4f50-aa8c-5dc79f1e0fb8 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:22:02.785652 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 578/1153] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Aug 24 11:22:02 2022] PUT /identity/v3/projects/087e1478f14d4d32bf0e56d605a9a549/users/2cf87623ae3b4b508ad6813ab8ec781d/roles/30bb1e97257f4ca5b90c88545777317b => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:22:04.628737 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5109903-a244-4011-b336-9d9440b153fc None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:22:04.629309 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5109903-a244-4011-b336-9d9440b153fc None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:22:04.629309 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5109903-a244-4011-b336-9d9440b153fc None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:22:04.630665 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 576/1154] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:22:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:22:04.637065 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3225af44-c72c-4290-a03d-eff24f6f4c6d None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:22:04.637764 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3225af44-c72c-4290-a03d-eff24f6f4c6d None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:22:04.637908 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3225af44-c72c-4290-a03d-eff24f6f4c6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:22:04.654138 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:22:04.660373 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-3225af44-c72c-4290-a03d-eff24f6f4c6d None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:22:04.662549 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-3225af44-c72c-4290-a03d-eff24f6f4c6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:22:04.730052 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 579/1155] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:22:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 11:22:04.992678 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5109903-a244-4011-b336-9d9440b153fc None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:22:05.028837 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:22:05.110997 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5109903-a244-4011-b336-9d9440b153fc None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:22:05.145084 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaa4b16-c53d-4cfc-84ad-b7923509450a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:22:05.145696 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaa4b16-c53d-4cfc-84ad-b7923509450a None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:22:05.145965 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaa4b16-c53d-4cfc-84ad-b7923509450a None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:22:05.146233 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaa4b16-c53d-4cfc-84ad-b7923509450a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:22:05.158025 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaa4b16-c53d-4cfc-84ad-b7923509450a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:22:05.162831 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-dfaa4b16-c53d-4cfc-84ad-b7923509450a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 11:22:05.162831 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:22:05.162831 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:22:05.162831 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:22:05.162831 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:22:05.162831 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:22:05.162831 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:22:05.162831 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:22:05.162831 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:22:05.162831 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:22:05.162831 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:22:05.162831 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:22:05.162831 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:22:05.162831 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:22:05.162831 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:22:05.162831 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:22:05.163909 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:22:05.163909 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:22:05.163909 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:22:05.163909 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:22:05.163909 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:22:05.163909 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:22:05.163909 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:22:05.163909 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:22:05.163909 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:22:05.163909 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:22:05.163909 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:22:05.163909 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Aug 24 11:22:05.163909 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:22:05.163909 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:22:05.163909 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:22:05.163909 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:22:05.164940 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:22:05.164940 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:22:05.164940 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:22:05.164940 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:22:05.164940 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:22:05.164940 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:22:05.164940 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:22:05.164940 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:22:05.164940 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:22:05.164940 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:22:05.164940 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 11:22:05.164940 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:22:05.164940 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 577/1156] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Aug 24 11:22:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:22:05.170342 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3225af44-c72c-4290-a03d-eff24f6f4c6d None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:22:05.269442 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3225af44-c72c-4290-a03d-eff24f6f4c6d None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:22:05.307489 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d81d87f-31d6-472e-a17d-c1c67d4005e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:22:05.308079 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d81d87f-31d6-472e-a17d-c1c67d4005e0 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:22:05.308346 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d81d87f-31d6-472e-a17d-c1c67d4005e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:22:05.308612 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d81d87f-31d6-472e-a17d-c1c67d4005e0 None admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:22:05.309262 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d81d87f-31d6-472e-a17d-c1c67d4005e0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:22:05.309560 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d81d87f-31d6-472e-a17d-c1c67d4005e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:22:05.310972 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d81d87f-31d6-472e-a17d-c1c67d4005e0 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:22:05.313143 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:22:05.320281 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 580/1157] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 24 11:22:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:22:05.326745 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaa4b16-c53d-4cfc-84ad-b7923509450a None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:22:05.430374 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:22:05.440250 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaa4b16-c53d-4cfc-84ad-b7923509450a None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:22:05.477726 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf29977-c415-40a1-a805-7d7099f4230e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:22:05.478340 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf29977-c415-40a1-a805-7d7099f4230e None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:22:05.478654 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf29977-c415-40a1-a805-7d7099f4230e None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:22:05.478928 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf29977-c415-40a1-a805-7d7099f4230e None admin] PATH_INFO: `/v3/users/2cf87623ae3b4b508ad6813ab8ec781d` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:22:05.480184 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf29977-c415-40a1-a805-7d7099f4230e None admin] RBAC: Authorizing `identity:get_user(user_id=2cf87623ae3b4b508ad6813ab8ec781d)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:22:05.481629 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf29977-c415-40a1-a805-7d7099f4230e None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:22:05.483232 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 578/1158] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Aug 24 11:22:05 2022] GET /identity/v3/users/2cf87623ae3b4b508ad6813ab8ec781d => generated 286 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:22:05.489393 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d81d87f-31d6-472e-a17d-c1c67d4005e0 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:22:05.600049 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d81d87f-31d6-472e-a17d-c1c67d4005e0 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:22:05.637671 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01a123a-450a-4923-b09f-67eb85c53c2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:22:05.638285 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01a123a-450a-4923-b09f-67eb85c53c2a None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:22:05.638555 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01a123a-450a-4923-b09f-67eb85c53c2a None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:22:05.638825 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01a123a-450a-4923-b09f-67eb85c53c2a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:22:05.704056 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:22:05.708015 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01a123a-450a-4923-b09f-67eb85c53c2a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:22:05.709839 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01a123a-450a-4923-b09f-67eb85c53c2a None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:22:05.810406 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 581/1159] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 24 11:22:05 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 11:22:05.818234 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf29977-c415-40a1-a805-7d7099f4230e None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:22:05.920374 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf29977-c415-40a1-a805-7d7099f4230e None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:22:05.959555 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d38982-2d96-4cc4-bbd0-76aa25ef4d92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:22:05.960188 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d38982-2d96-4cc4-bbd0-76aa25ef4d92 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:22:05.960466 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d38982-2d96-4cc4-bbd0-76aa25ef4d92 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:22:05.960737 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d38982-2d96-4cc4-bbd0-76aa25ef4d92 None admin] PATH_INFO: `/v3/projects/087e1478f14d4d32bf0e56d605a9a549` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:22:05.961971 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d38982-2d96-4cc4-bbd0-76aa25ef4d92 None admin] RBAC: Authorizing `identity:get_project(project_id=087e1478f14d4d32bf0e56d605a9a549)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:22:05.963464 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d38982-2d96-4cc4-bbd0-76aa25ef4d92 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:22:05.965091 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 579/1160] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Aug 24 11:22:05 2022] GET /identity/v3/projects/087e1478f14d4d32bf0e56d605a9a549 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:22:05.971414 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01a123a-450a-4923-b09f-67eb85c53c2a None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:22:06.071190 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:22:06.074980 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01a123a-450a-4923-b09f-67eb85c53c2a None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:22:06.111964 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bc4a7f-3d55-431d-83ca-d15e8385ba29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:22:06.112576 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bc4a7f-3d55-431d-83ca-d15e8385ba29 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:22:06.112852 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bc4a7f-3d55-431d-83ca-d15e8385ba29 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:22:06.113119 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bc4a7f-3d55-431d-83ca-d15e8385ba29 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:22:06.113826 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bc4a7f-3d55-431d-83ca-d15e8385ba29 None admin] RBAC: Adding query filter params (role.id=30bb1e97257f4ca5b90c88545777317b, scope.project.id=087e1478f14d4d32bf0e56d605a9a549, user.id=2cf87623ae3b4b508ad6813ab8ec781d) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:22:06.114127 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bc4a7f-3d55-431d-83ca-d15e8385ba29 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:22:06.115620 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bc4a7f-3d55-431d-83ca-d15e8385ba29 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:22:06.122267 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 582/1161] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Aug 24 11:22:05 2022] GET /identity/v3/role_assignments?user.id=2cf87623ae3b4b508ad6813ab8ec781d&scope.project.id=087e1478f14d4d32bf0e56d605a9a549&role.id=30bb1e97257f4ca5b90c88545777317b => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:22:08.026399 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7367ae52-0586-489c-a67e-3c26d7a1dab3 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:22:08.027052 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7367ae52-0586-489c-a67e-3c26d7a1dab3 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:22:08.027052 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7367ae52-0586-489c-a67e-3c26d7a1dab3 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:22:08.028290 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 580/1162] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:22:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:22:08.034882 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a720e7c-a68a-4f9f-afc2-8864f7473ba0 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:22:08.035645 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a720e7c-a68a-4f9f-afc2-8864f7473ba0 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:22:08.035831 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a720e7c-a68a-4f9f-afc2-8864f7473ba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:22:08.066071 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-1a720e7c-a68a-4f9f-afc2-8864f7473ba0 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:22:08.067353 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-1a720e7c-a68a-4f9f-afc2-8864f7473ba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:22:08.144540 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 583/1163] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:22:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 11:22:08.401843 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7367ae52-0586-489c-a67e-3c26d7a1dab3 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:22:08.433626 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:22:08.511798 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7367ae52-0586-489c-a67e-3c26d7a1dab3 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:22:08.549036 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfa545e-c42f-4ff4-b97f-7ca561fd3c80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:22:08.549647 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfa545e-c42f-4ff4-b97f-7ca561fd3c80 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:22:08.549924 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfa545e-c42f-4ff4-b97f-7ca561fd3c80 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:22:08.550197 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfa545e-c42f-4ff4-b97f-7ca561fd3c80 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:22:08.620034 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfa545e-c42f-4ff4-b97f-7ca561fd3c80 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:22:08.621505 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfa545e-c42f-4ff4-b97f-7ca561fd3c80 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:22:08.648544 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:22:08.725001 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 581/1164] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 24 11:22:08 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 11:22:08.731443 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a720e7c-a68a-4f9f-afc2-8864f7473ba0 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:22:08.840051 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:22:08.855542 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a720e7c-a68a-4f9f-afc2-8864f7473ba0 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:22:08.893301 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a89f8e-ba8b-4e35-b367-481f9224e3a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:22:08.894019 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a89f8e-ba8b-4e35-b367-481f9224e3a5 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:22:08.894292 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a89f8e-ba8b-4e35-b367-481f9224e3a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:22:08.894594 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a89f8e-ba8b-4e35-b367-481f9224e3a5 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:22:08.901866 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a89f8e-ba8b-4e35-b367-481f9224e3a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:22:08.903419 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a89f8e-ba8b-4e35-b367-481f9224e3a5 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:22:08.914825 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-25a89f8e-ba8b-4e35-b367-481f9224e3a5 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 24 11:22:08.914825 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:22:08.914825 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 24 11:22:08.914825 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 24 11:22:08.914825 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 11:22:08.914825 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 11:22:08.914825 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 11:22:08.914825 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 11:22:08.914825 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 24 11:22:08.914825 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Aug 24 11:22:08.914825 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 11:22:08.914825 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Aug 24 11:22:08.914825 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:22:08.914825 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:22:08.914825 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:22:08.914825 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:22:08.914825 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:22:08.916000 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:22:08.916000 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:22:08.916000 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:22:08.916000 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:22:08.916000 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:22:08.916000 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:22:08.916000 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 11:22:08.916000 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 11:22:08.916000 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 11:22:08.916000 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 11:22:08.916000 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:22:08.916000 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:22:08.916000 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:22:08.916000 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:22:08.916000 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:22:08.916000 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:22:08.917704 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:22:08.917704 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Aug 24 11:22:08.917704 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:22:08.917704 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:22:08.917704 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:22:08.917704 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:22:08.917704 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:22:08.917704 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:22:08.917704 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:22:08.917704 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:22:08.917704 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 24 11:22:08.917704 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 11:22:08.917704 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 24 11:22:08.917704 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Aug 24 11:22:08.917704 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 584/1165] 10.222.0.27 () {56 vars in 1117 bytes} [Wed Aug 24 11:22:08 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:22:08.924837 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfa545e-c42f-4ff4-b97f-7ca561fd3c80 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:22:09.022470 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfa545e-c42f-4ff4-b97f-7ca561fd3c80 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:22:09.049974 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:22:09.059176 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5febce-4fee-4839-95ca-2bcfe7a34b07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:22:09.059769 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5febce-4fee-4839-95ca-2bcfe7a34b07 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:22:09.060042 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5febce-4fee-4839-95ca-2bcfe7a34b07 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:22:09.060309 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5febce-4fee-4839-95ca-2bcfe7a34b07 None admin] PATH_INFO: `/v3/domains` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:22:09.060944 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5febce-4fee-4839-95ca-2bcfe7a34b07 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:22:09.061240 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5febce-4fee-4839-95ca-2bcfe7a34b07 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:22:09.062665 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5febce-4fee-4839-95ca-2bcfe7a34b07 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:22:09.070204 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 582/1166] 10.222.0.27 () {56 vars in 1115 bytes} [Wed Aug 24 11:22:08 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:22:10.917219 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecbbdbf-7322-4637-adf1-e9fcf5a09b42 None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:22:10.918081 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecbbdbf-7322-4637-adf1-e9fcf5a09b42 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:22:10.918081 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecbbdbf-7322-4637-adf1-e9fcf5a09b42 None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:22:10.920279 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 585/1167] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:22:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:22:10.925789 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a12166-d816-4dfc-bdc2-507fed21cb2e None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:22:10.926214 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a12166-d816-4dfc-bdc2-507fed21cb2e None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:22:10.926304 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a12166-d816-4dfc-bdc2-507fed21cb2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:22:10.945630 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-06a12166-d816-4dfc-bdc2-507fed21cb2e None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:22:10.946833 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-06a12166-d816-4dfc-bdc2-507fed21cb2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:22:11.014480 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 583/1168] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:22:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 11:22:11.274505 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecbbdbf-7322-4637-adf1-e9fcf5a09b42 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:22:11.394900 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecbbdbf-7322-4637-adf1-e9fcf5a09b42 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:22:11.431273 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcfbb70-a863-4d59-bea3-ae6e0c3f295f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:22:11.431879 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcfbb70-a863-4d59-bea3-ae6e0c3f295f None admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:22:11.432156 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcfbb70-a863-4d59-bea3-ae6e0c3f295f None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:22:11.432423 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcfbb70-a863-4d59-bea3-ae6e0c3f295f None admin] PATH_INFO: `/v3/domains` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:22:11.433076 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcfbb70-a863-4d59-bea3-ae6e0c3f295f None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:22:11.434481 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcfbb70-a863-4d59-bea3-ae6e0c3f295f None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:22:11.453165 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 586/1169] 10.222.0.27 () {60 vars in 1138 bytes} [Wed Aug 24 11:22:11 2022] POST /identity/v3/domains => generated 267 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:22:13.372726 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a30299c-cb41-4c54-ab2a-3ac4defffa83 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:22:13.373298 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a30299c-cb41-4c54-ab2a-3ac4defffa83 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:22:13.373298 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a30299c-cb41-4c54-ab2a-3ac4defffa83 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:22:13.374536 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 584/1170] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:22:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:22:13.380104 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b62b6ec-26bd-402a-ac7a-3498c645b261 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:22:13.380548 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b62b6ec-26bd-402a-ac7a-3498c645b261 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:22:13.380657 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b62b6ec-26bd-402a-ac7a-3498c645b261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:22:13.400445 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-7b62b6ec-26bd-402a-ac7a-3498c645b261 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:22:13.401655 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-7b62b6ec-26bd-402a-ac7a-3498c645b261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:22:13.409051 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:22:13.474380 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 587/1171] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:22:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 11:22:13.740173 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a30299c-cb41-4c54-ab2a-3ac4defffa83 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:22:13.849183 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a30299c-cb41-4c54-ab2a-3ac4defffa83 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:22:13.871847 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:22:13.884231 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978103f0-a2fd-4ff9-9877-45652118e49b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:22:13.884855 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978103f0-a2fd-4ff9-9877-45652118e49b None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:22:13.885125 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978103f0-a2fd-4ff9-9877-45652118e49b None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:22:13.885396 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978103f0-a2fd-4ff9-9877-45652118e49b None admin] PATH_INFO: `/v3/domains/9f6fa44760504b30817d5be7cec9cf36` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:22:13.896287 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978103f0-a2fd-4ff9-9877-45652118e49b None admin] RBAC: Authorizing `identity:get_domain(domain_id=9f6fa44760504b30817d5be7cec9cf36)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:22:13.897777 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978103f0-a2fd-4ff9-9877-45652118e49b None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:22:13.900959 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 585/1172] 10.222.0.27 () {56 vars in 1183 bytes} [Wed Aug 24 11:22:13 2022] GET /identity/v3/domains/9f6fa44760504b30817d5be7cec9cf36 => generated 267 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:22:13.907465 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b62b6ec-26bd-402a-ac7a-3498c645b261 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:22:14.010796 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b62b6ec-26bd-402a-ac7a-3498c645b261 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:22:14.046126 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fdff56-6bc2-43c3-ba07-02674afa1865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:22:14.046744 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fdff56-6bc2-43c3-ba07-02674afa1865 None admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:22:14.047017 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fdff56-6bc2-43c3-ba07-02674afa1865 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:22:14.047270 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fdff56-6bc2-43c3-ba07-02674afa1865 None admin] PATH_INFO: `/v3/projects` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:22:14.047903 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fdff56-6bc2-43c3-ba07-02674afa1865 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:22:14.049358 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fdff56-6bc2-43c3-ba07-02674afa1865 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:22:14.063956 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:22:14.078454 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 588/1173] 10.222.0.27 () {60 vars in 1141 bytes} [Wed Aug 24 11:22:13 2022] POST /identity/v3/projects => generated 361 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:22:15.989687 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3da987-e832-428b-8417-79b60de63527 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:22:15.990302 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3da987-e832-428b-8417-79b60de63527 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:22:15.990302 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3da987-e832-428b-8417-79b60de63527 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:22:15.992323 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 586/1174] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:22:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:22:16.001234 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76655f2f-da09-4148-8a86-8f8447c0ad26 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:22:16.001690 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76655f2f-da09-4148-8a86-8f8447c0ad26 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:22:16.001907 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76655f2f-da09-4148-8a86-8f8447c0ad26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:22:16.020981 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-76655f2f-da09-4148-8a86-8f8447c0ad26 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:22:16.022204 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-76655f2f-da09-4148-8a86-8f8447c0ad26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:22:16.092885 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 589/1175] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:22:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 11:22:16.362943 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3da987-e832-428b-8417-79b60de63527 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:22:16.488329 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3da987-e832-428b-8417-79b60de63527 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:22:16.529411 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68c75c6-7793-4356-8f5e-be73f24091fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:22:16.530032 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68c75c6-7793-4356-8f5e-be73f24091fe None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:22:16.530308 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68c75c6-7793-4356-8f5e-be73f24091fe None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:22:16.530612 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68c75c6-7793-4356-8f5e-be73f24091fe None admin] PATH_INFO: `/v3/domains/9f6fa44760504b30817d5be7cec9cf36` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:22:16.531786 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68c75c6-7793-4356-8f5e-be73f24091fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=9f6fa44760504b30817d5be7cec9cf36)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:22:16.533308 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68c75c6-7793-4356-8f5e-be73f24091fe None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:22:16.534947 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 587/1176] 10.222.0.27 () {56 vars in 1183 bytes} [Wed Aug 24 11:22:16 2022] GET /identity/v3/domains/9f6fa44760504b30817d5be7cec9cf36 => generated 267 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:22:16.541506 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76655f2f-da09-4148-8a86-8f8447c0ad26 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:22:16.647975 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76655f2f-da09-4148-8a86-8f8447c0ad26 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:22:16.671235 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:22:16.688160 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5974c364-cacc-414d-9840-eda7f9073e4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:22:16.689112 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5974c364-cacc-414d-9840-eda7f9073e4f None admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:22:16.689439 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5974c364-cacc-414d-9840-eda7f9073e4f None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:22:16.689705 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5974c364-cacc-414d-9840-eda7f9073e4f None admin] PATH_INFO: `/v3/users` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:22:16.690384 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5974c364-cacc-414d-9840-eda7f9073e4f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:22:16.691826 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5974c364-cacc-414d-9840-eda7f9073e4f None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:22:16.714952 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 590/1177] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Aug 24 11:22:16 2022] POST /identity/v3/users => generated 311 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 11:22:18.639513 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36363b78-e9a7-466d-bcf4-aebd2b5e79a9 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:22:18.640185 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36363b78-e9a7-466d-bcf4-aebd2b5e79a9 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:22:18.640185 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36363b78-e9a7-466d-bcf4-aebd2b5e79a9 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:22:18.642042 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 588/1178] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:22:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:22:18.647774 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfc95de-fec7-4cb7-abc5-3ef11f4e21bd None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:22:18.648249 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfc95de-fec7-4cb7-abc5-3ef11f4e21bd None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:22:18.648357 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfc95de-fec7-4cb7-abc5-3ef11f4e21bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:22:18.669033 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-7cfc95de-fec7-4cb7-abc5-3ef11f4e21bd None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:22:18.670210 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-7cfc95de-fec7-4cb7-abc5-3ef11f4e21bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:22:18.742861 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 591/1179] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:22:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 11:22:19.003455 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36363b78-e9a7-466d-bcf4-aebd2b5e79a9 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:22:19.061385 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:22:19.114376 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36363b78-e9a7-466d-bcf4-aebd2b5e79a9 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:22:19.148799 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b015b932-42c8-41b5-a478-11c9b3bd6858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:22:19.149414 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b015b932-42c8-41b5-a478-11c9b3bd6858 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:22:19.149688 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b015b932-42c8-41b5-a478-11c9b3bd6858 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:22:19.150243 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b015b932-42c8-41b5-a478-11c9b3bd6858 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:22:19.161386 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b015b932-42c8-41b5-a478-11c9b3bd6858 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:22:19.166085 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-b015b932-42c8-41b5-a478-11c9b3bd6858 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 11:22:19.166085 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:22:19.166085 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:22:19.166085 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:22:19.166085 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:22:19.166085 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:22:19.166085 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:22:19.166085 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:22:19.166085 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:22:19.166085 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:22:19.166085 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:22:19.166085 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:22:19.166085 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:22:19.166085 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:22:19.166085 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:22:19.166085 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:22:19.167344 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:22:19.167344 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:22:19.167344 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:22:19.167344 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:22:19.167344 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:22:19.167344 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:22:19.167344 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:22:19.167344 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:22:19.167344 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:22:19.167344 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:22:19.167344 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:22:19.167344 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Aug 24 11:22:19.167344 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:22:19.167344 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:22:19.167344 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:22:19.167344 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:22:19.168440 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:22:19.168440 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:22:19.168440 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:22:19.168440 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:22:19.168440 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:22:19.168440 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:22:19.168440 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:22:19.168440 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:22:19.168440 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:22:19.168440 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:22:19.168440 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 11:22:19.168440 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:22:19.170577 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 589/1180] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Aug 24 11:22:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:22:19.174046 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfc95de-fec7-4cb7-abc5-3ef11f4e21bd None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:22:19.293319 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfc95de-fec7-4cb7-abc5-3ef11f4e21bd None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:22:19.304924 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:22:19.354265 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae27f564-50a9-4caf-b80b-97173ec12ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:22:19.355144 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae27f564-50a9-4caf-b80b-97173ec12ea5 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:22:19.355491 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae27f564-50a9-4caf-b80b-97173ec12ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:22:19.355832 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae27f564-50a9-4caf-b80b-97173ec12ea5 None admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:22:19.356845 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae27f564-50a9-4caf-b80b-97173ec12ea5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:22:19.357254 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae27f564-50a9-4caf-b80b-97173ec12ea5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:22:19.359473 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae27f564-50a9-4caf-b80b-97173ec12ea5 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:22:19.368384 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 592/1181] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 24 11:22:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:22:19.377058 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b015b932-42c8-41b5-a478-11c9b3bd6858 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:22:19.482507 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b015b932-42c8-41b5-a478-11c9b3bd6858 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:22:19.492830 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:22:19.518089 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc7ff5e-ab98-4945-a84d-ed3260ed8193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:22:19.518759 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc7ff5e-ab98-4945-a84d-ed3260ed8193 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:22:19.519061 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc7ff5e-ab98-4945-a84d-ed3260ed8193 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:22:19.519310 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc7ff5e-ab98-4945-a84d-ed3260ed8193 None admin] PATH_INFO: `/v3/users/436e498b6b154187ba864b7b922467b5` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:22:19.536799 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc7ff5e-ab98-4945-a84d-ed3260ed8193 None admin] RBAC: Authorizing `identity:get_user(user_id=436e498b6b154187ba864b7b922467b5)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:22:19.539128 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc7ff5e-ab98-4945-a84d-ed3260ed8193 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:22:19.541616 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 590/1182] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Aug 24 11:22:19 2022] GET /identity/v3/users/436e498b6b154187ba864b7b922467b5 => generated 311 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:22:19.550598 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae27f564-50a9-4caf-b80b-97173ec12ea5 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:22:19.652327 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae27f564-50a9-4caf-b80b-97173ec12ea5 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:22:19.684483 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99e0cb9-ce9f-4699-8da3-095acfb2eff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:22:19.685086 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99e0cb9-ce9f-4699-8da3-095acfb2eff3 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:22:19.685361 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99e0cb9-ce9f-4699-8da3-095acfb2eff3 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:22:19.685625 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99e0cb9-ce9f-4699-8da3-095acfb2eff3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:22:19.726714 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:22:19.753724 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99e0cb9-ce9f-4699-8da3-095acfb2eff3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:22:19.755190 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99e0cb9-ce9f-4699-8da3-095acfb2eff3 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:22:19.866349 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 593/1183] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 24 11:22:19 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 11:22:19.875805 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc7ff5e-ab98-4945-a84d-ed3260ed8193 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:22:19.981887 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc7ff5e-ab98-4945-a84d-ed3260ed8193 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:22:20.018935 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dcc23a-7a3b-4eac-8c94-128669127050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:22:20.019548 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dcc23a-7a3b-4eac-8c94-128669127050 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:22:20.019817 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dcc23a-7a3b-4eac-8c94-128669127050 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:22:20.020084 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dcc23a-7a3b-4eac-8c94-128669127050 None admin] PATH_INFO: `/v3/projects/902293f6d0034e4880d057fd52c9b898` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:22:20.021325 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dcc23a-7a3b-4eac-8c94-128669127050 None admin] RBAC: Authorizing `identity:get_project(project_id=902293f6d0034e4880d057fd52c9b898)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:22:20.022792 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dcc23a-7a3b-4eac-8c94-128669127050 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:22:20.024394 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 591/1184] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Aug 24 11:22:19 2022] GET /identity/v3/projects/902293f6d0034e4880d057fd52c9b898 => generated 361 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:22:20.034799 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99e0cb9-ce9f-4699-8da3-095acfb2eff3 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:22:20.116809 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:22:20.147642 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99e0cb9-ce9f-4699-8da3-095acfb2eff3 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:22:20.180600 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b761ce14-af21-4350-bac5-032d7f115cbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:22:20.181224 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b761ce14-af21-4350-bac5-032d7f115cbf None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:22:20.181503 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b761ce14-af21-4350-bac5-032d7f115cbf None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:22:20.181771 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b761ce14-af21-4350-bac5-032d7f115cbf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:22:20.182547 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b761ce14-af21-4350-bac5-032d7f115cbf None admin] RBAC: Adding query filter params (role.id=30bb1e97257f4ca5b90c88545777317b, scope.project.id=902293f6d0034e4880d057fd52c9b898, user.id=436e498b6b154187ba864b7b922467b5) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:22:20.182854 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b761ce14-af21-4350-bac5-032d7f115cbf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:22:20.184301 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b761ce14-af21-4350-bac5-032d7f115cbf None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:22:20.189822 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 594/1185] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Aug 24 11:22:20 2022] GET /identity/v3/role_assignments?user.id=436e498b6b154187ba864b7b922467b5&scope.project.id=902293f6d0034e4880d057fd52c9b898&role.id=30bb1e97257f4ca5b90c88545777317b => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:22:22.061579 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723dca57-254d-4859-838b-1b1250254e55 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:22:22.062188 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723dca57-254d-4859-838b-1b1250254e55 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:22:22.062188 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723dca57-254d-4859-838b-1b1250254e55 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:22:22.063514 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 592/1186] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:22:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:22:22.070193 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa5dbe6-0ac7-4106-9f8f-584fc5ce6904 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:22:22.070973 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa5dbe6-0ac7-4106-9f8f-584fc5ce6904 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:22:22.071121 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa5dbe6-0ac7-4106-9f8f-584fc5ce6904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:22:22.099791 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-7fa5dbe6-0ac7-4106-9f8f-584fc5ce6904 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:22:22.101004 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-7fa5dbe6-0ac7-4106-9f8f-584fc5ce6904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:22:22.177705 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 595/1187] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:22:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 11:22:22.438004 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723dca57-254d-4859-838b-1b1250254e55 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:22:22.482069 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:22:22.551528 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723dca57-254d-4859-838b-1b1250254e55 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:22:22.591731 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82879931-1dba-4f73-927b-c61f656f3b33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:22:22.592356 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82879931-1dba-4f73-927b-c61f656f3b33 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:22:22.592628 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82879931-1dba-4f73-927b-c61f656f3b33 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:22:22.592897 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82879931-1dba-4f73-927b-c61f656f3b33 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:22:22.603828 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82879931-1dba-4f73-927b-c61f656f3b33 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:22:22.611413 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-82879931-1dba-4f73-927b-c61f656f3b33 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 11:22:22.611413 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:22:22.611413 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:22:22.611413 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:22:22.611413 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:22:22.611413 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:22:22.611413 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:22:22.611413 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:22:22.611413 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:22:22.611413 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:22:22.611413 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:22:22.611413 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:22:22.611413 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:22:22.611413 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:22:22.611413 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:22:22.611413 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:22:22.612377 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:22:22.612377 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:22:22.612377 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:22:22.612377 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:22:22.612377 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:22:22.612377 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:22:22.612377 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:22:22.612377 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:22:22.612377 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:22:22.612377 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:22:22.612377 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:22:22.612377 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Aug 24 11:22:22.612377 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:22:22.612377 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:22:22.612377 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:22:22.612377 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:22:22.613328 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:22:22.613328 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:22:22.613328 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:22:22.613328 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:22:22.613328 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:22:22.613328 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:22:22.613328 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:22:22.613328 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:22:22.613328 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:22:22.613328 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:22:22.613328 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 11:22:22.613328 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:22:22.613328 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 593/1188] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Aug 24 11:22:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:22:22.618967 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa5dbe6-0ac7-4106-9f8f-584fc5ce6904 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:22:22.689156 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:22:22.729618 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa5dbe6-0ac7-4106-9f8f-584fc5ce6904 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:22:22.768181 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cc8603-00ab-4526-b2e2-2742838b3710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:22:22.768794 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cc8603-00ab-4526-b2e2-2742838b3710 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:22:22.769073 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cc8603-00ab-4526-b2e2-2742838b3710 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:22:22.769341 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cc8603-00ab-4526-b2e2-2742838b3710 None admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:22:22.770026 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cc8603-00ab-4526-b2e2-2742838b3710 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:22:22.770330 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cc8603-00ab-4526-b2e2-2742838b3710 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:22:22.771782 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cc8603-00ab-4526-b2e2-2742838b3710 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:22:22.781075 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 596/1189] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 24 11:22:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:22:22.788450 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82879931-1dba-4f73-927b-c61f656f3b33 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:22:22.918790 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:22:22.925736 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82879931-1dba-4f73-927b-c61f656f3b33 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:22:22.962795 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0805fb5-6153-4017-9865-24fc3e44c737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:22:22.963346 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0805fb5-6153-4017-9865-24fc3e44c737 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:22:22.963626 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0805fb5-6153-4017-9865-24fc3e44c737 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:22:22.963893 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0805fb5-6153-4017-9865-24fc3e44c737 None admin] PATH_INFO: `/v3/users/436e498b6b154187ba864b7b922467b5` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:22:22.965137 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0805fb5-6153-4017-9865-24fc3e44c737 None admin] RBAC: Authorizing `identity:get_user(user_id=436e498b6b154187ba864b7b922467b5)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:22:22.966626 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0805fb5-6153-4017-9865-24fc3e44c737 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:22:22.968225 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 594/1190] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Aug 24 11:22:22 2022] GET /identity/v3/users/436e498b6b154187ba864b7b922467b5 => generated 311 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:22:22.974794 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cc8603-00ab-4526-b2e2-2742838b3710 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:22:23.084220 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cc8603-00ab-4526-b2e2-2742838b3710 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:22:23.112092 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:22:23.121508 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ef7492-07c2-40e2-9099-e275e0945d52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:22:23.122168 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ef7492-07c2-40e2-9099-e275e0945d52 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:22:23.122475 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ef7492-07c2-40e2-9099-e275e0945d52 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:22:23.122731 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ef7492-07c2-40e2-9099-e275e0945d52 None admin] PATH_INFO: `/v3/projects/902293f6d0034e4880d057fd52c9b898` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:22:23.123902 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ef7492-07c2-40e2-9099-e275e0945d52 None admin] RBAC: Authorizing `identity:get_project(project_id=902293f6d0034e4880d057fd52c9b898)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:22:23.125369 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ef7492-07c2-40e2-9099-e275e0945d52 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:22:23.127095 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 597/1191] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Aug 24 11:22:22 2022] GET /identity/v3/projects/902293f6d0034e4880d057fd52c9b898 => generated 361 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:22:23.133657 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0805fb5-6153-4017-9865-24fc3e44c737 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:22:23.240061 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0805fb5-6153-4017-9865-24fc3e44c737 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:22:23.278078 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0fd8a7-f630-4e7b-b477-6ad69c2d4b7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:22:23.278783 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0fd8a7-f630-4e7b-b477-6ad69c2d4b7c None admin] REQUEST_METHOD: `PUT` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:22:23.279062 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0fd8a7-f630-4e7b-b477-6ad69c2d4b7c None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:22:23.279336 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0fd8a7-f630-4e7b-b477-6ad69c2d4b7c None admin] PATH_INFO: `/v3/projects/902293f6d0034e4880d057fd52c9b898/users/436e498b6b154187ba864b7b922467b5/roles/30bb1e97257f4ca5b90c88545777317b` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:22:23.281224 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0fd8a7-f630-4e7b-b477-6ad69c2d4b7c None admin] RBAC: Authorizing `identity:create_grant(project_id=902293f6d0034e4880d057fd52c9b898, user_id=436e498b6b154187ba864b7b922467b5, role_id=30bb1e97257f4ca5b90c88545777317b)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:22:23.282741 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0fd8a7-f630-4e7b-b477-6ad69c2d4b7c None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:22:23.296306 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 595/1192] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Aug 24 11:22:23 2022] PUT /identity/v3/projects/902293f6d0034e4880d057fd52c9b898/users/436e498b6b154187ba864b7b922467b5/roles/30bb1e97257f4ca5b90c88545777317b => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:22:25.154614 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6180201-96d9-439f-9274-3025716280e6 None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:22:25.155159 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6180201-96d9-439f-9274-3025716280e6 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:22:25.155159 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6180201-96d9-439f-9274-3025716280e6 None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:22:25.157423 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 598/1193] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:22:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:22:25.163197 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eb892e-8937-45b0-8724-6c619f951ad3 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:22:25.163597 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eb892e-8937-45b0-8724-6c619f951ad3 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:22:25.163727 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eb892e-8937-45b0-8724-6c619f951ad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:22:25.184494 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-b1eb892e-8937-45b0-8724-6c619f951ad3 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:22:25.185684 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-b1eb892e-8937-45b0-8724-6c619f951ad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:22:25.204713 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:22:25.256828 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 596/1194] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:22:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 11:22:25.528905 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6180201-96d9-439f-9274-3025716280e6 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:22:25.648618 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6180201-96d9-439f-9274-3025716280e6 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:22:25.693537 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c03162-4df5-477b-8214-f7600b06253e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:22:25.694151 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c03162-4df5-477b-8214-f7600b06253e None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:22:25.694448 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c03162-4df5-477b-8214-f7600b06253e None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:22:25.694714 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c03162-4df5-477b-8214-f7600b06253e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:22:25.705142 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c03162-4df5-477b-8214-f7600b06253e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:22:25.709811 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-e3c03162-4df5-477b-8214-f7600b06253e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 11:22:25.709811 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:22:25.709811 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:22:25.709811 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:22:25.709811 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:22:25.709811 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:22:25.709811 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:22:25.709811 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:22:25.709811 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:22:25.709811 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:22:25.709811 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:22:25.709811 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:22:25.709811 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:22:25.709811 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:22:25.709811 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:22:25.709811 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:22:25.710992 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:22:25.710992 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:22:25.710992 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:22:25.710992 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:22:25.710992 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:22:25.710992 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:22:25.710992 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:22:25.710992 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:22:25.710992 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:22:25.710992 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:22:25.710992 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:22:25.710992 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Aug 24 11:22:25.710992 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:22:25.710992 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:22:25.710992 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:22:25.710992 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:22:25.711862 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:22:25.711862 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:22:25.711862 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:22:25.711862 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:22:25.711862 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:22:25.711862 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:22:25.711862 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:22:25.711862 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:22:25.711862 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:22:25.711862 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:22:25.711862 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 11:22:25.711862 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Aug 24 11:22:25.711862 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 599/1195] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Aug 24 11:22:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:22:25.719036 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1eb892e-8937-45b0-8724-6c619f951ad3 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:22:25.824445 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1eb892e-8937-45b0-8724-6c619f951ad3 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:22:25.858766 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e3fd19-efb7-4626-9350-fa4126ff188e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:22:25.859357 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e3fd19-efb7-4626-9350-fa4126ff188e None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:22:25.859626 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e3fd19-efb7-4626-9350-fa4126ff188e None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:22:25.859895 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e3fd19-efb7-4626-9350-fa4126ff188e None admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:22:25.860561 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e3fd19-efb7-4626-9350-fa4126ff188e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:22:25.860887 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e3fd19-efb7-4626-9350-fa4126ff188e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:22:25.862334 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e3fd19-efb7-4626-9350-fa4126ff188e None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:22:25.870390 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 597/1196] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 24 11:22:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:22:25.878715 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c03162-4df5-477b-8214-f7600b06253e None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:22:25.937179 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:22:25.986964 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c03162-4df5-477b-8214-f7600b06253e None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:22:26.023177 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f2b5e4-85d0-47fe-9488-d32ba7793cd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:22:26.023792 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f2b5e4-85d0-47fe-9488-d32ba7793cd1 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:22:26.024068 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f2b5e4-85d0-47fe-9488-d32ba7793cd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:22:26.024337 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f2b5e4-85d0-47fe-9488-d32ba7793cd1 None admin] PATH_INFO: `/v3/users/436e498b6b154187ba864b7b922467b5` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:22:26.025941 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f2b5e4-85d0-47fe-9488-d32ba7793cd1 None admin] RBAC: Authorizing `identity:get_user(user_id=436e498b6b154187ba864b7b922467b5)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:22:26.027423 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f2b5e4-85d0-47fe-9488-d32ba7793cd1 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:22:26.028990 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 600/1197] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Aug 24 11:22:25 2022] GET /identity/v3/users/436e498b6b154187ba864b7b922467b5 => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:22:26.036745 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e3fd19-efb7-4626-9350-fa4126ff188e None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:22:26.056912 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:22:26.149033 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e3fd19-efb7-4626-9350-fa4126ff188e None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:22:26.184930 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017417da-8cd1-47a7-aa4b-0ae37189437a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:22:26.185617 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017417da-8cd1-47a7-aa4b-0ae37189437a None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:22:26.185945 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017417da-8cd1-47a7-aa4b-0ae37189437a None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:22:26.186259 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017417da-8cd1-47a7-aa4b-0ae37189437a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:22:26.259403 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017417da-8cd1-47a7-aa4b-0ae37189437a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:22:26.260864 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017417da-8cd1-47a7-aa4b-0ae37189437a None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:22:26.278192 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:22:26.372121 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 598/1198] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 24 11:22:26 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 11:22:26.378424 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f2b5e4-85d0-47fe-9488-d32ba7793cd1 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:22:26.494437 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f2b5e4-85d0-47fe-9488-d32ba7793cd1 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:22:26.518052 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:22:26.531484 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7135d9-456e-4220-8da2-7665e771f395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:22:26.532134 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7135d9-456e-4220-8da2-7665e771f395 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:22:26.532411 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7135d9-456e-4220-8da2-7665e771f395 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:22:26.532706 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7135d9-456e-4220-8da2-7665e771f395 None admin] PATH_INFO: `/v3/projects/902293f6d0034e4880d057fd52c9b898` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:22:26.533894 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7135d9-456e-4220-8da2-7665e771f395 None admin] RBAC: Authorizing `identity:get_project(project_id=902293f6d0034e4880d057fd52c9b898)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:22:26.535373 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7135d9-456e-4220-8da2-7665e771f395 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:22:26.537035 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 601/1199] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Aug 24 11:22:26 2022] GET /identity/v3/projects/902293f6d0034e4880d057fd52c9b898 => generated 361 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:22:26.543389 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017417da-8cd1-47a7-aa4b-0ae37189437a None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:22:26.644309 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017417da-8cd1-47a7-aa4b-0ae37189437a None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:22:26.662273 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:22:26.690102 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac886c0c-8e87-4a29-a638-26ff9d67f395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:22:26.690755 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac886c0c-8e87-4a29-a638-26ff9d67f395 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:22:26.691034 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac886c0c-8e87-4a29-a638-26ff9d67f395 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:22:26.691303 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac886c0c-8e87-4a29-a638-26ff9d67f395 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:22:26.692036 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac886c0c-8e87-4a29-a638-26ff9d67f395 None admin] RBAC: Adding query filter params (role.id=30bb1e97257f4ca5b90c88545777317b, scope.project.id=902293f6d0034e4880d057fd52c9b898, user.id=436e498b6b154187ba864b7b922467b5) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:22:26.692335 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac886c0c-8e87-4a29-a638-26ff9d67f395 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:22:26.693769 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac886c0c-8e87-4a29-a638-26ff9d67f395 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:22:26.699712 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 599/1200] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Aug 24 11:22:26 2022] GET /identity/v3/role_assignments?user.id=436e498b6b154187ba864b7b922467b5&scope.project.id=902293f6d0034e4880d057fd52c9b898&role.id=30bb1e97257f4ca5b90c88545777317b => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:22:36.526016 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=4 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:22:36.696925 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=10 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:23:22.097215 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f44dec-6f1b-44ae-971f-1f2e491656f8 None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:23:22.097965 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f44dec-6f1b-44ae-971f-1f2e491656f8 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:23:22.097965 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f44dec-6f1b-44ae-971f-1f2e491656f8 None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:23:22.099511 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 602/1201] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:23:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 11:23:22.105146 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12da8456-83ec-4499-89c8-e5f6cbeea7f8 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:23:22.105570 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12da8456-83ec-4499-89c8-e5f6cbeea7f8 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:23:22.105670 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12da8456-83ec-4499-89c8-e5f6cbeea7f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:23:22.126691 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-12da8456-83ec-4499-89c8-e5f6cbeea7f8 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:23:22.130015 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-12da8456-83ec-4499-89c8-e5f6cbeea7f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:23:22.222395 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 600/1202] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:23:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 11:23:22.496568 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f44dec-6f1b-44ae-971f-1f2e491656f8 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:23:22.625800 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f44dec-6f1b-44ae-971f-1f2e491656f8 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:23:22.673226 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07b5c26-4986-4642-b710-0d4e04777f7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:23:22.673904 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07b5c26-4986-4642-b710-0d4e04777f7e None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:23:22.674218 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07b5c26-4986-4642-b710-0d4e04777f7e None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:23:22.674517 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07b5c26-4986-4642-b710-0d4e04777f7e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:23:22.686780 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07b5c26-4986-4642-b710-0d4e04777f7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:23:22.688750 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07b5c26-4986-4642-b710-0d4e04777f7e None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:23:22.706133 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-e07b5c26-4986-4642-b710-0d4e04777f7e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:23:22.706133 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:23:22.706133 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:23:22.706133 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:23:22.706133 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:23:22.706133 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:23:22.706133 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:23:22.706133 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:23:22.706133 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:23:22.706133 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:23:22.706133 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:23:22.706133 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:23:22.706133 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 11:23:22.706133 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 11:23:22.706133 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 11:23:22.706133 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 11:23:22.707655 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:23:22.707655 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:23:22.707655 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:23:22.707655 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:23:22.707655 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:23:22.707655 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:23:22.707655 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:23:22.707655 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Aug 24 11:23:22.707655 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:23:22.707655 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:23:22.707655 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:23:22.707655 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:23:22.707655 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:23:22.707655 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:23:22.707655 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:23:22.707655 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:23:22.707655 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 11:23:22.708620 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 11:23:22.708620 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:23:22.708620 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Aug 24 11:23:22.708620 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 603/1203] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 11:23:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:23:22.714645 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12da8456-83ec-4499-89c8-e5f6cbeea7f8 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:23:22.845720 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12da8456-83ec-4499-89c8-e5f6cbeea7f8 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:23:22.884039 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:23:22.891821 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75abec0f-40e3-4e13-95b2-ad4340f660de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:23:22.892877 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75abec0f-40e3-4e13-95b2-ad4340f660de None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:23:22.893341 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75abec0f-40e3-4e13-95b2-ad4340f660de None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:23:22.893648 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75abec0f-40e3-4e13-95b2-ad4340f660de None admin] PATH_INFO: `/v3/domains` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:23:22.894463 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75abec0f-40e3-4e13-95b2-ad4340f660de None admin] RBAC: Adding query filter params (name=Default) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:23:22.894835 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75abec0f-40e3-4e13-95b2-ad4340f660de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:23:22.896555 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75abec0f-40e3-4e13-95b2-ad4340f660de None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:23:22.919560 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 601/1204] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 24 11:23:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:23:22.924295 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07b5c26-4986-4642-b710-0d4e04777f7e None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:23:22.994187 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:23:23.059372 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07b5c26-4986-4642-b710-0d4e04777f7e None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:23:23.106432 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9eb0c6f-848d-4655-85d1-7edacd6a02cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:23:23.107251 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eb0c6f-848d-4655-85d1-7edacd6a02cd None admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:23:23.107433 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eb0c6f-848d-4655-85d1-7edacd6a02cd None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:23:23.107611 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eb0c6f-848d-4655-85d1-7edacd6a02cd None admin] PATH_INFO: `/v3/users` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:23:23.108296 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9eb0c6f-848d-4655-85d1-7edacd6a02cd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:23:23.109752 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9eb0c6f-848d-4655-85d1-7edacd6a02cd None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:23:23.135637 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 604/1205] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Aug 24 11:23:22 2022] POST /identity/v3/users => generated 251 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:23:25.283546 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fe7b11-f8f6-40a7-bcde-282dd02842d4 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:23:25.283546 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fe7b11-f8f6-40a7-bcde-282dd02842d4 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:23:25.283546 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fe7b11-f8f6-40a7-bcde-282dd02842d4 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:23:25.284392 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 602/1206] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:23:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:23:25.290209 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f905fc6-54cb-4dc5-9d8b-e86479219f61 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:23:25.290739 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f905fc6-54cb-4dc5-9d8b-e86479219f61 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:23:25.290832 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f905fc6-54cb-4dc5-9d8b-e86479219f61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:23:25.311524 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-5f905fc6-54cb-4dc5-9d8b-e86479219f61 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:23:25.312668 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-5f905fc6-54cb-4dc5-9d8b-e86479219f61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:23:25.387540 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 605/1207] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:23:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 11:23:25.677914 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fe7b11-f8f6-40a7-bcde-282dd02842d4 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:23:25.793722 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fe7b11-f8f6-40a7-bcde-282dd02842d4 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:23:25.832288 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762a9925-2c62-448b-adae-aeeffe9a43d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:23:25.833006 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762a9925-2c62-448b-adae-aeeffe9a43d7 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:23:25.833274 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762a9925-2c62-448b-adae-aeeffe9a43d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:23:25.833544 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762a9925-2c62-448b-adae-aeeffe9a43d7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:23:25.844942 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762a9925-2c62-448b-adae-aeeffe9a43d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:23:25.849786 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-762a9925-2c62-448b-adae-aeeffe9a43d7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 11:23:25.849786 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:23:25.849786 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:23:25.849786 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:23:25.849786 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:23:25.849786 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:23:25.849786 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:23:25.849786 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:23:25.849786 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:23:25.849786 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:23:25.849786 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:23:25.849786 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:23:25.849786 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:23:25.849786 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:23:25.849786 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:23:25.849786 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:23:25.851296 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:23:25.851296 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:23:25.851296 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:23:25.851296 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:23:25.851296 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:23:25.851296 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:23:25.851296 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:23:25.851296 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:23:25.851296 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:23:25.851296 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:23:25.851296 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:23:25.851296 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Aug 24 11:23:25.851296 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:23:25.851296 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:23:25.851296 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:23:25.851296 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:23:25.852161 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:23:25.852161 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:23:25.852161 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:23:25.852161 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:23:25.852161 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:23:25.852161 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:23:25.852161 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:23:25.852161 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:23:25.852161 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:23:25.852161 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:23:25.852161 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 11:23:25.852161 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:23:25.852161 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 603/1208] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Aug 24 11:23:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:23:25.857623 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f905fc6-54cb-4dc5-9d8b-e86479219f61 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:23:25.904172 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:23:25.970767 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f905fc6-54cb-4dc5-9d8b-e86479219f61 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:23:26.009184 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec70c4be-6d7d-44ac-bba9-f3640a8702a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:23:26.009880 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec70c4be-6d7d-44ac-bba9-f3640a8702a5 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:23:26.010127 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec70c4be-6d7d-44ac-bba9-f3640a8702a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:23:26.010450 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec70c4be-6d7d-44ac-bba9-f3640a8702a5 None admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:23:26.011170 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec70c4be-6d7d-44ac-bba9-f3640a8702a5 None admin] RBAC: Adding query filter params (name=service) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:23:26.011562 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec70c4be-6d7d-44ac-bba9-f3640a8702a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:23:26.013356 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec70c4be-6d7d-44ac-bba9-f3640a8702a5 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:23:26.022197 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 606/1209] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Aug 24 11:23:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:23:26.028111 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762a9925-2c62-448b-adae-aeeffe9a43d7 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:23:26.085482 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:23:26.154297 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762a9925-2c62-448b-adae-aeeffe9a43d7 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:23:26.193240 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edb5528-180a-43c8-9f03-5c3776b7630e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:23:26.193926 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edb5528-180a-43c8-9f03-5c3776b7630e None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:23:26.194197 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edb5528-180a-43c8-9f03-5c3776b7630e None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:23:26.194544 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edb5528-180a-43c8-9f03-5c3776b7630e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:23:26.206593 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edb5528-180a-43c8-9f03-5c3776b7630e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:23:26.208124 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edb5528-180a-43c8-9f03-5c3776b7630e None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:23:26.223279 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-1edb5528-180a-43c8-9f03-5c3776b7630e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:23:26.223279 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:23:26.223279 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:23:26.223279 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:23:26.223279 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:23:26.223279 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:23:26.223279 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:23:26.223279 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:23:26.223279 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:23:26.223279 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:23:26.223279 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:23:26.223279 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:23:26.223279 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 11:23:26.223279 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 11:23:26.223279 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 11:23:26.223279 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 11:23:26.224413 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:23:26.224413 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:23:26.224413 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:23:26.224413 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:23:26.224413 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:23:26.224413 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:23:26.224413 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:23:26.224413 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Aug 24 11:23:26.224413 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:23:26.224413 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:23:26.224413 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:23:26.224413 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:23:26.224413 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:23:26.224413 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:23:26.224413 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:23:26.224413 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:23:26.224413 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 11:23:26.225648 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 11:23:26.225648 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:23:26.225648 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:23:26.225648 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 604/1210] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 11:23:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:23:26.230911 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec70c4be-6d7d-44ac-bba9-f3640a8702a5 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:23:26.350422 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:23:26.353380 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec70c4be-6d7d-44ac-bba9-f3640a8702a5 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:23:26.390527 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7be79a-778f-4bdc-8ec1-705e974335d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:23:26.391128 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7be79a-778f-4bdc-8ec1-705e974335d0 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:23:26.391413 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7be79a-778f-4bdc-8ec1-705e974335d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:23:26.391667 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7be79a-778f-4bdc-8ec1-705e974335d0 None admin] PATH_INFO: `/v3/domains` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:23:26.392302 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7be79a-778f-4bdc-8ec1-705e974335d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:23:26.392674 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7be79a-778f-4bdc-8ec1-705e974335d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:23:26.394093 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7be79a-778f-4bdc-8ec1-705e974335d0 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:23:26.406655 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 607/1211] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 24 11:23:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:23:26.412910 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edb5528-180a-43c8-9f03-5c3776b7630e None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:23:26.524411 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edb5528-180a-43c8-9f03-5c3776b7630e None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:23:26.526290 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:23:26.564049 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581d1fa7-3af2-4778-9446-2f664f791545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:23:26.564818 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581d1fa7-3af2-4778-9446-2f664f791545 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:23:26.565102 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581d1fa7-3af2-4778-9446-2f664f791545 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:23:26.565381 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581d1fa7-3af2-4778-9446-2f664f791545 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:23:26.575159 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581d1fa7-3af2-4778-9446-2f664f791545 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:23:26.576938 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581d1fa7-3af2-4778-9446-2f664f791545 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:23:26.589420 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-581d1fa7-3af2-4778-9446-2f664f791545 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 11:23:26.589420 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:23:26.589420 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:23:26.589420 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:23:26.589420 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:23:26.589420 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:23:26.589420 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:23:26.589420 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:23:26.589420 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:23:26.589420 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:23:26.589420 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:23:26.589420 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:23:26.589420 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 11:23:26.589420 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 11:23:26.589420 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 11:23:26.589420 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 11:23:26.590657 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:23:26.590657 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:23:26.590657 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 11:23:26.590657 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 11:23:26.590657 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 11:23:26.590657 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 11:23:26.590657 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:23:26.590657 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:23:26.590657 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:23:26.590657 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:23:26.590657 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:23:26.590657 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Aug 24 11:23:26.590657 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:23:26.590657 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:23:26.590657 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:23:26.590657 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:23:26.590657 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:23:26.590657 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:23:26.591647 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:23:26.591647 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:23:26.591647 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 11:23:26.591647 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 11:23:26.591647 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 11:23:26.591647 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 11:23:26.591647 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 11:23:26.591647 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 11:23:26.591647 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 11:23:26.591647 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:23:26.591647 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 605/1212] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 11:23:26 2022] GET /identity/v3/users/placement => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:23:26.597316 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7be79a-778f-4bdc-8ec1-705e974335d0 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:23:26.704937 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7be79a-778f-4bdc-8ec1-705e974335d0 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:23:26.740088 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069fd910-f961-4cde-9984-d58a389cd185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:23:26.740790 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069fd910-f961-4cde-9984-d58a389cd185 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:23:26.741131 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069fd910-f961-4cde-9984-d58a389cd185 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:23:26.741457 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069fd910-f961-4cde-9984-d58a389cd185 None admin] PATH_INFO: `/v3/users` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:23:26.742445 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069fd910-f961-4cde-9984-d58a389cd185 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:23:26.742920 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069fd910-f961-4cde-9984-d58a389cd185 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:23:26.744335 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069fd910-f961-4cde-9984-d58a389cd185 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:23:26.762037 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 608/1213] 10.222.0.27 () {56 vars in 1143 bytes} [Wed Aug 24 11:23:26 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:23:26.768173 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581d1fa7-3af2-4778-9446-2f664f791545 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:23:26.885671 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581d1fa7-3af2-4778-9446-2f664f791545 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:23:26.921933 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3295687-ac99-43d1-bec4-ed6c3268c0f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:23:26.922597 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3295687-ac99-43d1-bec4-ed6c3268c0f1 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:23:26.922877 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3295687-ac99-43d1-bec4-ed6c3268c0f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:23:26.923135 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3295687-ac99-43d1-bec4-ed6c3268c0f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:23:26.958174 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:23:27.008832 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3295687-ac99-43d1-bec4-ed6c3268c0f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:23:27.010482 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3295687-ac99-43d1-bec4-ed6c3268c0f1 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:23:27.137524 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 606/1214] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 24 11:23:26 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 11:23:27.138978 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069fd910-f961-4cde-9984-d58a389cd185 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:23:27.161703 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:23:27.248905 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069fd910-f961-4cde-9984-d58a389cd185 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:23:27.290455 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b08489-9ba5-486a-952e-efc72803cecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:23:27.291200 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b08489-9ba5-486a-952e-efc72803cecb None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:23:27.291485 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b08489-9ba5-486a-952e-efc72803cecb None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:23:27.292630 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b08489-9ba5-486a-952e-efc72803cecb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:23:27.305945 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b08489-9ba5-486a-952e-efc72803cecb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:23:27.307694 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b08489-9ba5-486a-952e-efc72803cecb None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:23:27.325697 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-05b08489-9ba5-486a-952e-efc72803cecb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:23:27.325697 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:23:27.325697 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:23:27.325697 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:23:27.325697 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:23:27.325697 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:23:27.325697 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:23:27.325697 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:23:27.325697 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:23:27.325697 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:23:27.325697 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:23:27.325697 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:23:27.325697 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 11:23:27.325697 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 11:23:27.325697 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 11:23:27.325697 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 11:23:27.328176 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:23:27.328176 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:23:27.328176 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:23:27.328176 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:23:27.328176 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:23:27.328176 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:23:27.328176 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:23:27.328176 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Aug 24 11:23:27.328176 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:23:27.328176 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:23:27.328176 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:23:27.328176 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:23:27.328176 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:23:27.328176 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:23:27.328176 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:23:27.328176 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:23:27.328176 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 11:23:27.329305 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 11:23:27.329305 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:23:27.329305 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Aug 24 11:23:27.329305 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 609/1215] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 11:23:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:23:27.333251 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3295687-ac99-43d1-bec4-ed6c3268c0f1 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:23:27.412957 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:23:27.459926 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3295687-ac99-43d1-bec4-ed6c3268c0f1 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:23:27.503569 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6802abd0-f976-4b2b-82cf-5462644f5f29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:23:27.504340 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6802abd0-f976-4b2b-82cf-5462644f5f29 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:23:27.504681 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6802abd0-f976-4b2b-82cf-5462644f5f29 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:23:27.505017 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6802abd0-f976-4b2b-82cf-5462644f5f29 None admin] PATH_INFO: `/v3/domains` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:23:27.505878 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6802abd0-f976-4b2b-82cf-5462644f5f29 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:23:27.506260 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6802abd0-f976-4b2b-82cf-5462644f5f29 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:23:27.507853 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6802abd0-f976-4b2b-82cf-5462644f5f29 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:23:27.520823 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 607/1216] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 24 11:23:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:23:27.527139 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b08489-9ba5-486a-952e-efc72803cecb None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:23:27.613078 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:23:27.650284 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b08489-9ba5-486a-952e-efc72803cecb None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:23:27.687920 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f52cebb-7f3b-478d-a0c6-c0f52b04f0e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:23:27.688680 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f52cebb-7f3b-478d-a0c6-c0f52b04f0e9 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:23:27.689058 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f52cebb-7f3b-478d-a0c6-c0f52b04f0e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:23:27.689431 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f52cebb-7f3b-478d-a0c6-c0f52b04f0e9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:23:27.698010 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f52cebb-7f3b-478d-a0c6-c0f52b04f0e9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:23:27.700060 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f52cebb-7f3b-478d-a0c6-c0f52b04f0e9 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:23:27.712214 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-8f52cebb-7f3b-478d-a0c6-c0f52b04f0e9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 11:23:27.712214 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:23:27.712214 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:23:27.712214 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:23:27.712214 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:23:27.712214 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:23:27.712214 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:23:27.712214 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:23:27.712214 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:23:27.712214 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:23:27.712214 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:23:27.712214 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:23:27.712214 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 11:23:27.712214 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 11:23:27.712214 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 11:23:27.713392 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 11:23:27.713392 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:23:27.713392 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:23:27.713392 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:23:27.713392 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:23:27.713392 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:23:27.713392 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:23:27.713392 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:23:27.713392 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Aug 24 11:23:27.713392 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:23:27.713392 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:23:27.713392 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:23:27.713392 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:23:27.713392 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:23:27.713392 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:23:27.713392 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:23:27.713392 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:23:27.714579 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 11:23:27.714579 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 11:23:27.714579 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 11:23:27.714579 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 11:23:27.714579 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 11:23:27.714579 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 11:23:27.714579 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 11:23:27.714579 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Aug 24 11:23:27.716008 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 610/1217] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Aug 24 11:23:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:23:27.721983 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6802abd0-f976-4b2b-82cf-5462644f5f29 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:23:27.841374 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6802abd0-f976-4b2b-82cf-5462644f5f29 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:23:27.872248 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:23:27.885075 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f862986-7674-47ac-86af-c02f88b1564b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:23:27.885766 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f862986-7674-47ac-86af-c02f88b1564b None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:23:27.886044 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f862986-7674-47ac-86af-c02f88b1564b None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:23:27.886458 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f862986-7674-47ac-86af-c02f88b1564b None admin] PATH_INFO: `/v3/projects` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:23:27.887184 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f862986-7674-47ac-86af-c02f88b1564b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:23:27.887482 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f862986-7674-47ac-86af-c02f88b1564b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:23:27.888950 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f862986-7674-47ac-86af-c02f88b1564b None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:23:27.904075 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 608/1218] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Aug 24 11:23:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:23:27.911477 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f52cebb-7f3b-478d-a0c6-c0f52b04f0e9 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:23:28.018305 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f52cebb-7f3b-478d-a0c6-c0f52b04f0e9 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:23:28.048077 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:23:28.054805 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52174142-a02d-431c-9738-4c591b27ce01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:23:28.055418 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52174142-a02d-431c-9738-4c591b27ce01 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:23:28.055694 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52174142-a02d-431c-9738-4c591b27ce01 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:23:28.055962 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52174142-a02d-431c-9738-4c591b27ce01 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:23:28.056742 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52174142-a02d-431c-9738-4c591b27ce01 None admin] RBAC: Adding query filter params (role.id=217baac59e08499ea2f1b1d84935df0b, scope.project.id=317f54a463cb48ab86648c6dcec5db0f, user.id=ad45431e70ff48a9b90905a97d473d81) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:23:28.057054 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52174142-a02d-431c-9738-4c591b27ce01 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:23:28.058537 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52174142-a02d-431c-9738-4c591b27ce01 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:23:28.065254 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 611/1219] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Aug 24 11:23:27 2022] GET /identity/v3/role_assignments?user.id=ad45431e70ff48a9b90905a97d473d81&scope.project.id=317f54a463cb48ab86648c6dcec5db0f&role.id=217baac59e08499ea2f1b1d84935df0b => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:23:29.990854 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334a2dc7-8874-4b14-8fe9-84e9fb9aebcd None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:23:29.991459 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334a2dc7-8874-4b14-8fe9-84e9fb9aebcd None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:23:29.991459 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334a2dc7-8874-4b14-8fe9-84e9fb9aebcd None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:23:29.992802 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 609/1220] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:23:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:23:29.998625 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494982e7-d49b-45c6-b534-d4a95eedc0f3 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:23:29.999081 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494982e7-d49b-45c6-b534-d4a95eedc0f3 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:23:29.999310 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494982e7-d49b-45c6-b534-d4a95eedc0f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:23:30.021428 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-494982e7-d49b-45c6-b534-d4a95eedc0f3 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:23:30.023356 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-494982e7-d49b-45c6-b534-d4a95eedc0f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:23:30.096277 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 612/1221] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:23:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 11:23:30.378997 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334a2dc7-8874-4b14-8fe9-84e9fb9aebcd None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:23:30.490767 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334a2dc7-8874-4b14-8fe9-84e9fb9aebcd None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:23:30.531422 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250d3ca6-42ff-4601-bf3e-d7acd83b313e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:23:30.532464 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250d3ca6-42ff-4601-bf3e-d7acd83b313e None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:23:30.532750 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250d3ca6-42ff-4601-bf3e-d7acd83b313e None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:23:30.533093 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250d3ca6-42ff-4601-bf3e-d7acd83b313e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:23:30.544910 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250d3ca6-42ff-4601-bf3e-d7acd83b313e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:23:30.549727 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-250d3ca6-42ff-4601-bf3e-d7acd83b313e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 11:23:30.549727 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:23:30.549727 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:23:30.549727 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:23:30.549727 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:23:30.549727 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:23:30.549727 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:23:30.549727 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:23:30.549727 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:23:30.549727 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:23:30.549727 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:23:30.549727 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:23:30.549727 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:23:30.549727 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:23:30.549727 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:23:30.549727 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:23:30.551066 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:23:30.551066 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:23:30.551066 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:23:30.551066 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:23:30.551066 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:23:30.551066 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:23:30.551066 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:23:30.551066 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:23:30.551066 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:23:30.551066 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:23:30.551066 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:23:30.551066 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Aug 24 11:23:30.551066 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:23:30.551066 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:23:30.551066 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:23:30.551066 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:23:30.551956 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:23:30.551956 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:23:30.551956 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:23:30.551956 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:23:30.551956 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:23:30.551956 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:23:30.551956 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:23:30.551956 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:23:30.551956 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:23:30.551956 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:23:30.551956 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 11:23:30.551956 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:23:30.551956 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 610/1222] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Aug 24 11:23:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:23:30.557811 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494982e7-d49b-45c6-b534-d4a95eedc0f3 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:23:30.695443 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494982e7-d49b-45c6-b534-d4a95eedc0f3 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:23:30.728701 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:23:30.743129 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7a93d2-e7a4-4e9c-96c0-09eb2306fd09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:23:30.743752 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7a93d2-e7a4-4e9c-96c0-09eb2306fd09 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:23:30.744027 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7a93d2-e7a4-4e9c-96c0-09eb2306fd09 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:23:30.744292 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7a93d2-e7a4-4e9c-96c0-09eb2306fd09 None admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:23:30.744988 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7a93d2-e7a4-4e9c-96c0-09eb2306fd09 None admin] RBAC: Adding query filter params (name=service) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:23:30.745292 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7a93d2-e7a4-4e9c-96c0-09eb2306fd09 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:23:30.746713 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7a93d2-e7a4-4e9c-96c0-09eb2306fd09 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:23:30.754692 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 613/1223] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Aug 24 11:23:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:23:30.760688 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250d3ca6-42ff-4601-bf3e-d7acd83b313e None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:23:30.810705 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:23:30.876597 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250d3ca6-42ff-4601-bf3e-d7acd83b313e None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:23:30.915900 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b5ba70-40df-43b4-ab73-9aedc169d382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:23:30.916983 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b5ba70-40df-43b4-ab73-9aedc169d382 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:23:30.917307 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b5ba70-40df-43b4-ab73-9aedc169d382 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:23:30.917685 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b5ba70-40df-43b4-ab73-9aedc169d382 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:23:30.938161 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b5ba70-40df-43b4-ab73-9aedc169d382 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:23:30.939772 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b5ba70-40df-43b4-ab73-9aedc169d382 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:23:30.955597 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-98b5ba70-40df-43b4-ab73-9aedc169d382 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:23:30.955597 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:23:30.955597 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:23:30.955597 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:23:30.955597 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:23:30.955597 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:23:30.955597 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:23:30.955597 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:23:30.955597 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:23:30.955597 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:23:30.955597 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:23:30.955597 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:23:30.955597 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 11:23:30.955597 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 11:23:30.955597 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 11:23:30.955597 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 11:23:30.956789 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:23:30.956789 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:23:30.956789 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:23:30.956789 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:23:30.956789 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:23:30.956789 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:23:30.956789 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:23:30.956789 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Aug 24 11:23:30.956789 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:23:30.956789 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:23:30.956789 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:23:30.956789 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:23:30.956789 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:23:30.956789 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:23:30.956789 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:23:30.956789 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:23:30.956789 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 11:23:30.957995 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 11:23:30.957995 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:23:30.957995 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:23:30.961792 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 611/1224] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 11:23:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:23:30.962689 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7a93d2-e7a4-4e9c-96c0-09eb2306fd09 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:23:31.070881 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7a93d2-e7a4-4e9c-96c0-09eb2306fd09 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:23:31.109540 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333a1e04-56ab-4af7-b5c8-2a05d2ddcbb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:23:31.110202 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333a1e04-56ab-4af7-b5c8-2a05d2ddcbb0 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:23:31.110594 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333a1e04-56ab-4af7-b5c8-2a05d2ddcbb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:23:31.110872 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333a1e04-56ab-4af7-b5c8-2a05d2ddcbb0 None admin] PATH_INFO: `/v3/domains` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:23:31.111541 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333a1e04-56ab-4af7-b5c8-2a05d2ddcbb0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:23:31.111847 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333a1e04-56ab-4af7-b5c8-2a05d2ddcbb0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:23:31.113233 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333a1e04-56ab-4af7-b5c8-2a05d2ddcbb0 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:23:31.128176 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 614/1225] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 24 11:23:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:23:31.134484 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b5ba70-40df-43b4-ab73-9aedc169d382 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:23:31.237074 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:23:31.244898 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b5ba70-40df-43b4-ab73-9aedc169d382 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:23:31.279827 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fe6d1e-082e-4822-a1df-5ed307cc7912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:23:31.280465 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fe6d1e-082e-4822-a1df-5ed307cc7912 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:23:31.280730 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fe6d1e-082e-4822-a1df-5ed307cc7912 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:23:31.281006 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fe6d1e-082e-4822-a1df-5ed307cc7912 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:23:31.291581 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fe6d1e-082e-4822-a1df-5ed307cc7912 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:23:31.293044 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fe6d1e-082e-4822-a1df-5ed307cc7912 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:23:31.307895 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-77fe6d1e-082e-4822-a1df-5ed307cc7912 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 11:23:31.307895 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:23:31.307895 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:23:31.307895 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:23:31.307895 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:23:31.307895 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:23:31.307895 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:23:31.307895 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:23:31.307895 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:23:31.307895 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:23:31.307895 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:23:31.307895 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:23:31.307895 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 11:23:31.307895 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 11:23:31.307895 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 11:23:31.307895 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 11:23:31.309158 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:23:31.309158 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:23:31.309158 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 11:23:31.309158 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 11:23:31.309158 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 11:23:31.309158 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 11:23:31.309158 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:23:31.309158 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:23:31.309158 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:23:31.309158 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:23:31.309158 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:23:31.309158 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Aug 24 11:23:31.309158 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:23:31.309158 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:23:31.309158 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:23:31.309158 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:23:31.309158 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:23:31.309158 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:23:31.310236 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:23:31.310236 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:23:31.310236 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 11:23:31.310236 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 11:23:31.310236 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 11:23:31.310236 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 11:23:31.310236 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 11:23:31.310236 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 11:23:31.310236 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 11:23:31.310236 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:23:31.310236 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 612/1226] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 11:23:31 2022] GET /identity/v3/users/placement => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 11:23:31.315976 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333a1e04-56ab-4af7-b5c8-2a05d2ddcbb0 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:23:31.378730 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:23:31.437891 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333a1e04-56ab-4af7-b5c8-2a05d2ddcbb0 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:23:31.476328 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186932ba-9278-489b-88c3-290c92c5fa01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:23:31.476943 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186932ba-9278-489b-88c3-290c92c5fa01 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:23:31.477220 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186932ba-9278-489b-88c3-290c92c5fa01 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:23:31.477490 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186932ba-9278-489b-88c3-290c92c5fa01 None admin] PATH_INFO: `/v3/users` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:23:31.478227 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186932ba-9278-489b-88c3-290c92c5fa01 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:23:31.478555 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186932ba-9278-489b-88c3-290c92c5fa01 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:23:31.480080 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186932ba-9278-489b-88c3-290c92c5fa01 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:23:31.500716 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 615/1227] 10.222.0.27 () {56 vars in 1143 bytes} [Wed Aug 24 11:23:31 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:23:31.506725 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fe6d1e-082e-4822-a1df-5ed307cc7912 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:23:31.624197 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fe6d1e-082e-4822-a1df-5ed307cc7912 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:23:31.664564 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd8dde7-68b0-43d1-aefd-46d7b1031a42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:23:31.665335 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd8dde7-68b0-43d1-aefd-46d7b1031a42 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:23:31.665730 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd8dde7-68b0-43d1-aefd-46d7b1031a42 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:23:31.666062 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd8dde7-68b0-43d1-aefd-46d7b1031a42 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:23:31.683854 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd8dde7-68b0-43d1-aefd-46d7b1031a42 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:23:31.685696 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd8dde7-68b0-43d1-aefd-46d7b1031a42 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:23:31.705108 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-4cd8dde7-68b0-43d1-aefd-46d7b1031a42 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:23:31.705108 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:23:31.705108 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:23:31.705108 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:23:31.705108 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:23:31.705108 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:23:31.705108 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:23:31.705108 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:23:31.705108 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:23:31.705108 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:23:31.705108 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:23:31.705108 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:23:31.705108 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 11:23:31.705108 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 11:23:31.705108 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 11:23:31.705108 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 11:23:31.706399 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:23:31.706399 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:23:31.706399 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:23:31.706399 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:23:31.706399 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:23:31.706399 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:23:31.706399 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:23:31.706399 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Aug 24 11:23:31.706399 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:23:31.706399 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:23:31.706399 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:23:31.706399 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:23:31.706399 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:23:31.706399 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:23:31.706399 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:23:31.706399 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:23:31.706399 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 11:23:31.707505 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 11:23:31.707505 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:23:31.707505 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:23:31.711891 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 613/1228] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 11:23:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:23:31.713528 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186932ba-9278-489b-88c3-290c92c5fa01 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:23:31.834796 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186932ba-9278-489b-88c3-290c92c5fa01 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:23:31.837301 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:23:31.872341 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dead7b-6615-4c6c-928a-07b8f6b61459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:23:31.873164 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dead7b-6615-4c6c-928a-07b8f6b61459 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:23:31.873451 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dead7b-6615-4c6c-928a-07b8f6b61459 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:23:31.873776 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dead7b-6615-4c6c-928a-07b8f6b61459 None admin] PATH_INFO: `/v3/domains` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:23:31.874840 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dead7b-6615-4c6c-928a-07b8f6b61459 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:23:31.875160 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dead7b-6615-4c6c-928a-07b8f6b61459 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:23:31.876880 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dead7b-6615-4c6c-928a-07b8f6b61459 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:23:31.891162 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 616/1229] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 24 11:23:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:23:31.897251 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd8dde7-68b0-43d1-aefd-46d7b1031a42 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:23:31.908381 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:23:32.011816 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd8dde7-68b0-43d1-aefd-46d7b1031a42 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:23:32.060118 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba96f73d-f618-4dab-8739-59f3300a9248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:23:32.060757 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba96f73d-f618-4dab-8739-59f3300a9248 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:23:32.061030 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba96f73d-f618-4dab-8739-59f3300a9248 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:23:32.061293 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba96f73d-f618-4dab-8739-59f3300a9248 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:23:32.068358 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba96f73d-f618-4dab-8739-59f3300a9248 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:23:32.069865 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba96f73d-f618-4dab-8739-59f3300a9248 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:23:32.083283 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-ba96f73d-f618-4dab-8739-59f3300a9248 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 11:23:32.083283 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:23:32.083283 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:23:32.083283 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:23:32.083283 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:23:32.083283 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:23:32.083283 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:23:32.083283 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:23:32.083283 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:23:32.083283 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:23:32.083283 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:23:32.083283 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:23:32.083283 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 11:23:32.083283 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 11:23:32.083283 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 11:23:32.084486 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 11:23:32.084486 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:23:32.084486 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:23:32.084486 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:23:32.084486 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:23:32.084486 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:23:32.084486 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:23:32.084486 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:23:32.084486 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Aug 24 11:23:32.084486 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:23:32.084486 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:23:32.084486 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:23:32.084486 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:23:32.084486 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:23:32.084486 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:23:32.084486 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:23:32.084486 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:23:32.085911 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 11:23:32.085911 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 11:23:32.085911 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 11:23:32.085911 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 11:23:32.085911 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 11:23:32.085911 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 11:23:32.085911 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 11:23:32.085911 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:23:32.085911 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 614/1230] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Aug 24 11:23:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:23:32.091046 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dead7b-6615-4c6c-928a-07b8f6b61459 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:23:32.206314 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dead7b-6615-4c6c-928a-07b8f6b61459 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:23:32.244273 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f385211-d0e4-42a2-b865-e915b13359c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:23:32.244889 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f385211-d0e4-42a2-b865-e915b13359c7 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:23:32.245227 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f385211-d0e4-42a2-b865-e915b13359c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:23:32.245527 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f385211-d0e4-42a2-b865-e915b13359c7 None admin] PATH_INFO: `/v3/projects` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:23:32.246273 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f385211-d0e4-42a2-b865-e915b13359c7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:23:32.246626 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f385211-d0e4-42a2-b865-e915b13359c7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:23:32.248370 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f385211-d0e4-42a2-b865-e915b13359c7 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:23:32.266728 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 617/1231] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Aug 24 11:23:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:23:32.267974 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba96f73d-f618-4dab-8739-59f3300a9248 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:23:32.342539 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:23:32.379386 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba96f73d-f618-4dab-8739-59f3300a9248 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:23:32.414097 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dd3d48-0e48-4fa7-b07b-edf4a7e411b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:23:32.414786 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dd3d48-0e48-4fa7-b07b-edf4a7e411b5 None admin] REQUEST_METHOD: `PUT` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:23:32.415063 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dd3d48-0e48-4fa7-b07b-edf4a7e411b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:23:32.415351 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dd3d48-0e48-4fa7-b07b-edf4a7e411b5 None admin] PATH_INFO: `/v3/projects/317f54a463cb48ab86648c6dcec5db0f/users/ad45431e70ff48a9b90905a97d473d81/roles/217baac59e08499ea2f1b1d84935df0b` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:23:32.431152 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dd3d48-0e48-4fa7-b07b-edf4a7e411b5 None admin] RBAC: Authorizing `identity:create_grant(project_id=317f54a463cb48ab86648c6dcec5db0f, user_id=ad45431e70ff48a9b90905a97d473d81, role_id=217baac59e08499ea2f1b1d84935df0b)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:23:32.432624 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dd3d48-0e48-4fa7-b07b-edf4a7e411b5 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:23:32.448461 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 615/1232] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Aug 24 11:23:32 2022] PUT /identity/v3/projects/317f54a463cb48ab86648c6dcec5db0f/users/ad45431e70ff48a9b90905a97d473d81/roles/217baac59e08499ea2f1b1d84935df0b => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:23:34.377660 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade6d70b-9ffc-44ad-896d-9c6035f64149 None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:23:34.378263 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade6d70b-9ffc-44ad-896d-9c6035f64149 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:23:34.378263 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade6d70b-9ffc-44ad-896d-9c6035f64149 None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:23:34.379776 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 618/1233] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:23:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:23:34.385652 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1918f295-fbc1-4b0f-9558-f18fc5603d46 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:23:34.386107 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1918f295-fbc1-4b0f-9558-f18fc5603d46 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:23:34.386335 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1918f295-fbc1-4b0f-9558-f18fc5603d46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:23:34.408454 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-1918f295-fbc1-4b0f-9558-f18fc5603d46 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:23:34.409913 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-1918f295-fbc1-4b0f-9558-f18fc5603d46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:23:34.483242 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 616/1234] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:23:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 11:23:34.790405 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade6d70b-9ffc-44ad-896d-9c6035f64149 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:23:34.822719 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:23:34.906813 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade6d70b-9ffc-44ad-896d-9c6035f64149 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:23:34.939578 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ecfcf3-ecb3-4286-9142-ef71e86460e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:23:34.940210 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ecfcf3-ecb3-4286-9142-ef71e86460e6 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:23:34.940483 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ecfcf3-ecb3-4286-9142-ef71e86460e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:23:34.940746 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ecfcf3-ecb3-4286-9142-ef71e86460e6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:23:34.950491 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ecfcf3-ecb3-4286-9142-ef71e86460e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:23:34.955119 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-38ecfcf3-ecb3-4286-9142-ef71e86460e6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 11:23:34.955119 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:23:34.955119 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:23:34.955119 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:23:34.955119 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:23:34.955119 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:23:34.955119 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:23:34.955119 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:23:34.955119 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:23:34.955119 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:23:34.955119 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:23:34.955119 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:23:34.955119 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:23:34.955119 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:23:34.955119 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:23:34.955119 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:23:34.956075 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:23:34.956075 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:23:34.956075 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:23:34.956075 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:23:34.956075 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:23:34.956075 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:23:34.956075 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:23:34.956075 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:23:34.956075 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:23:34.956075 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:23:34.956075 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:23:34.956075 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Aug 24 11:23:34.956075 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:23:34.956075 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:23:34.956075 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:23:34.956075 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:23:34.956912 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:23:34.956912 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:23:34.956912 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:23:34.956912 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:23:34.956912 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:23:34.956912 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:23:34.956912 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:23:34.956912 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:23:34.956912 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:23:34.956912 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:23:34.956912 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 11:23:34.956912 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Aug 24 11:23:34.956912 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 619/1235] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Aug 24 11:23:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 11:23:34.962922 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1918f295-fbc1-4b0f-9558-f18fc5603d46 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:23:35.010647 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:23:35.068104 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1918f295-fbc1-4b0f-9558-f18fc5603d46 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:23:35.102793 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3ff069-03ec-41bc-aa28-64201c50e169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:23:35.103418 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3ff069-03ec-41bc-aa28-64201c50e169 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:23:35.104179 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3ff069-03ec-41bc-aa28-64201c50e169 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:23:35.104179 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3ff069-03ec-41bc-aa28-64201c50e169 None admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:23:35.104694 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3ff069-03ec-41bc-aa28-64201c50e169 None admin] RBAC: Adding query filter params (name=service) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:23:35.104996 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3ff069-03ec-41bc-aa28-64201c50e169 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:23:35.106465 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3ff069-03ec-41bc-aa28-64201c50e169 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:23:35.115415 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 617/1236] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Aug 24 11:23:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:23:35.121281 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ecfcf3-ecb3-4286-9142-ef71e86460e6 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:23:35.222054 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:23:35.239704 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ecfcf3-ecb3-4286-9142-ef71e86460e6 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:23:35.277996 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ea5c3b-4a4b-4375-8922-e9ba162e48ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:23:35.278765 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ea5c3b-4a4b-4375-8922-e9ba162e48ba None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:23:35.279368 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ea5c3b-4a4b-4375-8922-e9ba162e48ba None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:23:35.279739 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ea5c3b-4a4b-4375-8922-e9ba162e48ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:23:35.293048 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ea5c3b-4a4b-4375-8922-e9ba162e48ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:23:35.294800 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ea5c3b-4a4b-4375-8922-e9ba162e48ba None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:23:35.309656 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-21ea5c3b-4a4b-4375-8922-e9ba162e48ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:23:35.309656 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:23:35.309656 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:23:35.309656 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:23:35.309656 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:23:35.309656 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:23:35.309656 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:23:35.309656 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:23:35.309656 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:23:35.309656 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:23:35.309656 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:23:35.309656 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:23:35.309656 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 11:23:35.309656 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 11:23:35.309656 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 11:23:35.309656 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 11:23:35.310795 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:23:35.310795 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:23:35.310795 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:23:35.310795 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:23:35.310795 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:23:35.310795 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:23:35.310795 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:23:35.310795 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Aug 24 11:23:35.310795 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:23:35.310795 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:23:35.310795 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:23:35.310795 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:23:35.310795 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:23:35.310795 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:23:35.310795 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:23:35.310795 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:23:35.310795 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 11:23:35.311718 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 11:23:35.311718 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:23:35.311718 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Aug 24 11:23:35.311718 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 620/1237] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 11:23:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:23:35.317121 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3ff069-03ec-41bc-aa28-64201c50e169 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:23:35.425910 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3ff069-03ec-41bc-aa28-64201c50e169 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:23:35.435051 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:23:35.459993 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a147fca-4e90-49cf-bf39-7b4aa6ec4e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:23:35.460623 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a147fca-4e90-49cf-bf39-7b4aa6ec4e68 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:23:35.460895 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a147fca-4e90-49cf-bf39-7b4aa6ec4e68 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:23:35.461162 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a147fca-4e90-49cf-bf39-7b4aa6ec4e68 None admin] PATH_INFO: `/v3/domains` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:23:35.461805 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a147fca-4e90-49cf-bf39-7b4aa6ec4e68 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:23:35.462102 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a147fca-4e90-49cf-bf39-7b4aa6ec4e68 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:23:35.463525 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a147fca-4e90-49cf-bf39-7b4aa6ec4e68 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:23:35.475319 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 618/1238] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 24 11:23:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:23:35.481543 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ea5c3b-4a4b-4375-8922-e9ba162e48ba None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:23:35.596366 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ea5c3b-4a4b-4375-8922-e9ba162e48ba None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:23:35.631335 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72cdd92-d5c5-4a49-9f4c-e3a353827939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:23:35.631997 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72cdd92-d5c5-4a49-9f4c-e3a353827939 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:23:35.632292 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72cdd92-d5c5-4a49-9f4c-e3a353827939 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:23:35.632558 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72cdd92-d5c5-4a49-9f4c-e3a353827939 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:23:35.635665 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:23:35.641288 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72cdd92-d5c5-4a49-9f4c-e3a353827939 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:23:35.643009 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72cdd92-d5c5-4a49-9f4c-e3a353827939 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:23:35.654545 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-f72cdd92-d5c5-4a49-9f4c-e3a353827939 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 11:23:35.654545 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:23:35.654545 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:23:35.654545 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:23:35.654545 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:23:35.654545 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:23:35.654545 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:23:35.654545 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:23:35.654545 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:23:35.654545 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:23:35.654545 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:23:35.654545 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:23:35.654545 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 11:23:35.654545 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 11:23:35.654545 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 11:23:35.654545 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 11:23:35.655684 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:23:35.655684 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:23:35.655684 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 11:23:35.655684 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 11:23:35.655684 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 11:23:35.655684 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 11:23:35.655684 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:23:35.655684 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:23:35.655684 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:23:35.655684 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:23:35.655684 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:23:35.655684 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Aug 24 11:23:35.655684 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:23:35.655684 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:23:35.655684 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:23:35.655684 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:23:35.655684 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:23:35.655684 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:23:35.656632 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:23:35.656632 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:23:35.656632 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 11:23:35.656632 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 11:23:35.656632 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 11:23:35.656632 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 11:23:35.656632 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 11:23:35.656632 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 11:23:35.656632 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 11:23:35.656632 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Aug 24 11:23:35.656632 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 621/1239] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 11:23:35 2022] GET /identity/v3/users/placement => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:23:35.661785 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a147fca-4e90-49cf-bf39-7b4aa6ec4e68 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:23:35.767257 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a147fca-4e90-49cf-bf39-7b4aa6ec4e68 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:23:35.806853 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511846d4-763a-4409-92e2-5940220a053f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:23:35.807467 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511846d4-763a-4409-92e2-5940220a053f None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:23:35.807769 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511846d4-763a-4409-92e2-5940220a053f None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:23:35.808033 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511846d4-763a-4409-92e2-5940220a053f None admin] PATH_INFO: `/v3/users` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:23:35.808781 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511846d4-763a-4409-92e2-5940220a053f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:23:35.809081 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511846d4-763a-4409-92e2-5940220a053f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:23:35.810551 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511846d4-763a-4409-92e2-5940220a053f None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:23:35.829295 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 619/1240] 10.222.0.27 () {56 vars in 1143 bytes} [Wed Aug 24 11:23:35 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:23:35.836194 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72cdd92-d5c5-4a49-9f4c-e3a353827939 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:23:35.951286 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72cdd92-d5c5-4a49-9f4c-e3a353827939 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:23:35.989994 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736c9ffc-69a3-4f1a-89a5-6bc4fa303e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:23:35.990690 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736c9ffc-69a3-4f1a-89a5-6bc4fa303e76 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:23:35.991036 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736c9ffc-69a3-4f1a-89a5-6bc4fa303e76 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:23:35.991397 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736c9ffc-69a3-4f1a-89a5-6bc4fa303e76 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:23:36.061872 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:23:36.070343 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736c9ffc-69a3-4f1a-89a5-6bc4fa303e76 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:23:36.071876 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736c9ffc-69a3-4f1a-89a5-6bc4fa303e76 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:23:36.188238 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 622/1241] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 24 11:23:35 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 24 11:23:36.195068 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511846d4-763a-4409-92e2-5940220a053f None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:23:36.227510 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:23:36.306886 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511846d4-763a-4409-92e2-5940220a053f None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:23:36.343117 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c668aa04-d4a7-41cf-ac26-cf1aa8feacf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:23:36.343623 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c668aa04-d4a7-41cf-ac26-cf1aa8feacf9 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:23:36.343895 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c668aa04-d4a7-41cf-ac26-cf1aa8feacf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:23:36.344176 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c668aa04-d4a7-41cf-ac26-cf1aa8feacf9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:23:36.354603 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c668aa04-d4a7-41cf-ac26-cf1aa8feacf9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:23:36.356069 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c668aa04-d4a7-41cf-ac26-cf1aa8feacf9 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:23:36.373168 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-c668aa04-d4a7-41cf-ac26-cf1aa8feacf9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:23:36.373168 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:23:36.373168 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:23:36.373168 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:23:36.373168 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:23:36.373168 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:23:36.373168 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:23:36.373168 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:23:36.373168 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:23:36.373168 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:23:36.373168 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:23:36.373168 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:23:36.373168 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 11:23:36.373168 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 11:23:36.373168 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 11:23:36.373168 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 11:23:36.374380 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:23:36.374380 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:23:36.374380 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:23:36.374380 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:23:36.374380 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:23:36.374380 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:23:36.374380 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:23:36.374380 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Aug 24 11:23:36.374380 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:23:36.374380 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:23:36.374380 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:23:36.374380 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:23:36.374380 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:23:36.374380 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:23:36.374380 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:23:36.374380 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:23:36.374380 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 11:23:36.375348 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 11:23:36.375348 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:23:36.375348 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:23:36.375348 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 620/1242] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 11:23:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:23:36.380780 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736c9ffc-69a3-4f1a-89a5-6bc4fa303e76 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:23:36.485102 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:23:36.493877 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736c9ffc-69a3-4f1a-89a5-6bc4fa303e76 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:23:36.529468 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccbca5e-1196-419a-a9ff-f9c8199d632a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:23:36.530312 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccbca5e-1196-419a-a9ff-f9c8199d632a None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:23:36.530679 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccbca5e-1196-419a-a9ff-f9c8199d632a None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:23:36.530995 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccbca5e-1196-419a-a9ff-f9c8199d632a None admin] PATH_INFO: `/v3/domains` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:23:36.531895 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccbca5e-1196-419a-a9ff-f9c8199d632a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:23:36.532235 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccbca5e-1196-419a-a9ff-f9c8199d632a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:23:36.533965 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccbca5e-1196-419a-a9ff-f9c8199d632a None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:23:36.553816 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 623/1243] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 24 11:23:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:23:36.555401 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c668aa04-d4a7-41cf-ac26-cf1aa8feacf9 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:23:36.649352 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:23:36.674520 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c668aa04-d4a7-41cf-ac26-cf1aa8feacf9 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:23:36.721774 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86e0968-bfa4-4f39-a3d2-5cc3193c4fa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:23:36.722427 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86e0968-bfa4-4f39-a3d2-5cc3193c4fa1 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:23:36.722697 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86e0968-bfa4-4f39-a3d2-5cc3193c4fa1 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:23:36.722958 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86e0968-bfa4-4f39-a3d2-5cc3193c4fa1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:23:36.731480 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86e0968-bfa4-4f39-a3d2-5cc3193c4fa1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:23:36.733401 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86e0968-bfa4-4f39-a3d2-5cc3193c4fa1 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:23:36.747164 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-c86e0968-bfa4-4f39-a3d2-5cc3193c4fa1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 11:23:36.747164 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:23:36.747164 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:23:36.747164 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:23:36.747164 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:23:36.747164 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:23:36.747164 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:23:36.747164 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:23:36.747164 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:23:36.747164 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:23:36.747164 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:23:36.747164 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:23:36.747164 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 11:23:36.747164 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 11:23:36.747164 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 11:23:36.748324 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 11:23:36.748324 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:23:36.748324 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:23:36.748324 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:23:36.748324 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:23:36.748324 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:23:36.748324 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:23:36.748324 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:23:36.748324 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Aug 24 11:23:36.748324 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:23:36.748324 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:23:36.748324 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:23:36.748324 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:23:36.748324 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:23:36.748324 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:23:36.748324 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:23:36.748324 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:23:36.749467 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 11:23:36.749467 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 11:23:36.749467 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 11:23:36.749467 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 11:23:36.749467 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 11:23:36.749467 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 11:23:36.749467 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 11:23:36.749467 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:23:36.749467 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 621/1244] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Aug 24 11:23:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:23:36.755256 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccbca5e-1196-419a-a9ff-f9c8199d632a None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:23:36.886335 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccbca5e-1196-419a-a9ff-f9c8199d632a None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:23:36.925598 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233deaf3-1c72-47dc-97fa-40bc06be6e4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:23:36.926145 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233deaf3-1c72-47dc-97fa-40bc06be6e4c None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:23:36.926449 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233deaf3-1c72-47dc-97fa-40bc06be6e4c None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:23:36.926721 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233deaf3-1c72-47dc-97fa-40bc06be6e4c None admin] PATH_INFO: `/v3/projects` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:23:36.927510 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233deaf3-1c72-47dc-97fa-40bc06be6e4c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:23:36.927855 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233deaf3-1c72-47dc-97fa-40bc06be6e4c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:23:36.929438 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233deaf3-1c72-47dc-97fa-40bc06be6e4c None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:23:36.942793 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 624/1245] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Aug 24 11:23:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:23:36.949398 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86e0968-bfa4-4f39-a3d2-5cc3193c4fa1 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:23:37.053328 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86e0968-bfa4-4f39-a3d2-5cc3193c4fa1 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:23:37.087507 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ab0a59-d63b-4281-a3cc-e864530134ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:23:37.089182 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ab0a59-d63b-4281-a3cc-e864530134ee None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:23:37.089467 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ab0a59-d63b-4281-a3cc-e864530134ee None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:23:37.089720 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ab0a59-d63b-4281-a3cc-e864530134ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:23:37.090514 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ab0a59-d63b-4281-a3cc-e864530134ee None admin] RBAC: Adding query filter params (role.id=217baac59e08499ea2f1b1d84935df0b, scope.project.id=317f54a463cb48ab86648c6dcec5db0f, user.id=ad45431e70ff48a9b90905a97d473d81) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:23:37.090819 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ab0a59-d63b-4281-a3cc-e864530134ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:23:37.092285 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ab0a59-d63b-4281-a3cc-e864530134ee None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:23:37.098319 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 622/1246] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Aug 24 11:23:36 2022] GET /identity/v3/role_assignments?user.id=ad45431e70ff48a9b90905a97d473d81&scope.project.id=317f54a463cb48ab86648c6dcec5db0f&role.id=217baac59e08499ea2f1b1d84935df0b => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:23:39.405001 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c92fee4-380f-42a6-828c-4dd7c9b9c269 None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:23:39.405543 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c92fee4-380f-42a6-828c-4dd7c9b9c269 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:23:39.405543 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c92fee4-380f-42a6-828c-4dd7c9b9c269 None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:23:39.406915 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 625/1247] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:23:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:23:39.413263 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f2144d-dcd2-4364-a81e-e38ea6eff638 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:23:39.413670 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f2144d-dcd2-4364-a81e-e38ea6eff638 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:23:39.413805 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f2144d-dcd2-4364-a81e-e38ea6eff638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:23:39.420920 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:23:39.434448 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-c1f2144d-dcd2-4364-a81e-e38ea6eff638 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:23:39.435645 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-c1f2144d-dcd2-4364-a81e-e38ea6eff638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:23:39.512189 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 623/1248] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:23:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 11:23:39.786115 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c92fee4-380f-42a6-828c-4dd7c9b9c269 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:23:39.804933 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:23:39.904715 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c92fee4-380f-42a6-828c-4dd7c9b9c269 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:23:39.946652 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354ed972-ffd8-45a8-a7a2-82f2f01da40b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:23:39.947400 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354ed972-ffd8-45a8-a7a2-82f2f01da40b None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:23:39.947674 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354ed972-ffd8-45a8-a7a2-82f2f01da40b None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:23:39.948118 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354ed972-ffd8-45a8-a7a2-82f2f01da40b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:23:39.960172 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354ed972-ffd8-45a8-a7a2-82f2f01da40b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:23:39.965174 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-354ed972-ffd8-45a8-a7a2-82f2f01da40b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 11:23:39.965174 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:23:39.965174 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:23:39.965174 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:23:39.965174 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:23:39.965174 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:23:39.965174 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:23:39.965174 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:23:39.965174 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:23:39.965174 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:23:39.965174 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:23:39.965174 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:23:39.965174 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:23:39.965174 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:23:39.965174 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:23:39.965174 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:23:39.966320 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:23:39.966320 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:23:39.966320 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:23:39.966320 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:23:39.966320 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:23:39.966320 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:23:39.966320 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:23:39.966320 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:23:39.966320 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:23:39.966320 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:23:39.966320 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:23:39.966320 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Aug 24 11:23:39.966320 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:23:39.966320 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:23:39.966320 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:23:39.966320 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:23:39.967333 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:23:39.967333 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:23:39.967333 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:23:39.967333 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:23:39.967333 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:23:39.967333 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:23:39.967333 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:23:39.967333 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:23:39.967333 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:23:39.967333 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:23:39.967333 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 11:23:39.967333 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Aug 24 11:23:39.967333 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 626/1249] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Aug 24 11:23:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:23:39.972889 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f2144d-dcd2-4364-a81e-e38ea6eff638 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:23:40.089981 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f2144d-dcd2-4364-a81e-e38ea6eff638 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:23:40.130294 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:23:40.136950 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1d3c55-5cfe-45f9-868d-665e25d3bd13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:23:40.137781 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1d3c55-5cfe-45f9-868d-665e25d3bd13 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:23:40.138124 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1d3c55-5cfe-45f9-868d-665e25d3bd13 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:23:40.138523 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1d3c55-5cfe-45f9-868d-665e25d3bd13 None admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:23:40.139299 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1d3c55-5cfe-45f9-868d-665e25d3bd13 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:23:40.139653 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1d3c55-5cfe-45f9-868d-665e25d3bd13 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:23:40.141255 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1d3c55-5cfe-45f9-868d-665e25d3bd13 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:23:40.151820 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 624/1250] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 24 11:23:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:23:40.157912 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354ed972-ffd8-45a8-a7a2-82f2f01da40b None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:23:40.246154 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:23:40.274211 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354ed972-ffd8-45a8-a7a2-82f2f01da40b None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:23:40.312582 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe2269f-f101-43c1-8373-2061c7f51720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:23:40.313225 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe2269f-f101-43c1-8373-2061c7f51720 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:23:40.313539 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe2269f-f101-43c1-8373-2061c7f51720 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:23:40.313788 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe2269f-f101-43c1-8373-2061c7f51720 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:23:40.325499 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe2269f-f101-43c1-8373-2061c7f51720 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:23:40.327156 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe2269f-f101-43c1-8373-2061c7f51720 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:23:40.344775 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-afe2269f-f101-43c1-8373-2061c7f51720 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:23:40.344775 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:23:40.344775 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:23:40.344775 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:23:40.344775 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:23:40.344775 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:23:40.344775 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:23:40.344775 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:23:40.344775 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:23:40.344775 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:23:40.344775 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:23:40.344775 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:23:40.344775 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 11:23:40.344775 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 11:23:40.344775 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 11:23:40.344775 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 11:23:40.346102 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:23:40.346102 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:23:40.346102 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:23:40.346102 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:23:40.346102 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:23:40.346102 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:23:40.346102 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:23:40.346102 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Aug 24 11:23:40.346102 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:23:40.346102 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:23:40.346102 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:23:40.346102 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:23:40.346102 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:23:40.346102 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:23:40.346102 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:23:40.346102 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:23:40.346102 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 11:23:40.347172 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 11:23:40.347172 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:23:40.347172 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Aug 24 11:23:40.347172 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 627/1251] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 11:23:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:23:40.352337 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1d3c55-5cfe-45f9-868d-665e25d3bd13 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:23:40.469507 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1d3c55-5cfe-45f9-868d-665e25d3bd13 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:23:40.507385 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792bce90-4491-47d0-8bd4-fbde8e70af89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:23:40.508015 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792bce90-4491-47d0-8bd4-fbde8e70af89 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:23:40.508292 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792bce90-4491-47d0-8bd4-fbde8e70af89 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:23:40.508561 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792bce90-4491-47d0-8bd4-fbde8e70af89 None admin] PATH_INFO: `/v3/domains` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:23:40.509224 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792bce90-4491-47d0-8bd4-fbde8e70af89 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:23:40.509525 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792bce90-4491-47d0-8bd4-fbde8e70af89 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:23:40.511106 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792bce90-4491-47d0-8bd4-fbde8e70af89 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:23:40.525386 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 625/1252] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 24 11:23:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:23:40.531321 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe2269f-f101-43c1-8373-2061c7f51720 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:23:40.640465 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe2269f-f101-43c1-8373-2061c7f51720 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:23:40.670859 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:23:40.680370 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85343d35-8f90-49bc-a5d9-e0ae93aace6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:23:40.681022 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85343d35-8f90-49bc-a5d9-e0ae93aace6b None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:23:40.681297 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85343d35-8f90-49bc-a5d9-e0ae93aace6b None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:23:40.681564 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85343d35-8f90-49bc-a5d9-e0ae93aace6b None admin] PATH_INFO: `/v3/users/placement` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:23:40.689914 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85343d35-8f90-49bc-a5d9-e0ae93aace6b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:23:40.691846 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85343d35-8f90-49bc-a5d9-e0ae93aace6b None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:23:40.704966 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-85343d35-8f90-49bc-a5d9-e0ae93aace6b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 11:23:40.704966 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:23:40.704966 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:23:40.704966 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:23:40.704966 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:23:40.704966 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:23:40.704966 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:23:40.704966 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:23:40.704966 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:23:40.704966 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:23:40.704966 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:23:40.704966 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:23:40.704966 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 11:23:40.704966 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 11:23:40.704966 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 11:23:40.704966 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 11:23:40.705947 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:23:40.705947 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:23:40.705947 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 11:23:40.705947 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 11:23:40.705947 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 11:23:40.705947 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 11:23:40.705947 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:23:40.705947 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:23:40.705947 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:23:40.705947 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:23:40.705947 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:23:40.705947 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Aug 24 11:23:40.705947 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:23:40.705947 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:23:40.705947 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:23:40.705947 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:23:40.705947 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:23:40.705947 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:23:40.707558 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:23:40.707558 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:23:40.707558 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 11:23:40.707558 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 11:23:40.707558 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 11:23:40.707558 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 11:23:40.707558 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 11:23:40.707558 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 11:23:40.707558 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 11:23:40.707558 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Aug 24 11:23:40.707558 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 628/1253] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 11:23:40 2022] GET /identity/v3/users/placement => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 11:23:40.712384 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792bce90-4491-47d0-8bd4-fbde8e70af89 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:23:40.778223 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:23:40.839649 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792bce90-4491-47d0-8bd4-fbde8e70af89 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:23:40.889750 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702f1a08-9825-47a0-b345-6d8985818d07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:23:40.890407 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702f1a08-9825-47a0-b345-6d8985818d07 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:23:40.890812 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702f1a08-9825-47a0-b345-6d8985818d07 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:23:40.891154 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702f1a08-9825-47a0-b345-6d8985818d07 None admin] PATH_INFO: `/v3/users` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:23:40.892177 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702f1a08-9825-47a0-b345-6d8985818d07 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:23:40.892664 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702f1a08-9825-47a0-b345-6d8985818d07 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:23:40.894786 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702f1a08-9825-47a0-b345-6d8985818d07 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:23:40.915337 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 626/1254] 10.222.0.27 () {56 vars in 1143 bytes} [Wed Aug 24 11:23:40 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:23:40.921997 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85343d35-8f90-49bc-a5d9-e0ae93aace6b None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:23:41.041101 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85343d35-8f90-49bc-a5d9-e0ae93aace6b None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:23:41.077687 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdd4f78-c623-48cc-8ff7-e58f9dce10d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:23:41.078586 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdd4f78-c623-48cc-8ff7-e58f9dce10d6 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:23:41.078863 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdd4f78-c623-48cc-8ff7-e58f9dce10d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:23:41.079130 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdd4f78-c623-48cc-8ff7-e58f9dce10d6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:23:41.142448 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:23:41.158864 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdd4f78-c623-48cc-8ff7-e58f9dce10d6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:23:41.160948 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdd4f78-c623-48cc-8ff7-e58f9dce10d6 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:23:41.272041 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 629/1255] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 24 11:23:40 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 11:23:41.278440 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702f1a08-9825-47a0-b345-6d8985818d07 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:23:41.383956 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702f1a08-9825-47a0-b345-6d8985818d07 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:23:41.401939 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:23:41.426690 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6cb62e-f142-4fb2-9e0d-ff0361f3eef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:23:41.427381 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6cb62e-f142-4fb2-9e0d-ff0361f3eef7 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:23:41.427661 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6cb62e-f142-4fb2-9e0d-ff0361f3eef7 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:23:41.428030 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6cb62e-f142-4fb2-9e0d-ff0361f3eef7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:23:41.440399 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6cb62e-f142-4fb2-9e0d-ff0361f3eef7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:23:41.441858 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6cb62e-f142-4fb2-9e0d-ff0361f3eef7 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:23:41.459030 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-ed6cb62e-f142-4fb2-9e0d-ff0361f3eef7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:23:41.459030 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:23:41.459030 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:23:41.459030 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:23:41.459030 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:23:41.459030 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:23:41.459030 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:23:41.459030 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:23:41.459030 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:23:41.459030 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:23:41.459030 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:23:41.459030 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:23:41.459030 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 11:23:41.459030 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 11:23:41.459030 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 11:23:41.459030 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 11:23:41.460015 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:23:41.460015 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:23:41.460015 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:23:41.460015 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:23:41.460015 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:23:41.460015 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:23:41.460015 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:23:41.460015 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Aug 24 11:23:41.460015 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:23:41.460015 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:23:41.460015 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:23:41.460015 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:23:41.460015 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:23:41.460015 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:23:41.460015 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:23:41.460015 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:23:41.460015 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 11:23:41.461045 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 11:23:41.461045 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:23:41.461045 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:23:41.461045 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 627/1256] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 11:23:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:23:41.466508 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdd4f78-c623-48cc-8ff7-e58f9dce10d6 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:23:41.576085 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:23:41.590092 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdd4f78-c623-48cc-8ff7-e58f9dce10d6 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:23:41.631274 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f61b10-1c2a-404c-b601-4581039d2faa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:23:41.631989 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f61b10-1c2a-404c-b601-4581039d2faa None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:23:41.632294 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f61b10-1c2a-404c-b601-4581039d2faa None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:23:41.632566 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f61b10-1c2a-404c-b601-4581039d2faa None admin] PATH_INFO: `/v3/domains` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:23:41.633226 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f61b10-1c2a-404c-b601-4581039d2faa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:23:41.633532 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f61b10-1c2a-404c-b601-4581039d2faa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:23:41.635015 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f61b10-1c2a-404c-b601-4581039d2faa None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:23:41.646993 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 630/1257] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 24 11:23:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:23:41.653459 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6cb62e-f142-4fb2-9e0d-ff0361f3eef7 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:23:41.759959 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6cb62e-f142-4fb2-9e0d-ff0361f3eef7 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:23:41.801109 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f23fe3e-0dc5-4cbb-ae4e-75c94f25d7f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:23:41.801750 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f23fe3e-0dc5-4cbb-ae4e-75c94f25d7f8 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:23:41.802037 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f23fe3e-0dc5-4cbb-ae4e-75c94f25d7f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:23:41.802303 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f23fe3e-0dc5-4cbb-ae4e-75c94f25d7f8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:23:41.809231 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f23fe3e-0dc5-4cbb-ae4e-75c94f25d7f8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:23:41.810740 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f23fe3e-0dc5-4cbb-ae4e-75c94f25d7f8 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:23:41.823050 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-9f23fe3e-0dc5-4cbb-ae4e-75c94f25d7f8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 11:23:41.823050 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:23:41.823050 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:23:41.823050 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:23:41.823050 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:23:41.823050 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:23:41.823050 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:23:41.823050 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:23:41.823050 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:23:41.823050 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:23:41.823050 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:23:41.823050 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:23:41.823050 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 11:23:41.823050 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 11:23:41.823050 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 11:23:41.824064 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 11:23:41.824064 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:23:41.824064 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:23:41.824064 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:23:41.824064 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:23:41.824064 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:23:41.824064 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:23:41.824064 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:23:41.824064 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Aug 24 11:23:41.824064 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:23:41.824064 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:23:41.824064 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:23:41.824064 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:23:41.824064 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:23:41.824064 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:23:41.824064 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:23:41.824064 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:23:41.825240 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 11:23:41.825240 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 11:23:41.825240 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 11:23:41.825240 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 11:23:41.825240 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 11:23:41.825240 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 11:23:41.825240 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 11:23:41.825240 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:23:41.825240 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 628/1258] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Aug 24 11:23:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:23:41.830459 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f61b10-1c2a-404c-b601-4581039d2faa None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:23:41.933315 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f61b10-1c2a-404c-b601-4581039d2faa None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:23:41.967395 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52c95d9-8cf1-4b61-a0bf-fe7c98d3e7df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:23:41.968002 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52c95d9-8cf1-4b61-a0bf-fe7c98d3e7df None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:23:41.968275 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52c95d9-8cf1-4b61-a0bf-fe7c98d3e7df None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:23:41.968539 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52c95d9-8cf1-4b61-a0bf-fe7c98d3e7df None admin] PATH_INFO: `/v3/projects` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:23:41.969231 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52c95d9-8cf1-4b61-a0bf-fe7c98d3e7df None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:23:41.969525 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52c95d9-8cf1-4b61-a0bf-fe7c98d3e7df None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:23:41.971001 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52c95d9-8cf1-4b61-a0bf-fe7c98d3e7df None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:23:41.983965 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 631/1259] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Aug 24 11:23:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:23:41.990428 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f23fe3e-0dc5-4cbb-ae4e-75c94f25d7f8 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:23:42.020979 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:23:42.103853 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f23fe3e-0dc5-4cbb-ae4e-75c94f25d7f8 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:23:42.148593 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503ef8c4-1afa-4ece-8a93-24e9c7981c24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:23:42.149238 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503ef8c4-1afa-4ece-8a93-24e9c7981c24 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:23:42.149540 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503ef8c4-1afa-4ece-8a93-24e9c7981c24 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:23:42.149805 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503ef8c4-1afa-4ece-8a93-24e9c7981c24 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:23:42.150652 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503ef8c4-1afa-4ece-8a93-24e9c7981c24 None admin] RBAC: Adding query filter params (role.id=30bb1e97257f4ca5b90c88545777317b, scope.project.id=317f54a463cb48ab86648c6dcec5db0f, user.id=ad45431e70ff48a9b90905a97d473d81) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:23:42.150992 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503ef8c4-1afa-4ece-8a93-24e9c7981c24 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:23:42.152654 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503ef8c4-1afa-4ece-8a93-24e9c7981c24 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:23:42.159251 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 629/1260] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Aug 24 11:23:41 2022] GET /identity/v3/role_assignments?user.id=ad45431e70ff48a9b90905a97d473d81&scope.project.id=317f54a463cb48ab86648c6dcec5db0f&role.id=30bb1e97257f4ca5b90c88545777317b => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:23:44.157036 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a962f4-c35c-44c3-8eb6-8449aa70b6db None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:23:44.157590 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a962f4-c35c-44c3-8eb6-8449aa70b6db None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:23:44.157590 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a962f4-c35c-44c3-8eb6-8449aa70b6db None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:23:44.158952 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 632/1261] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:23:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:23:44.165079 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d209e0-60b1-48bd-b3fd-8026119fe3cb None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:23:44.165872 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d209e0-60b1-48bd-b3fd-8026119fe3cb None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:23:44.166001 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d209e0-60b1-48bd-b3fd-8026119fe3cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:23:44.191552 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-d9d209e0-60b1-48bd-b3fd-8026119fe3cb None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:23:44.192751 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-d9d209e0-60b1-48bd-b3fd-8026119fe3cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:23:44.267635 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 630/1262] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:23:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 11:23:44.528407 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a962f4-c35c-44c3-8eb6-8449aa70b6db None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:23:44.543640 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:23:44.652055 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a962f4-c35c-44c3-8eb6-8449aa70b6db None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:23:44.687022 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f655e7a-180a-4c18-bea3-5aa1347276a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:23:44.687649 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f655e7a-180a-4c18-bea3-5aa1347276a4 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:23:44.687936 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f655e7a-180a-4c18-bea3-5aa1347276a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:23:44.688188 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f655e7a-180a-4c18-bea3-5aa1347276a4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:23:44.699379 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f655e7a-180a-4c18-bea3-5aa1347276a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:23:44.704013 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-8f655e7a-180a-4c18-bea3-5aa1347276a4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 11:23:44.704013 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:23:44.704013 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:23:44.704013 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:23:44.704013 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:23:44.704013 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:23:44.704013 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:23:44.704013 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:23:44.704013 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:23:44.704013 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:23:44.704013 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:23:44.704013 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:23:44.704013 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:23:44.704013 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:23:44.704013 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:23:44.704013 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:23:44.705298 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:23:44.705298 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:23:44.705298 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:23:44.705298 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:23:44.705298 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:23:44.705298 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:23:44.705298 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:23:44.705298 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:23:44.705298 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:23:44.705298 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:23:44.705298 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:23:44.705298 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Aug 24 11:23:44.705298 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:23:44.705298 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:23:44.705298 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:23:44.705298 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:23:44.706179 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:23:44.706179 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:23:44.706179 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:23:44.706179 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:23:44.706179 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:23:44.706179 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:23:44.706179 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:23:44.706179 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:23:44.706179 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:23:44.706179 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:23:44.706179 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 11:23:44.706179 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Aug 24 11:23:44.706179 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 633/1263] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Aug 24 11:23:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:23:44.711733 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d209e0-60b1-48bd-b3fd-8026119fe3cb None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:23:44.731570 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:23:44.829118 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d209e0-60b1-48bd-b3fd-8026119fe3cb None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:23:44.864657 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5278519-f2f0-464f-9eed-0a31f3588082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:23:44.865248 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5278519-f2f0-464f-9eed-0a31f3588082 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:23:44.865525 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5278519-f2f0-464f-9eed-0a31f3588082 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:23:44.865796 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5278519-f2f0-464f-9eed-0a31f3588082 None admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:23:44.866527 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5278519-f2f0-464f-9eed-0a31f3588082 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:23:44.866857 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5278519-f2f0-464f-9eed-0a31f3588082 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:23:44.868309 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5278519-f2f0-464f-9eed-0a31f3588082 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:23:44.876526 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 631/1264] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 24 11:23:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:23:44.882554 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f655e7a-180a-4c18-bea3-5aa1347276a4 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:23:44.953819 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:23:44.988192 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f655e7a-180a-4c18-bea3-5aa1347276a4 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:23:45.026400 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9d2543-a260-480e-946c-a911892321ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:23:45.027307 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9d2543-a260-480e-946c-a911892321ca None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:23:45.027702 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9d2543-a260-480e-946c-a911892321ca None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:23:45.028020 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9d2543-a260-480e-946c-a911892321ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:23:45.043141 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9d2543-a260-480e-946c-a911892321ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:23:45.044607 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9d2543-a260-480e-946c-a911892321ca None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:23:45.059626 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-ee9d2543-a260-480e-946c-a911892321ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:23:45.059626 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:23:45.059626 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:23:45.059626 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:23:45.059626 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:23:45.059626 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:23:45.059626 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:23:45.059626 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:23:45.059626 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:23:45.059626 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:23:45.059626 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:23:45.059626 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:23:45.059626 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 11:23:45.059626 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 11:23:45.059626 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 11:23:45.059626 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 11:23:45.060673 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:23:45.060673 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:23:45.060673 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:23:45.060673 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:23:45.060673 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:23:45.060673 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:23:45.060673 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:23:45.060673 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Aug 24 11:23:45.060673 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:23:45.060673 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:23:45.060673 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:23:45.060673 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:23:45.060673 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:23:45.060673 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:23:45.060673 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:23:45.060673 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:23:45.060673 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 11:23:45.061648 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 11:23:45.061648 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:23:45.061648 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Aug 24 11:23:45.061648 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 634/1265] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 11:23:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:23:45.067441 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5278519-f2f0-464f-9eed-0a31f3588082 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:23:45.157162 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:23:45.188710 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5278519-f2f0-464f-9eed-0a31f3588082 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:23:45.237009 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caa1bcc-be4b-41d8-986c-78db01e55a8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:23:45.237629 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caa1bcc-be4b-41d8-986c-78db01e55a8d None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:23:45.237905 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caa1bcc-be4b-41d8-986c-78db01e55a8d None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:23:45.238181 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caa1bcc-be4b-41d8-986c-78db01e55a8d None admin] PATH_INFO: `/v3/domains` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:23:45.238881 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caa1bcc-be4b-41d8-986c-78db01e55a8d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:23:45.239176 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caa1bcc-be4b-41d8-986c-78db01e55a8d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:23:45.240591 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caa1bcc-be4b-41d8-986c-78db01e55a8d None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:23:45.252728 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 632/1266] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 24 11:23:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:23:45.259747 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9d2543-a260-480e-946c-a911892321ca None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:23:45.377984 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9d2543-a260-480e-946c-a911892321ca None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:23:45.401606 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:23:45.417537 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c6fe99-4579-4d76-b33b-53ec7be286a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:23:45.418157 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c6fe99-4579-4d76-b33b-53ec7be286a5 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:23:45.418490 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c6fe99-4579-4d76-b33b-53ec7be286a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:23:45.418745 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c6fe99-4579-4d76-b33b-53ec7be286a5 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:23:45.425999 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c6fe99-4579-4d76-b33b-53ec7be286a5 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:23:45.427501 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c6fe99-4579-4d76-b33b-53ec7be286a5 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:23:45.438948 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-44c6fe99-4579-4d76-b33b-53ec7be286a5 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 11:23:45.438948 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:23:45.438948 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:23:45.438948 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:23:45.438948 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:23:45.438948 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:23:45.438948 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:23:45.438948 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:23:45.438948 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:23:45.438948 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:23:45.438948 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:23:45.438948 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:23:45.438948 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 11:23:45.438948 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 11:23:45.438948 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 11:23:45.438948 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 11:23:45.440056 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:23:45.440056 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:23:45.440056 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 11:23:45.440056 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 11:23:45.440056 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 11:23:45.440056 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 11:23:45.440056 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:23:45.440056 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:23:45.440056 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:23:45.440056 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:23:45.440056 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:23:45.440056 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Aug 24 11:23:45.440056 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:23:45.440056 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:23:45.440056 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:23:45.440056 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:23:45.440056 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:23:45.440056 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:23:45.441230 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:23:45.441230 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:23:45.441230 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 11:23:45.441230 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 11:23:45.441230 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 11:23:45.441230 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 11:23:45.441230 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 11:23:45.441230 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 11:23:45.441230 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 11:23:45.441230 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Aug 24 11:23:45.442535 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 635/1267] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 11:23:45 2022] GET /identity/v3/users/placement => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:23:45.445900 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caa1bcc-be4b-41d8-986c-78db01e55a8d None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:23:45.556576 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caa1bcc-be4b-41d8-986c-78db01e55a8d None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:23:45.592820 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cbe7d0-c6ea-49bf-9080-2d109cb02ca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:23:45.593431 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cbe7d0-c6ea-49bf-9080-2d109cb02ca8 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:23:45.593711 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cbe7d0-c6ea-49bf-9080-2d109cb02ca8 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:23:45.593984 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cbe7d0-c6ea-49bf-9080-2d109cb02ca8 None admin] PATH_INFO: `/v3/users` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:23:45.594747 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cbe7d0-c6ea-49bf-9080-2d109cb02ca8 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:23:45.595053 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cbe7d0-c6ea-49bf-9080-2d109cb02ca8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:23:45.596512 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cbe7d0-c6ea-49bf-9080-2d109cb02ca8 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:23:45.605119 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:23:45.613728 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 633/1268] 10.222.0.27 () {56 vars in 1143 bytes} [Wed Aug 24 11:23:45 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:23:45.619706 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c6fe99-4579-4d76-b33b-53ec7be286a5 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:23:45.723388 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c6fe99-4579-4d76-b33b-53ec7be286a5 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:23:45.760879 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e599272-c1b7-48f8-99cd-3ced579ba654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:23:45.761498 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e599272-c1b7-48f8-99cd-3ced579ba654 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:23:45.761770 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e599272-c1b7-48f8-99cd-3ced579ba654 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:23:45.762044 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e599272-c1b7-48f8-99cd-3ced579ba654 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:23:45.774416 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e599272-c1b7-48f8-99cd-3ced579ba654 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:23:45.775899 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e599272-c1b7-48f8-99cd-3ced579ba654 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:23:45.791202 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-3e599272-c1b7-48f8-99cd-3ced579ba654 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:23:45.791202 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:23:45.791202 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:23:45.791202 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:23:45.791202 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:23:45.791202 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:23:45.791202 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:23:45.791202 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:23:45.791202 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:23:45.791202 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:23:45.791202 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:23:45.791202 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:23:45.791202 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 11:23:45.791202 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 11:23:45.791202 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 11:23:45.791202 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 11:23:45.792245 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:23:45.792245 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:23:45.792245 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:23:45.792245 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:23:45.792245 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:23:45.792245 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:23:45.792245 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:23:45.792245 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Aug 24 11:23:45.792245 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:23:45.792245 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:23:45.792245 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:23:45.792245 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:23:45.792245 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:23:45.792245 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:23:45.792245 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:23:45.792245 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:23:45.792245 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 11:23:45.793888 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 11:23:45.793888 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:23:45.793888 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Aug 24 11:23:45.793888 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 636/1269] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 11:23:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 11:23:45.801250 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cbe7d0-c6ea-49bf-9080-2d109cb02ca8 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:23:45.904985 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cbe7d0-c6ea-49bf-9080-2d109cb02ca8 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:23:45.940837 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff546c3-9735-4d11-b069-211d7e5e5e55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:23:45.941450 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff546c3-9735-4d11-b069-211d7e5e5e55 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:23:45.941722 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff546c3-9735-4d11-b069-211d7e5e5e55 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:23:45.941993 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff546c3-9735-4d11-b069-211d7e5e5e55 None admin] PATH_INFO: `/v3/domains` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:23:45.942667 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff546c3-9735-4d11-b069-211d7e5e5e55 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:23:45.942973 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff546c3-9735-4d11-b069-211d7e5e5e55 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:23:45.944376 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff546c3-9735-4d11-b069-211d7e5e5e55 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:23:45.955928 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 634/1270] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 24 11:23:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:23:45.961912 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e599272-c1b7-48f8-99cd-3ced579ba654 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:23:45.995469 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:23:46.071073 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e599272-c1b7-48f8-99cd-3ced579ba654 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:23:46.108101 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cd2944-a6e3-4cbd-ab64-db41939d8b32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:23:46.108738 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cd2944-a6e3-4cbd-ab64-db41939d8b32 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:23:46.109013 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cd2944-a6e3-4cbd-ab64-db41939d8b32 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:23:46.109276 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cd2944-a6e3-4cbd-ab64-db41939d8b32 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:23:46.116602 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cd2944-a6e3-4cbd-ab64-db41939d8b32 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:23:46.118208 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cd2944-a6e3-4cbd-ab64-db41939d8b32 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:23:46.129547 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-12cd2944-a6e3-4cbd-ab64-db41939d8b32 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 11:23:46.129547 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:23:46.129547 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:23:46.129547 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:23:46.129547 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:23:46.129547 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:23:46.129547 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:23:46.129547 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:23:46.129547 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:23:46.129547 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:23:46.129547 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:23:46.129547 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:23:46.129547 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 11:23:46.129547 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 11:23:46.129547 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 11:23:46.130691 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 11:23:46.130691 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:23:46.130691 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:23:46.130691 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:23:46.130691 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:23:46.130691 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:23:46.130691 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:23:46.130691 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:23:46.130691 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Aug 24 11:23:46.130691 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:23:46.130691 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:23:46.130691 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:23:46.130691 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:23:46.130691 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:23:46.130691 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:23:46.130691 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:23:46.130691 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:23:46.131813 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 11:23:46.131813 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 11:23:46.131813 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 11:23:46.131813 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 11:23:46.131813 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 11:23:46.131813 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 11:23:46.131813 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 11:23:46.131813 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Aug 24 11:23:46.131813 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 637/1271] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Aug 24 11:23:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:23:46.136700 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff546c3-9735-4d11-b069-211d7e5e5e55 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:23:46.198755 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:23:46.245702 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff546c3-9735-4d11-b069-211d7e5e5e55 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:23:46.287043 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056bf9bd-0b48-4671-ad47-1d1526359a7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:23:46.287652 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056bf9bd-0b48-4671-ad47-1d1526359a7d None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:23:46.287926 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056bf9bd-0b48-4671-ad47-1d1526359a7d None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:23:46.288197 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056bf9bd-0b48-4671-ad47-1d1526359a7d None admin] PATH_INFO: `/v3/projects` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:23:46.288891 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056bf9bd-0b48-4671-ad47-1d1526359a7d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:23:46.289197 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056bf9bd-0b48-4671-ad47-1d1526359a7d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:23:46.290690 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056bf9bd-0b48-4671-ad47-1d1526359a7d None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:23:46.302755 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 635/1272] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Aug 24 11:23:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:23:46.311045 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cd2944-a6e3-4cbd-ab64-db41939d8b32 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:23:46.414134 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:23:46.424097 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cd2944-a6e3-4cbd-ab64-db41939d8b32 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:23:46.459731 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6532485a-8556-4fc4-b950-ed983bb63d18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:23:46.460373 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6532485a-8556-4fc4-b950-ed983bb63d18 None admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:23:46.460664 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6532485a-8556-4fc4-b950-ed983bb63d18 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:23:46.460951 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6532485a-8556-4fc4-b950-ed983bb63d18 None admin] PATH_INFO: `/v3/projects/317f54a463cb48ab86648c6dcec5db0f/users/ad45431e70ff48a9b90905a97d473d81/roles/30bb1e97257f4ca5b90c88545777317b` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:23:46.463082 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6532485a-8556-4fc4-b950-ed983bb63d18 None admin] RBAC: Authorizing `identity:create_grant(project_id=317f54a463cb48ab86648c6dcec5db0f, user_id=ad45431e70ff48a9b90905a97d473d81, role_id=30bb1e97257f4ca5b90c88545777317b)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:23:46.464666 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6532485a-8556-4fc4-b950-ed983bb63d18 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:23:46.480857 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 638/1273] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Aug 24 11:23:46 2022] PUT /identity/v3/projects/317f54a463cb48ab86648c6dcec5db0f/users/ad45431e70ff48a9b90905a97d473d81/roles/30bb1e97257f4ca5b90c88545777317b => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:23:48.388006 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db729c1c-9e7a-4f71-a4bf-7429807a2fbb None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:23:48.388822 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db729c1c-9e7a-4f71-a4bf-7429807a2fbb None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:23:48.388822 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db729c1c-9e7a-4f71-a4bf-7429807a2fbb None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:23:48.390941 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 636/1274] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:23:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:23:48.397779 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121903a4-fa4d-4bfa-9777-0f7f4a1e827a None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:23:48.398433 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121903a4-fa4d-4bfa-9777-0f7f4a1e827a None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:23:48.398530 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121903a4-fa4d-4bfa-9777-0f7f4a1e827a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:23:48.423719 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-121903a4-fa4d-4bfa-9777-0f7f4a1e827a None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:23:48.425581 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-121903a4-fa4d-4bfa-9777-0f7f4a1e827a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:23:48.503005 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 639/1275] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:23:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 11:23:48.777860 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db729c1c-9e7a-4f71-a4bf-7429807a2fbb None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:23:48.892224 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db729c1c-9e7a-4f71-a4bf-7429807a2fbb None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:23:48.910002 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:23:48.928590 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9288a22-af31-496f-be77-547cebc790c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:23:48.929212 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9288a22-af31-496f-be77-547cebc790c9 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:23:48.929488 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9288a22-af31-496f-be77-547cebc790c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:23:48.929758 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9288a22-af31-496f-be77-547cebc790c9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:23:48.942173 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9288a22-af31-496f-be77-547cebc790c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:23:48.948562 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-b9288a22-af31-496f-be77-547cebc790c9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 11:23:48.948562 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:23:48.948562 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:23:48.948562 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:23:48.948562 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:23:48.948562 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:23:48.948562 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:23:48.948562 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:23:48.948562 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:23:48.948562 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:23:48.948562 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:23:48.948562 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:23:48.948562 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:23:48.948562 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:23:48.948562 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:23:48.948562 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:23:48.949635 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:23:48.949635 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:23:48.949635 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:23:48.949635 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:23:48.949635 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:23:48.949635 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:23:48.949635 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:23:48.949635 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:23:48.949635 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:23:48.949635 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:23:48.949635 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:23:48.949635 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Aug 24 11:23:48.949635 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:23:48.949635 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:23:48.949635 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:23:48.949635 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:23:48.950687 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:23:48.950687 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:23:48.950687 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:23:48.950687 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:23:48.950687 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:23:48.950687 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:23:48.950687 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:23:48.950687 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:23:48.950687 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:23:48.950687 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:23:48.950687 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 11:23:48.950687 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:23:48.950687 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 637/1276] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Aug 24 11:23:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:23:48.956013 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121903a4-fa4d-4bfa-9777-0f7f4a1e827a None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:23:49.043648 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:23:49.063509 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121903a4-fa4d-4bfa-9777-0f7f4a1e827a None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:23:49.098451 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f155cc67-f2db-44c8-b45f-03dedb3487e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:23:49.099045 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f155cc67-f2db-44c8-b45f-03dedb3487e7 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:23:49.099327 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f155cc67-f2db-44c8-b45f-03dedb3487e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:23:49.099597 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f155cc67-f2db-44c8-b45f-03dedb3487e7 None admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:23:49.100270 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f155cc67-f2db-44c8-b45f-03dedb3487e7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:23:49.100571 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f155cc67-f2db-44c8-b45f-03dedb3487e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:23:49.102015 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f155cc67-f2db-44c8-b45f-03dedb3487e7 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:23:49.110591 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 640/1277] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 24 11:23:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:23:49.117093 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9288a22-af31-496f-be77-547cebc790c9 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:23:49.225573 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9288a22-af31-496f-be77-547cebc790c9 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:23:49.268540 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd77eb2d-cbf9-4732-a2b8-44685ac62e9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:23:49.269401 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd77eb2d-cbf9-4732-a2b8-44685ac62e9d None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:23:49.269792 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd77eb2d-cbf9-4732-a2b8-44685ac62e9d None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:23:49.270114 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd77eb2d-cbf9-4732-a2b8-44685ac62e9d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:23:49.283578 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd77eb2d-cbf9-4732-a2b8-44685ac62e9d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:23:49.285090 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd77eb2d-cbf9-4732-a2b8-44685ac62e9d None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:23:49.300574 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-bd77eb2d-cbf9-4732-a2b8-44685ac62e9d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:23:49.300574 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:23:49.300574 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:23:49.300574 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:23:49.300574 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:23:49.300574 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:23:49.300574 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:23:49.300574 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:23:49.300574 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:23:49.300574 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:23:49.300574 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:23:49.300574 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:23:49.300574 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 11:23:49.300574 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 11:23:49.300574 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 11:23:49.300574 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 11:23:49.301699 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:23:49.301699 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:23:49.301699 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:23:49.301699 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:23:49.301699 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:23:49.301699 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:23:49.301699 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:23:49.301699 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Aug 24 11:23:49.301699 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:23:49.301699 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:23:49.301699 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:23:49.301699 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:23:49.301699 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:23:49.301699 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:23:49.301699 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:23:49.301699 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:23:49.301699 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 11:23:49.302810 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 11:23:49.302810 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:23:49.302810 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:23:49.302810 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 638/1278] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 11:23:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:23:49.307952 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f155cc67-f2db-44c8-b45f-03dedb3487e7 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:23:49.429022 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f155cc67-f2db-44c8-b45f-03dedb3487e7 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:23:49.463658 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b486002d-b931-4ed8-b3cc-aef500066416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:23:49.464249 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b486002d-b931-4ed8-b3cc-aef500066416 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:23:49.464494 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b486002d-b931-4ed8-b3cc-aef500066416 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:23:49.464791 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b486002d-b931-4ed8-b3cc-aef500066416 None admin] PATH_INFO: `/v3/domains` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:23:49.465422 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b486002d-b931-4ed8-b3cc-aef500066416 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:23:49.465726 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b486002d-b931-4ed8-b3cc-aef500066416 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:23:49.467127 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b486002d-b931-4ed8-b3cc-aef500066416 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:23:49.479100 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 641/1279] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 24 11:23:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:23:49.488641 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd77eb2d-cbf9-4732-a2b8-44685ac62e9d None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:23:49.523081 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:23:49.606848 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd77eb2d-cbf9-4732-a2b8-44685ac62e9d None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:23:49.643359 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29e144d-668d-409d-977b-2bfade3f5381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:23:49.644007 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29e144d-668d-409d-977b-2bfade3f5381 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:23:49.644284 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29e144d-668d-409d-977b-2bfade3f5381 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:23:49.644557 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29e144d-668d-409d-977b-2bfade3f5381 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:23:49.652875 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29e144d-668d-409d-977b-2bfade3f5381 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:23:49.654392 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29e144d-668d-409d-977b-2bfade3f5381 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:23:49.666039 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-c29e144d-668d-409d-977b-2bfade3f5381 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 11:23:49.666039 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:23:49.666039 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:23:49.666039 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:23:49.666039 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:23:49.666039 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:23:49.666039 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:23:49.666039 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:23:49.666039 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:23:49.666039 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:23:49.666039 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:23:49.666039 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:23:49.666039 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 11:23:49.666039 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 11:23:49.666039 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 11:23:49.666039 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 11:23:49.667099 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:23:49.667099 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:23:49.667099 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 11:23:49.667099 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 11:23:49.667099 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 11:23:49.667099 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 11:23:49.667099 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:23:49.667099 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:23:49.667099 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:23:49.667099 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:23:49.667099 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:23:49.667099 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Aug 24 11:23:49.667099 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:23:49.667099 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:23:49.667099 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:23:49.667099 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:23:49.667099 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:23:49.667099 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:23:49.668232 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:23:49.668232 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:23:49.668232 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 11:23:49.668232 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 11:23:49.668232 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 11:23:49.668232 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 11:23:49.668232 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 11:23:49.668232 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 11:23:49.668232 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 11:23:49.668232 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:23:49.668232 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 639/1280] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 11:23:49 2022] GET /identity/v3/users/placement => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:23:49.675374 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b486002d-b931-4ed8-b3cc-aef500066416 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:23:49.679556 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:23:49.786382 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b486002d-b931-4ed8-b3cc-aef500066416 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:23:49.821485 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e294b7-4f34-4986-a825-5e0aca5a9097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:23:49.822076 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e294b7-4f34-4986-a825-5e0aca5a9097 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:23:49.822337 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e294b7-4f34-4986-a825-5e0aca5a9097 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:23:49.822653 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e294b7-4f34-4986-a825-5e0aca5a9097 None admin] PATH_INFO: `/v3/users` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:23:49.823385 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e294b7-4f34-4986-a825-5e0aca5a9097 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:23:49.823678 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e294b7-4f34-4986-a825-5e0aca5a9097 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:23:49.825125 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e294b7-4f34-4986-a825-5e0aca5a9097 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:23:49.842211 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 642/1281] 10.222.0.27 () {56 vars in 1143 bytes} [Wed Aug 24 11:23:49 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:23:49.848883 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29e144d-668d-409d-977b-2bfade3f5381 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:23:49.962653 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:23:49.979179 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29e144d-668d-409d-977b-2bfade3f5381 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:23:50.018855 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46686343-261e-4622-bb78-70c24e145800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:23:50.019460 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46686343-261e-4622-bb78-70c24e145800 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:23:50.019733 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46686343-261e-4622-bb78-70c24e145800 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:23:50.020003 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46686343-261e-4622-bb78-70c24e145800 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:23:50.093216 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46686343-261e-4622-bb78-70c24e145800 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:23:50.094706 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46686343-261e-4622-bb78-70c24e145800 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:23:50.189485 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:23:50.200836 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 640/1282] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 24 11:23:49 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 11:23:50.207039 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e294b7-4f34-4986-a825-5e0aca5a9097 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:23:50.271673 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:23:50.312428 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e294b7-4f34-4986-a825-5e0aca5a9097 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:23:50.347773 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caecfb14-8873-473f-81a9-4ea71441612d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:23:50.348387 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caecfb14-8873-473f-81a9-4ea71441612d None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:23:50.348663 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caecfb14-8873-473f-81a9-4ea71441612d None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:23:50.348931 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caecfb14-8873-473f-81a9-4ea71441612d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:23:50.359421 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caecfb14-8873-473f-81a9-4ea71441612d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:23:50.360885 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caecfb14-8873-473f-81a9-4ea71441612d None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:23:50.375728 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-caecfb14-8873-473f-81a9-4ea71441612d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:23:50.375728 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:23:50.375728 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:23:50.375728 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:23:50.375728 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:23:50.375728 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:23:50.375728 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:23:50.375728 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:23:50.375728 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:23:50.375728 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:23:50.375728 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:23:50.375728 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:23:50.375728 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 11:23:50.375728 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 11:23:50.375728 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 11:23:50.375728 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 11:23:50.376846 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:23:50.376846 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:23:50.376846 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:23:50.376846 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:23:50.376846 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:23:50.376846 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:23:50.376846 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:23:50.376846 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Aug 24 11:23:50.376846 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:23:50.376846 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:23:50.376846 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:23:50.376846 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:23:50.376846 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:23:50.376846 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:23:50.376846 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:23:50.376846 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:23:50.376846 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 11:23:50.377781 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 11:23:50.377781 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:23:50.377781 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Aug 24 11:23:50.377781 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 643/1283] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 11:23:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:23:50.382768 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46686343-261e-4622-bb78-70c24e145800 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:23:50.491682 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46686343-261e-4622-bb78-70c24e145800 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:23:50.546932 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0fab3d-a62f-491a-850c-a7ee24cec5a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:23:50.547701 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0fab3d-a62f-491a-850c-a7ee24cec5a3 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:23:50.548041 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0fab3d-a62f-491a-850c-a7ee24cec5a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:23:50.548382 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0fab3d-a62f-491a-850c-a7ee24cec5a3 None admin] PATH_INFO: `/v3/domains` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:23:50.549086 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0fab3d-a62f-491a-850c-a7ee24cec5a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:23:50.549441 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0fab3d-a62f-491a-850c-a7ee24cec5a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:23:50.551130 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0fab3d-a62f-491a-850c-a7ee24cec5a3 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:23:50.565680 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 641/1284] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 24 11:23:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:23:50.572644 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caecfb14-8873-473f-81a9-4ea71441612d None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:23:50.687824 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caecfb14-8873-473f-81a9-4ea71441612d None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:23:50.701922 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:23:50.725137 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ac233c-e106-412e-a43a-82bf382501d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:23:50.725749 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ac233c-e106-412e-a43a-82bf382501d6 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:23:50.726029 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ac233c-e106-412e-a43a-82bf382501d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:23:50.726298 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ac233c-e106-412e-a43a-82bf382501d6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:23:50.733760 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ac233c-e106-412e-a43a-82bf382501d6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:23:50.735356 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ac233c-e106-412e-a43a-82bf382501d6 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:23:50.747588 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-98ac233c-e106-412e-a43a-82bf382501d6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 11:23:50.747588 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:23:50.747588 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:23:50.747588 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:23:50.747588 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:23:50.747588 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:23:50.747588 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:23:50.747588 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:23:50.747588 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:23:50.747588 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:23:50.747588 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:23:50.747588 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:23:50.747588 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 11:23:50.747588 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 11:23:50.747588 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 11:23:50.748723 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 11:23:50.748723 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:23:50.748723 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:23:50.748723 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:23:50.748723 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:23:50.748723 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:23:50.748723 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:23:50.748723 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:23:50.748723 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Aug 24 11:23:50.748723 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:23:50.748723 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:23:50.748723 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:23:50.748723 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:23:50.748723 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:23:50.748723 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:23:50.748723 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:23:50.748723 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:23:50.750003 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 11:23:50.750003 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 11:23:50.750003 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 11:23:50.750003 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 11:23:50.750003 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 11:23:50.750003 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 11:23:50.750003 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 11:23:50.750003 dv-cinder-848899-3-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Aug 24 11:23:50.750003 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 644/1285] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Aug 24 11:23:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:23:50.755045 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0fab3d-a62f-491a-850c-a7ee24cec5a3 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:23:50.826250 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:23:50.884817 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0fab3d-a62f-491a-850c-a7ee24cec5a3 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:23:50.923374 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4459c59-e029-4368-95e6-58369f53c4d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:23:50.923968 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4459c59-e029-4368-95e6-58369f53c4d3 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:23:50.924237 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4459c59-e029-4368-95e6-58369f53c4d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:23:50.924505 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4459c59-e029-4368-95e6-58369f53c4d3 None admin] PATH_INFO: `/v3/projects` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:23:50.925188 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4459c59-e029-4368-95e6-58369f53c4d3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:23:50.925487 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4459c59-e029-4368-95e6-58369f53c4d3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:23:50.926977 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4459c59-e029-4368-95e6-58369f53c4d3 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:23:50.940794 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 642/1286] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Aug 24 11:23:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:23:50.947315 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ac233c-e106-412e-a43a-82bf382501d6 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:23:51.058713 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ac233c-e106-412e-a43a-82bf382501d6 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:23:51.095427 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15488046-520a-420e-95e3-94d13208f09a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:23:51.096213 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15488046-520a-420e-95e3-94d13208f09a None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:23:51.096570 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15488046-520a-420e-95e3-94d13208f09a None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:23:51.096836 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15488046-520a-420e-95e3-94d13208f09a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:23:51.097946 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15488046-520a-420e-95e3-94d13208f09a None admin] RBAC: Adding query filter params (role.id=30bb1e97257f4ca5b90c88545777317b, scope.project.id=317f54a463cb48ab86648c6dcec5db0f, user.id=ad45431e70ff48a9b90905a97d473d81) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:23:51.098394 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15488046-520a-420e-95e3-94d13208f09a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:23:51.100098 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15488046-520a-420e-95e3-94d13208f09a None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:23:51.107052 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 645/1287] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Aug 24 11:23:50 2022] GET /identity/v3/role_assignments?user.id=ad45431e70ff48a9b90905a97d473d81&scope.project.id=317f54a463cb48ab86648c6dcec5db0f&role.id=30bb1e97257f4ca5b90c88545777317b => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:23:53.037887 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf254d0-7181-4f4a-b044-17669c1d49bf None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:23:53.038515 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf254d0-7181-4f4a-b044-17669c1d49bf None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:23:53.038515 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf254d0-7181-4f4a-b044-17669c1d49bf None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:23:53.039827 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 643/1288] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:23:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:23:53.046147 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c28dda8-1bea-437a-856d-e9fceefcdd09 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:23:53.046947 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c28dda8-1bea-437a-856d-e9fceefcdd09 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:23:53.047093 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c28dda8-1bea-437a-856d-e9fceefcdd09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:23:53.070856 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-9c28dda8-1bea-437a-856d-e9fceefcdd09 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:23:53.072069 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-9c28dda8-1bea-437a-856d-e9fceefcdd09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:23:53.104614 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:23:53.143610 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 646/1289] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:23:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 11:23:53.407513 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf254d0-7181-4f4a-b044-17669c1d49bf None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:23:53.516105 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf254d0-7181-4f4a-b044-17669c1d49bf None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:23:53.530861 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:23:53.562310 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4967bd-2e80-4020-9bb3-499eb198c08b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:23:53.563151 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4967bd-2e80-4020-9bb3-499eb198c08b None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:23:53.563497 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4967bd-2e80-4020-9bb3-499eb198c08b None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:23:53.563807 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4967bd-2e80-4020-9bb3-499eb198c08b None admin] PATH_INFO: `/v3/services/placement` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:23:53.564534 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4967bd-2e80-4020-9bb3-499eb198c08b None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:23:53.566241 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4967bd-2e80-4020-9bb3-499eb198c08b None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:23:53.577841 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-cd4967bd-2e80-4020-9bb3-499eb198c08b None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 11:23:53.577841 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:23:53.577841 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 11:23:53.577841 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 11:23:53.577841 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 11:23:53.577841 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 11:23:53.577841 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 11:23:53.577841 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 11:23:53.577841 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 11:23:53.577841 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:23:53.577841 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 11:23:53.577841 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:23:53.577841 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:23:53.577841 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:23:53.577841 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:23:53.577841 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:23:53.577841 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:23:53.579425 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:23:53.579425 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:23:53.579425 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:23:53.579425 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:23:53.579425 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:23:53.579425 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:23:53.579425 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 11:23:53.579425 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 11:23:53.579425 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 11:23:53.579425 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 11:23:53.579425 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:23:53.579425 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:23:53.579425 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:23:53.579425 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:23:53.579425 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:23:53.579425 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:23:53.580424 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:23:53.580424 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Aug 24 11:23:53.580424 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:23:53.580424 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:23:53.580424 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:23:53.580424 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:23:53.580424 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:23:53.580424 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:23:53.580424 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:23:53.580424 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:23:53.580424 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 11:23:53.580424 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 11:23:53.580424 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 11:23:53.580424 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:23:53.580424 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 644/1290] 10.222.0.27 () {56 vars in 1117 bytes} [Wed Aug 24 11:23:53 2022] GET /identity/v3/services/placement => generated 90 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:23:53.587373 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c28dda8-1bea-437a-856d-e9fceefcdd09 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:23:53.706779 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c28dda8-1bea-437a-856d-e9fceefcdd09 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:23:53.741353 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0806e609-59a1-4ccb-a4b5-72ea6fee8642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:23:53.741950 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0806e609-59a1-4ccb-a4b5-72ea6fee8642 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:23:53.742225 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0806e609-59a1-4ccb-a4b5-72ea6fee8642 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:23:53.742518 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0806e609-59a1-4ccb-a4b5-72ea6fee8642 None admin] PATH_INFO: `/v3/services` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:23:53.743142 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0806e609-59a1-4ccb-a4b5-72ea6fee8642 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:23:53.743445 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0806e609-59a1-4ccb-a4b5-72ea6fee8642 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:23:53.744858 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0806e609-59a1-4ccb-a4b5-72ea6fee8642 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:23:53.749593 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 647/1291] 10.222.0.27 () {56 vars in 1116 bytes} [Wed Aug 24 11:23:53 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:23:53.758121 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4967bd-2e80-4020-9bb3-499eb198c08b None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:23:53.865719 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4967bd-2e80-4020-9bb3-499eb198c08b None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:23:53.900547 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4611c0-8099-47eb-b290-3989b3b452dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:23:53.901180 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4611c0-8099-47eb-b290-3989b3b452dc None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:23:53.901449 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4611c0-8099-47eb-b290-3989b3b452dc None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:23:53.901727 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4611c0-8099-47eb-b290-3989b3b452dc None admin] PATH_INFO: `/v3/services` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:23:53.902381 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4611c0-8099-47eb-b290-3989b3b452dc None admin] RBAC: Adding query filter params (type=placement) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:23:53.902678 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4611c0-8099-47eb-b290-3989b3b452dc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:23:53.904108 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4611c0-8099-47eb-b290-3989b3b452dc None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:23:53.908973 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 645/1292] 10.222.0.27 () {56 vars in 1116 bytes} [Wed Aug 24 11:23:53 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:23:55.786349 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5e3eb9-7b57-4f94-a669-99f621f0ff8e None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:23:55.786978 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5e3eb9-7b57-4f94-a669-99f621f0ff8e None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:23:55.786978 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5e3eb9-7b57-4f94-a669-99f621f0ff8e None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:23:55.788243 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 648/1293] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:23:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:23:55.795108 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e21a6e-3a41-4ee6-b2ef-0297684f8a56 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:23:55.795569 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e21a6e-3a41-4ee6-b2ef-0297684f8a56 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:23:55.795674 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e21a6e-3a41-4ee6-b2ef-0297684f8a56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:23:55.818981 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-00e21a6e-3a41-4ee6-b2ef-0297684f8a56 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:23:55.820177 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-00e21a6e-3a41-4ee6-b2ef-0297684f8a56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:23:55.851179 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:23:55.890993 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 646/1294] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:23:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 11:23:56.158309 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5e3eb9-7b57-4f94-a669-99f621f0ff8e None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:23:56.194534 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:23:56.267150 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5e3eb9-7b57-4f94-a669-99f621f0ff8e None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:23:56.303687 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154ae7d9-42d5-4faa-8921-ada0981ffc47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:23:56.304281 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154ae7d9-42d5-4faa-8921-ada0981ffc47 None admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:23:56.304553 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154ae7d9-42d5-4faa-8921-ada0981ffc47 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:23:56.304817 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154ae7d9-42d5-4faa-8921-ada0981ffc47 None admin] PATH_INFO: `/v3/services` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:23:56.305455 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154ae7d9-42d5-4faa-8921-ada0981ffc47 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:23:56.306880 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154ae7d9-42d5-4faa-8921-ada0981ffc47 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:23:56.322931 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 649/1295] 10.222.0.27 () {60 vars in 1141 bytes} [Wed Aug 24 11:23:56 2022] POST /identity/v3/services => generated 246 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:23:58.213466 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584208ba-680f-4bf9-8d4f-2709b1544859 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:23:58.214010 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584208ba-680f-4bf9-8d4f-2709b1544859 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:23:58.214010 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584208ba-680f-4bf9-8d4f-2709b1544859 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:23:58.215413 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 647/1296] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:23:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:23:58.221744 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0c2263-0876-4dec-b2e6-8a822e601dc2 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:23:58.222528 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0c2263-0876-4dec-b2e6-8a822e601dc2 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:23:58.222653 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0c2263-0876-4dec-b2e6-8a822e601dc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:23:58.249670 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-0c0c2263-0876-4dec-b2e6-8a822e601dc2 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:23:58.250916 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-0c0c2263-0876-4dec-b2e6-8a822e601dc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:23:58.341780 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 650/1297] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:23:58 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 11:23:58.611052 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584208ba-680f-4bf9-8d4f-2709b1544859 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:23:58.728172 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584208ba-680f-4bf9-8d4f-2709b1544859 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:23:58.765162 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340c9a6d-369b-42f7-a5dc-ceb60f9aaf61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:23:58.765781 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340c9a6d-369b-42f7-a5dc-ceb60f9aaf61 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:23:58.766053 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340c9a6d-369b-42f7-a5dc-ceb60f9aaf61 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:23:58.766319 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340c9a6d-369b-42f7-a5dc-ceb60f9aaf61 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:23:58.766932 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340c9a6d-369b-42f7-a5dc-ceb60f9aaf61 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:23:58.768317 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340c9a6d-369b-42f7-a5dc-ceb60f9aaf61 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:23:58.777541 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-340c9a6d-369b-42f7-a5dc-ceb60f9aaf61 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 11:23:58.777541 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:23:58.777541 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 11:23:58.777541 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 11:23:58.777541 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 11:23:58.777541 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 11:23:58.777541 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 11:23:58.777541 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 11:23:58.777541 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 11:23:58.777541 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:23:58.777541 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 11:23:58.777541 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:23:58.777541 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:23:58.777541 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:23:58.777541 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:23:58.777541 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:23:58.777541 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:23:58.778752 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:23:58.778752 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:23:58.778752 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:23:58.778752 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:23:58.778752 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:23:58.778752 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:23:58.778752 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 11:23:58.778752 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 11:23:58.778752 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 11:23:58.778752 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 11:23:58.778752 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:23:58.778752 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:23:58.778752 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:23:58.778752 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:23:58.778752 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:23:58.778752 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:23:58.779632 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:23:58.779632 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Aug 24 11:23:58.779632 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:23:58.779632 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:23:58.779632 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:23:58.779632 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:23:58.779632 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:23:58.779632 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:23:58.779632 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:23:58.779632 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:23:58.779632 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 11:23:58.779632 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 11:23:58.779632 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 11:23:58.779632 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:23:58.779632 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 648/1298] 10.222.0.27 () {56 vars in 1117 bytes} [Wed Aug 24 11:23:58 2022] GET /identity/v3/services/placement => generated 90 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:23:58.784670 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0c2263-0876-4dec-b2e6-8a822e601dc2 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:23:58.803684 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:23:58.887580 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0c2263-0876-4dec-b2e6-8a822e601dc2 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:23:58.923054 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c7c234-a9fe-462f-9d21-4b5d72f2109c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:23:58.923653 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c7c234-a9fe-462f-9d21-4b5d72f2109c None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:23:58.923922 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c7c234-a9fe-462f-9d21-4b5d72f2109c None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:23:58.924191 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c7c234-a9fe-462f-9d21-4b5d72f2109c None admin] PATH_INFO: `/v3/services` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:23:58.924819 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c7c234-a9fe-462f-9d21-4b5d72f2109c None admin] RBAC: Adding query filter params (name=placement) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:23:58.925118 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c7c234-a9fe-462f-9d21-4b5d72f2109c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:23:58.926524 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c7c234-a9fe-462f-9d21-4b5d72f2109c None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:23:58.931874 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 651/1299] 10.222.0.27 () {56 vars in 1116 bytes} [Wed Aug 24 11:23:58 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:23:58.938411 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340c9a6d-369b-42f7-a5dc-ceb60f9aaf61 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:23:58.980531 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:23:59.056901 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340c9a6d-369b-42f7-a5dc-ceb60f9aaf61 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:23:59.095256 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445db846-a732-4fcf-8fd6-eabb9e2151a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:23:59.095884 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445db846-a732-4fcf-8fd6-eabb9e2151a3 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:23:59.096160 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445db846-a732-4fcf-8fd6-eabb9e2151a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:23:59.096438 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445db846-a732-4fcf-8fd6-eabb9e2151a3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:23:59.097124 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445db846-a732-4fcf-8fd6-eabb9e2151a3 None admin] RBAC: Adding query filter params (interface=public, service_id=930a0dd9fceb40acbb375a53af06fcca, region_id=RegionOne) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:23:59.097427 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445db846-a732-4fcf-8fd6-eabb9e2151a3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:23:59.098837 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445db846-a732-4fcf-8fd6-eabb9e2151a3 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:23:59.105352 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 649/1300] 10.222.0.27 () {56 vars in 1251 bytes} [Wed Aug 24 11:23:58 2022] GET /identity/v3/endpoints?service_id=930a0dd9fceb40acbb375a53af06fcca&interface=public®ion_id=RegionOne => generated 194 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:23:59.111472 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c7c234-a9fe-462f-9d21-4b5d72f2109c None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:23:59.202072 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:23:59.223511 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c7c234-a9fe-462f-9d21-4b5d72f2109c None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:23:59.260160 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad71aab0-37bc-4935-902c-c7bfcb1d68a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:23:59.260778 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad71aab0-37bc-4935-902c-c7bfcb1d68a4 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:23:59.261050 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad71aab0-37bc-4935-902c-c7bfcb1d68a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:23:59.261319 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad71aab0-37bc-4935-902c-c7bfcb1d68a4 None admin] PATH_INFO: `/v3/services` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:23:59.261928 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad71aab0-37bc-4935-902c-c7bfcb1d68a4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:23:59.263489 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad71aab0-37bc-4935-902c-c7bfcb1d68a4 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:23:59.270580 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 652/1301] 10.222.0.27 () {56 vars in 1087 bytes} [Wed Aug 24 11:23:59 2022] GET /identity/v3/services => generated 2191 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:24:01.152388 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f02b3ba-0262-4189-896f-95c1f2075255 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:24:01.153241 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f02b3ba-0262-4189-896f-95c1f2075255 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:24:01.153241 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f02b3ba-0262-4189-896f-95c1f2075255 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:24:01.155640 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 650/1302] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:24:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:24:01.162040 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6159b6-2a92-493f-b247-dc9aa417cbfd None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:24:01.162517 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6159b6-2a92-493f-b247-dc9aa417cbfd None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:24:01.162622 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6159b6-2a92-493f-b247-dc9aa417cbfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:24:01.188487 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-7f6159b6-2a92-493f-b247-dc9aa417cbfd None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:24:01.189676 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-7f6159b6-2a92-493f-b247-dc9aa417cbfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:24:01.268158 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 653/1303] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:24:01 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 11:24:01.530922 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f02b3ba-0262-4189-896f-95c1f2075255 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:24:01.647737 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:24:01.655821 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f02b3ba-0262-4189-896f-95c1f2075255 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:24:01.691087 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c7de5a-5a68-48c2-9b36-7f2b7b91d3b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:24:01.691717 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c7de5a-5a68-48c2-9b36-7f2b7b91d3b7 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:24:01.691993 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c7de5a-5a68-48c2-9b36-7f2b7b91d3b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:24:01.692263 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c7de5a-5a68-48c2-9b36-7f2b7b91d3b7 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:24:01.692844 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c7de5a-5a68-48c2-9b36-7f2b7b91d3b7 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:24:01.694248 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c7de5a-5a68-48c2-9b36-7f2b7b91d3b7 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:24:01.703419 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-05c7de5a-5a68-48c2-9b36-7f2b7b91d3b7 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 11:24:01.703419 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:24:01.703419 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 11:24:01.703419 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 11:24:01.703419 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 11:24:01.703419 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 11:24:01.703419 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 11:24:01.703419 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 11:24:01.703419 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 11:24:01.703419 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:24:01.703419 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 11:24:01.703419 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:24:01.703419 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:24:01.703419 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:24:01.703419 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:24:01.703419 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:24:01.703419 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:24:01.705655 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:24:01.705655 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:24:01.705655 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:24:01.705655 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:24:01.705655 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:24:01.705655 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:24:01.705655 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 11:24:01.705655 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 11:24:01.705655 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 11:24:01.705655 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 11:24:01.705655 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:24:01.705655 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:24:01.705655 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:24:01.705655 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:24:01.705655 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:24:01.705655 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:24:01.706797 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:24:01.706797 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Aug 24 11:24:01.706797 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:24:01.706797 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:24:01.706797 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:24:01.706797 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:24:01.706797 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:24:01.706797 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:24:01.706797 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:24:01.706797 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:24:01.706797 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 11:24:01.706797 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 11:24:01.706797 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 11:24:01.706797 dv-cinder-848899-3-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Aug 24 11:24:01.706797 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 651/1304] 10.222.0.27 () {56 vars in 1117 bytes} [Wed Aug 24 11:24:01 2022] GET /identity/v3/services/placement => generated 90 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:24:01.710866 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6159b6-2a92-493f-b247-dc9aa417cbfd None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:24:01.790827 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:24:01.814785 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6159b6-2a92-493f-b247-dc9aa417cbfd None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:24:01.849145 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546e463f-8b01-4551-83b7-8068be289ec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:24:01.849731 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546e463f-8b01-4551-83b7-8068be289ec8 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:24:01.849999 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546e463f-8b01-4551-83b7-8068be289ec8 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:24:01.850238 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546e463f-8b01-4551-83b7-8068be289ec8 None admin] PATH_INFO: `/v3/services` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:24:01.850872 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546e463f-8b01-4551-83b7-8068be289ec8 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:24:01.851205 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546e463f-8b01-4551-83b7-8068be289ec8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:24:01.852607 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546e463f-8b01-4551-83b7-8068be289ec8 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:24:01.857633 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 654/1305] 10.222.0.27 () {56 vars in 1116 bytes} [Wed Aug 24 11:24:01 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:24:01.863648 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c7de5a-5a68-48c2-9b36-7f2b7b91d3b7 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:24:01.969874 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c7de5a-5a68-48c2-9b36-7f2b7b91d3b7 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:24:02.013194 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1298c2fa-bb3a-4613-b7f9-ab23f7d3e7b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:24:02.013779 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1298c2fa-bb3a-4613-b7f9-ab23f7d3e7b4 None admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:24:02.014048 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1298c2fa-bb3a-4613-b7f9-ab23f7d3e7b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:24:02.014314 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1298c2fa-bb3a-4613-b7f9-ab23f7d3e7b4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:24:02.015004 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1298c2fa-bb3a-4613-b7f9-ab23f7d3e7b4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:24:02.016409 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1298c2fa-bb3a-4613-b7f9-ab23f7d3e7b4 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:24:02.043355 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 652/1306] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 11:24:01 2022] POST /identity/v3/endpoints => generated 331 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:24:11.855106 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=30 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:24:12.035188 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:25:06.102282 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734db6dc-e720-4a36-927a-337634cf0330 None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:25:06.103425 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734db6dc-e720-4a36-927a-337634cf0330 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:25:06.104525 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734db6dc-e720-4a36-927a-337634cf0330 None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:25:06.112542 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c9ce75-f21f-4420-9ffb-05923a7b6417 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:25:06.113534 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c9ce75-f21f-4420-9ffb-05923a7b6417 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:25:06.114018 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c9ce75-f21f-4420-9ffb-05923a7b6417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:25:06.119109 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 655/1307] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:25:06 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:25:06.199167 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-f0c9ce75-f21f-4420-9ffb-05923a7b6417 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:25:06.200282 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-f0c9ce75-f21f-4420-9ffb-05923a7b6417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:25:06.312454 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 653/1308] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:25:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:25:06.605307 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62872a3f-4525-4a3e-9e2b-c4df19077c96 None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:25:06.605670 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62872a3f-4525-4a3e-9e2b-c4df19077c96 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:25:06.606126 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62872a3f-4525-4a3e-9e2b-c4df19077c96 None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:25:06.607978 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 656/1309] 10.222.0.27 () {54 vars in 965 bytes} [Wed Aug 24 11:25:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:25:06.613800 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902cef50-b7a6-4bfd-83d5-2c2fd3ba4d6c None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:25:06.614076 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902cef50-b7a6-4bfd-83d5-2c2fd3ba4d6c None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:25:06.614337 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902cef50-b7a6-4bfd-83d5-2c2fd3ba4d6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:25:06.711378 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-902cef50-b7a6-4bfd-83d5-2c2fd3ba4d6c None None] MFA Rules not processed for user `e2d061d25d83443c9232218c90792d51`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:25:06.712573 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-902cef50-b7a6-4bfd-83d5-2c2fd3ba4d6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:25:06.744105 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:25:06.810411 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 654/1310] 10.222.0.27 () {58 vars in 1062 bytes} [Wed Aug 24 11:25:06 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:25:06.819279 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62872a3f-4525-4a3e-9e2b-c4df19077c96 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:25:06.821066 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-62872a3f-4525-4a3e-9e2b-c4df19077c96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:25:06.941110 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62872a3f-4525-4a3e-9e2b-c4df19077c96 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:25:07.016722 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5040c757-b145-4ca1-a86d-a75b6f31ec8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2d061d25d83443c9232218c90792d51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:25:07.017332 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5040c757-b145-4ca1-a86d-a75b6f31ec8c service neutron] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:25:07.017601 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5040c757-b145-4ca1-a86d-a75b6f31ec8c service neutron] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:25:07.017865 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5040c757-b145-4ca1-a86d-a75b6f31ec8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:25:07.019868 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-5040c757-b145-4ca1-a86d-a75b6f31ec8c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:25:07.076478 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:25:07.153253 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5040c757-b145-4ca1-a86d-a75b6f31ec8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:25:07.154754 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5040c757-b145-4ca1-a86d-a75b6f31ec8c service neutron] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:25:07.176631 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 657/1311] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:25:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:25:09.362100 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3fd65b-8fe3-4965-abac-46e6f75b2ecd None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:25:09.362672 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3fd65b-8fe3-4965-abac-46e6f75b2ecd None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:25:09.362672 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3fd65b-8fe3-4965-abac-46e6f75b2ecd None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:25:09.363991 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 655/1312] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:25:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:25:09.369810 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b42160e-9f3b-4c04-9553-647eb7ca1711 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:25:09.370268 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b42160e-9f3b-4c04-9553-647eb7ca1711 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:25:09.370399 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b42160e-9f3b-4c04-9553-647eb7ca1711 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:25:09.466543 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-7b42160e-9f3b-4c04-9553-647eb7ca1711 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:25:09.468004 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-7b42160e-9f3b-4c04-9553-647eb7ca1711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:25:09.585143 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 658/1313] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:25:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:25:09.859946 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3fd65b-8fe3-4965-abac-46e6f75b2ecd None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:25:09.861432 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-7c3fd65b-8fe3-4965-abac-46e6f75b2ecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:25:09.973569 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3fd65b-8fe3-4965-abac-46e6f75b2ecd None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:25:10.049436 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:25:10.052035 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fbbcb5-0aa2-4b9e-ae3b-2816aec1609c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2d061d25d83443c9232218c90792d51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:25:10.052720 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fbbcb5-0aa2-4b9e-ae3b-2816aec1609c service neutron] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:25:10.053000 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fbbcb5-0aa2-4b9e-ae3b-2816aec1609c service neutron] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:25:10.053274 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fbbcb5-0aa2-4b9e-ae3b-2816aec1609c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:25:10.055453 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-40fbbcb5-0aa2-4b9e-ae3b-2816aec1609c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:25:10.173855 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fbbcb5-0aa2-4b9e-ae3b-2816aec1609c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:25:10.175354 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fbbcb5-0aa2-4b9e-ae3b-2816aec1609c service neutron] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:25:10.194274 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 656/1314] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:25:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:25:12.407423 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9349e669-0bfe-4d5d-8da0-7db344c97b76 None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:25:12.408291 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9349e669-0bfe-4d5d-8da0-7db344c97b76 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:25:12.408291 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9349e669-0bfe-4d5d-8da0-7db344c97b76 None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:25:12.410421 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 659/1315] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:25:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:25:12.417058 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d412b2b-6e29-443c-9b5c-44fe3a65fa68 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:25:12.417511 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d412b2b-6e29-443c-9b5c-44fe3a65fa68 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:25:12.417624 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d412b2b-6e29-443c-9b5c-44fe3a65fa68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:25:12.499952 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-7d412b2b-6e29-443c-9b5c-44fe3a65fa68 None None] MFA Rules not processed for user `46203446b8ea4ef7b7610bda424e8775`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:25:12.501176 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-7d412b2b-6e29-443c-9b5c-44fe3a65fa68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:25:12.554074 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:25:12.599459 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 657/1316] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:25:12 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:25:12.883145 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9349e669-0bfe-4d5d-8da0-7db344c97b76 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:25:12.884752 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-9349e669-0bfe-4d5d-8da0-7db344c97b76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:25:12.895706 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:25:13.008513 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9349e669-0bfe-4d5d-8da0-7db344c97b76 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:25:13.085119 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a2939e-3aae-42be-aee6-1ff2a2428d4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2d061d25d83443c9232218c90792d51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:25:13.085854 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a2939e-3aae-42be-aee6-1ff2a2428d4b service neutron] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:25:13.086139 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a2939e-3aae-42be-aee6-1ff2a2428d4b service neutron] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:25:13.086463 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a2939e-3aae-42be-aee6-1ff2a2428d4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:25:13.088083 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-44a2939e-3aae-42be-aee6-1ff2a2428d4b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:25:13.154725 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:25:13.204631 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a2939e-3aae-42be-aee6-1ff2a2428d4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:25:13.206145 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a2939e-3aae-42be-aee6-1ff2a2428d4b service neutron] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:25:13.225865 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 660/1317] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:25:12 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:25:15.625404 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d938f8b0-4b65-49a7-a657-c9d4d1185e3d None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:25:15.626295 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d938f8b0-4b65-49a7-a657-c9d4d1185e3d None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:25:15.626295 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d938f8b0-4b65-49a7-a657-c9d4d1185e3d None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:25:15.628564 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 658/1318] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:25:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:25:15.635877 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56184b53-c169-4f1a-8ad4-c689ab523225 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:25:15.636309 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56184b53-c169-4f1a-8ad4-c689ab523225 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:25:15.636419 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56184b53-c169-4f1a-8ad4-c689ab523225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:25:15.724739 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-56184b53-c169-4f1a-8ad4-c689ab523225 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:25:15.726474 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-56184b53-c169-4f1a-8ad4-c689ab523225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:25:15.831841 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 661/1319] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:25:15 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:25:16.132544 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8180a9d1-ad94-466e-a527-450d8b49927d None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:25:16.132886 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8180a9d1-ad94-466e-a527-450d8b49927d None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:25:16.133098 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8180a9d1-ad94-466e-a527-450d8b49927d None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:25:16.135246 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 659/1320] 10.222.0.27 () {54 vars in 965 bytes} [Wed Aug 24 11:25:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:25:16.142057 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302fbcd1-ac1b-4570-98de-1eae052c5693 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:25:16.142412 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302fbcd1-ac1b-4570-98de-1eae052c5693 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:25:16.142802 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302fbcd1-ac1b-4570-98de-1eae052c5693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:25:16.168174 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:25:16.224537 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-302fbcd1-ac1b-4570-98de-1eae052c5693 None None] MFA Rules not processed for user `e2d061d25d83443c9232218c90792d51`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:25:16.225744 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-302fbcd1-ac1b-4570-98de-1eae052c5693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:25:16.303418 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 662/1321] 10.222.0.27 () {58 vars in 1062 bytes} [Wed Aug 24 11:25:16 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:25:16.313394 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8180a9d1-ad94-466e-a527-450d8b49927d None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:25:16.315818 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-8180a9d1-ad94-466e-a527-450d8b49927d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:25:16.431500 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8180a9d1-ad94-466e-a527-450d8b49927d None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:25:16.510567 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bd392d-8513-49a3-a905-098249c49da5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2d061d25d83443c9232218c90792d51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:25:16.511166 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bd392d-8513-49a3-a905-098249c49da5 service neutron] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:25:16.511436 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bd392d-8513-49a3-a905-098249c49da5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:25:16.511702 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bd392d-8513-49a3-a905-098249c49da5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:25:16.513281 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-88bd392d-8513-49a3-a905-098249c49da5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:25:16.521128 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:25:16.635013 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bd392d-8513-49a3-a905-098249c49da5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:25:16.636473 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bd392d-8513-49a3-a905-098249c49da5 service neutron] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:25:16.655585 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 660/1322] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:25:16 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:25:19.659643 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b6c309-b54e-4cde-872a-8bfce9460b5d None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:25:19.660232 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b6c309-b54e-4cde-872a-8bfce9460b5d None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:25:19.660232 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b6c309-b54e-4cde-872a-8bfce9460b5d None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:25:19.661536 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 663/1323] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:25:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:25:19.667489 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104bbb4d-c48a-4cb2-9260-34a1460d51c6 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:25:19.667959 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104bbb4d-c48a-4cb2-9260-34a1460d51c6 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:25:19.668059 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104bbb4d-c48a-4cb2-9260-34a1460d51c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:25:19.736968 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-104bbb4d-c48a-4cb2-9260-34a1460d51c6 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:25:19.738189 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-104bbb4d-c48a-4cb2-9260-34a1460d51c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:25:19.815621 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:25:19.857788 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 661/1324] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:25:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:25:20.145345 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b6c309-b54e-4cde-872a-8bfce9460b5d None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:25:20.146977 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-28b6c309-b54e-4cde-872a-8bfce9460b5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:25:20.254556 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b6c309-b54e-4cde-872a-8bfce9460b5d None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:25:20.267287 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:25:20.330844 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7e62ef-70b9-41a9-a677-d69ea207648e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2d061d25d83443c9232218c90792d51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:25:20.331387 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7e62ef-70b9-41a9-a677-d69ea207648e service neutron] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:25:20.331636 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7e62ef-70b9-41a9-a677-d69ea207648e service neutron] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:25:20.331907 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7e62ef-70b9-41a9-a677-d69ea207648e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:25:20.333543 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-3f7e62ef-70b9-41a9-a677-d69ea207648e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:25:20.447022 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7e62ef-70b9-41a9-a677-d69ea207648e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:25:20.448952 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7e62ef-70b9-41a9-a677-d69ea207648e service neutron] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:25:20.469032 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 664/1325] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:25:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:25:22.423035 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702cb539-0a69-4b42-b4c7-e0482b346e06 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:25:22.423630 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702cb539-0a69-4b42-b4c7-e0482b346e06 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:25:22.423630 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702cb539-0a69-4b42-b4c7-e0482b346e06 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:25:22.424816 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 662/1326] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:25:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:25:22.430391 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae36c18-69e1-4487-989e-41d5ae2a5431 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:25:22.430821 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae36c18-69e1-4487-989e-41d5ae2a5431 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:25:22.430957 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae36c18-69e1-4487-989e-41d5ae2a5431 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:25:22.481016 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:25:22.499769 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-7ae36c18-69e1-4487-989e-41d5ae2a5431 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:25:22.501008 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-7ae36c18-69e1-4487-989e-41d5ae2a5431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:25:22.602800 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 665/1327] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:25:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:25:22.886488 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702cb539-0a69-4b42-b4c7-e0482b346e06 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:25:22.888233 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-702cb539-0a69-4b42-b4c7-e0482b346e06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:25:23.003804 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702cb539-0a69-4b42-b4c7-e0482b346e06 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:25:23.079295 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bff4647-8837-4805-a970-83b1544cd09c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2d061d25d83443c9232218c90792d51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:25:23.079908 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bff4647-8837-4805-a970-83b1544cd09c service neutron] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:25:23.080188 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bff4647-8837-4805-a970-83b1544cd09c service neutron] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:25:23.080462 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bff4647-8837-4805-a970-83b1544cd09c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:25:23.082068 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-1bff4647-8837-4805-a970-83b1544cd09c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:25:23.101344 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:25:23.202778 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bff4647-8837-4805-a970-83b1544cd09c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:25:23.204199 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bff4647-8837-4805-a970-83b1544cd09c service neutron] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:25:23.222736 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 663/1328] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:25:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 11:25:25.188647 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7342beba-09ed-4bf5-a57e-40dfabaccb56 None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:25:25.189239 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7342beba-09ed-4bf5-a57e-40dfabaccb56 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:25:25.189239 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7342beba-09ed-4bf5-a57e-40dfabaccb56 None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:25:25.190562 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 666/1329] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:25:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:25:25.196084 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1742e1-2852-47b0-8285-01a53f53dcad None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:25:25.196601 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1742e1-2852-47b0-8285-01a53f53dcad None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:25:25.196707 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1742e1-2852-47b0-8285-01a53f53dcad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:25:25.268728 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-5b1742e1-2852-47b0-8285-01a53f53dcad None None] MFA Rules not processed for user `46203446b8ea4ef7b7610bda424e8775`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:25:25.269942 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-5b1742e1-2852-47b0-8285-01a53f53dcad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:25:25.336544 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:25:25.370811 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 664/1330] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:25:25 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:25:25.650643 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7342beba-09ed-4bf5-a57e-40dfabaccb56 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:25:25.652407 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-7342beba-09ed-4bf5-a57e-40dfabaccb56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:25:25.770998 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7342beba-09ed-4bf5-a57e-40dfabaccb56 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:25:25.792243 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:25:25.848551 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f409fe9-1a2b-49eb-bd27-0e781a913b37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2d061d25d83443c9232218c90792d51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:25:25.849165 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f409fe9-1a2b-49eb-bd27-0e781a913b37 service neutron] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:25:25.849494 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f409fe9-1a2b-49eb-bd27-0e781a913b37 service neutron] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:25:25.849668 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f409fe9-1a2b-49eb-bd27-0e781a913b37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:25:25.851557 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-2f409fe9-1a2b-49eb-bd27-0e781a913b37 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:25:25.972769 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f409fe9-1a2b-49eb-bd27-0e781a913b37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:25:25.974228 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f409fe9-1a2b-49eb-bd27-0e781a913b37 service neutron] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:25:25.993280 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 667/1331] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:25:25 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:25:28.158476 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18efd3e6-e31f-4de0-8015-441f9702808d None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:25:28.159016 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18efd3e6-e31f-4de0-8015-441f9702808d None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:25:28.159016 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18efd3e6-e31f-4de0-8015-441f9702808d None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:25:28.160377 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 665/1332] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:25:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:25:28.166914 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cc7395-d7c0-408b-a725-6753fb565132 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:25:28.167370 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cc7395-d7c0-408b-a725-6753fb565132 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:25:28.167465 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cc7395-d7c0-408b-a725-6753fb565132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:25:28.237358 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:25:28.240508 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-c8cc7395-d7c0-408b-a725-6753fb565132 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:25:28.242332 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-c8cc7395-d7c0-408b-a725-6753fb565132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:25:28.352735 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 668/1333] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:25:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:25:28.635682 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18efd3e6-e31f-4de0-8015-441f9702808d None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:25:28.638097 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-18efd3e6-e31f-4de0-8015-441f9702808d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:25:28.764214 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18efd3e6-e31f-4de0-8015-441f9702808d None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:25:28.847847 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c853b616-c0e2-4155-88c8-6300f4b8167c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2d061d25d83443c9232218c90792d51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:25:28.848706 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c853b616-c0e2-4155-88c8-6300f4b8167c service neutron] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:25:28.849057 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c853b616-c0e2-4155-88c8-6300f4b8167c service neutron] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:25:28.849381 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c853b616-c0e2-4155-88c8-6300f4b8167c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:25:28.852066 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-c853b616-c0e2-4155-88c8-6300f4b8167c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:25:28.885832 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:25:28.976349 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c853b616-c0e2-4155-88c8-6300f4b8167c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:25:28.977895 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c853b616-c0e2-4155-88c8-6300f4b8167c service neutron] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:25:28.995896 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 666/1334] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:25:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:25:30.915197 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411876c6-dfa6-4443-9348-99d43c6676e6 None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:25:30.915765 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411876c6-dfa6-4443-9348-99d43c6676e6 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:25:30.915765 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411876c6-dfa6-4443-9348-99d43c6676e6 None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:25:30.917107 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 669/1335] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:25:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:25:30.922521 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eb4466-5bd3-4cf5-ae70-87a2c2a91ba9 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:25:30.922992 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eb4466-5bd3-4cf5-ae70-87a2c2a91ba9 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:25:30.923086 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eb4466-5bd3-4cf5-ae70-87a2c2a91ba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:25:30.992487 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-50eb4466-5bd3-4cf5-ae70-87a2c2a91ba9 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:25:30.993693 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-50eb4466-5bd3-4cf5-ae70-87a2c2a91ba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:25:31.071272 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:25:31.094806 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 667/1336] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:25:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:25:31.380264 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411876c6-dfa6-4443-9348-99d43c6676e6 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:25:31.382701 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-411876c6-dfa6-4443-9348-99d43c6676e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:25:31.496631 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411876c6-dfa6-4443-9348-99d43c6676e6 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:25:31.525707 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:25:31.570732 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a5017d-1af7-46a6-8f30-b889079cdf3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2d061d25d83443c9232218c90792d51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:25:31.571366 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a5017d-1af7-46a6-8f30-b889079cdf3d service neutron] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:25:31.571645 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a5017d-1af7-46a6-8f30-b889079cdf3d service neutron] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:25:31.571919 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a5017d-1af7-46a6-8f30-b889079cdf3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:25:31.573526 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-a8a5017d-1af7-46a6-8f30-b889079cdf3d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:25:31.697495 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a5017d-1af7-46a6-8f30-b889079cdf3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:25:31.698911 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a5017d-1af7-46a6-8f30-b889079cdf3d service neutron] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:25:31.717345 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 670/1337] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:25:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:25:33.935296 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b769e610-6545-4aa2-a81a-54eea51316d6 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:25:33.935848 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b769e610-6545-4aa2-a81a-54eea51316d6 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:25:33.935848 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b769e610-6545-4aa2-a81a-54eea51316d6 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:25:33.937189 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 668/1338] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:25:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:25:33.943435 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec61695e-91bd-4c14-a43e-e8cf293283de None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:25:33.944184 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec61695e-91bd-4c14-a43e-e8cf293283de None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:25:33.944347 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec61695e-91bd-4c14-a43e-e8cf293283de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:25:34.014400 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-ec61695e-91bd-4c14-a43e-e8cf293283de None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:25:34.015609 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-ec61695e-91bd-4c14-a43e-e8cf293283de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:25:34.024276 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:25:34.129247 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 671/1339] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:25:33 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:25:34.412565 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b769e610-6545-4aa2-a81a-54eea51316d6 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:25:34.414780 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-b769e610-6545-4aa2-a81a-54eea51316d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:25:34.524361 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b769e610-6545-4aa2-a81a-54eea51316d6 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:25:34.603971 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e507fbdd-50a7-48e4-a0ff-1a04a701bdac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2d061d25d83443c9232218c90792d51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:25:34.604580 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e507fbdd-50a7-48e4-a0ff-1a04a701bdac service neutron] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:25:34.604856 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e507fbdd-50a7-48e4-a0ff-1a04a701bdac service neutron] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:25:34.605117 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e507fbdd-50a7-48e4-a0ff-1a04a701bdac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:25:34.606788 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-e507fbdd-50a7-48e4-a0ff-1a04a701bdac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:25:34.646033 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:25:34.723928 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e507fbdd-50a7-48e4-a0ff-1a04a701bdac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:25:34.725386 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e507fbdd-50a7-48e4-a0ff-1a04a701bdac service neutron] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:25:34.744458 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 669/1340] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:25:34 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:25:38.678997 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96cfda2-2e4a-4318-8665-316c71d6c6b3 None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:25:38.679536 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96cfda2-2e4a-4318-8665-316c71d6c6b3 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:25:38.679760 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96cfda2-2e4a-4318-8665-316c71d6c6b3 None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:25:38.681038 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 672/1341] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:25:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 11:25:38.686892 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f31a1cc-f698-4da2-9db7-025a6974a9c9 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:25:38.687300 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f31a1cc-f698-4da2-9db7-025a6974a9c9 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:25:38.687436 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f31a1cc-f698-4da2-9db7-025a6974a9c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:25:38.759009 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-5f31a1cc-f698-4da2-9db7-025a6974a9c9 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:25:38.760311 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-5f31a1cc-f698-4da2-9db7-025a6974a9c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:25:38.849515 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:25:38.861813 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 670/1342] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:25:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:25:39.140627 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96cfda2-2e4a-4318-8665-316c71d6c6b3 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:25:39.142210 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-d96cfda2-2e4a-4318-8665-316c71d6c6b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:25:39.256495 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96cfda2-2e4a-4318-8665-316c71d6c6b3 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:25:39.301142 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:25:39.334885 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0eb5695-30c8-4014-bc55-06ec2c63296a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2d061d25d83443c9232218c90792d51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:25:39.335497 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eb5695-30c8-4014-bc55-06ec2c63296a service neutron] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:25:39.335825 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eb5695-30c8-4014-bc55-06ec2c63296a service neutron] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:25:39.336088 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eb5695-30c8-4014-bc55-06ec2c63296a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:25:39.337669 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-d0eb5695-30c8-4014-bc55-06ec2c63296a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:25:39.448902 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0eb5695-30c8-4014-bc55-06ec2c63296a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:25:39.450263 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0eb5695-30c8-4014-bc55-06ec2c63296a service neutron] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:25:39.470280 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 673/1343] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:25:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:25:42.024280 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1887021b-d1a4-49a5-985e-469ff728df63 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:25:42.024831 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1887021b-d1a4-49a5-985e-469ff728df63 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:25:42.024831 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1887021b-d1a4-49a5-985e-469ff728df63 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:25:42.026249 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 671/1344] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:25:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:25:42.031773 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a37a406-f539-4e8f-8e3e-3a2217cdad00 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:25:42.032175 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a37a406-f539-4e8f-8e3e-3a2217cdad00 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:25:42.032411 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a37a406-f539-4e8f-8e3e-3a2217cdad00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:25:42.101932 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-2a37a406-f539-4e8f-8e3e-3a2217cdad00 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:25:42.105046 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-2a37a406-f539-4e8f-8e3e-3a2217cdad00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:25:42.127869 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:25:42.207264 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 674/1345] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:25:42 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:25:42.488469 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1887021b-d1a4-49a5-985e-469ff728df63 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:25:42.490074 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-1887021b-d1a4-49a5-985e-469ff728df63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:25:42.610379 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1887021b-d1a4-49a5-985e-469ff728df63 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:25:42.692139 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e81177f-189b-440d-8352-2e81f95bd050 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2d061d25d83443c9232218c90792d51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:25:42.692746 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e81177f-189b-440d-8352-2e81f95bd050 service neutron] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:25:42.693017 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e81177f-189b-440d-8352-2e81f95bd050 service neutron] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:25:42.693284 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e81177f-189b-440d-8352-2e81f95bd050 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:25:42.694968 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-2e81177f-189b-440d-8352-2e81f95bd050 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:25:42.739096 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:25:42.806396 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e81177f-189b-440d-8352-2e81f95bd050 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:25:42.807871 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e81177f-189b-440d-8352-2e81f95bd050 service neutron] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:25:42.826784 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 672/1346] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:25:42 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:25:46.691764 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7a86c9-1a3a-4902-84be-1f373a75b506 None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:25:46.692328 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7a86c9-1a3a-4902-84be-1f373a75b506 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:25:46.692328 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7a86c9-1a3a-4902-84be-1f373a75b506 None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:25:46.693686 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 675/1347] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:25:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:25:46.699753 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87a1d0c-36e4-4b52-a598-45eb7af3056a None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:25:46.700223 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87a1d0c-36e4-4b52-a598-45eb7af3056a None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:25:46.700335 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87a1d0c-36e4-4b52-a598-45eb7af3056a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:25:46.779759 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-a87a1d0c-36e4-4b52-a598-45eb7af3056a None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:25:46.781000 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-a87a1d0c-36e4-4b52-a598-45eb7af3056a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:25:46.878823 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:25:46.882379 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 673/1348] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:25:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:25:47.161179 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7a86c9-1a3a-4902-84be-1f373a75b506 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:25:47.162860 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-cf7a86c9-1a3a-4902-84be-1f373a75b506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:25:47.272935 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7a86c9-1a3a-4902-84be-1f373a75b506 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:25:47.325931 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:25:47.353130 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c52dea-eefd-4f32-948c-78139e140adf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2d061d25d83443c9232218c90792d51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:25:47.353731 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c52dea-eefd-4f32-948c-78139e140adf service neutron] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:25:47.354006 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c52dea-eefd-4f32-948c-78139e140adf service neutron] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:25:47.354267 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c52dea-eefd-4f32-948c-78139e140adf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:25:47.355892 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-87c52dea-eefd-4f32-948c-78139e140adf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:25:47.468498 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c52dea-eefd-4f32-948c-78139e140adf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:25:47.469940 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c52dea-eefd-4f32-948c-78139e140adf service neutron] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:25:47.495570 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 676/1349] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:25:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 11:25:52.423641 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef65fdc0-f556-4bd2-8352-fe09819bda52 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:25:52.424210 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef65fdc0-f556-4bd2-8352-fe09819bda52 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:25:52.424210 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef65fdc0-f556-4bd2-8352-fe09819bda52 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:25:52.426235 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 674/1350] 10.222.0.27 () {54 vars in 921 bytes} [Wed Aug 24 11:25:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:25:52.433874 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00531f20-ca72-4557-ae98-2e834bd57c63 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:25:52.434272 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00531f20-ca72-4557-ae98-2e834bd57c63 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:25:52.434415 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00531f20-ca72-4557-ae98-2e834bd57c63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:25:52.522486 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-00531f20-ca72-4557-ae98-2e834bd57c63 None None] MFA Rules not processed for user `ad45431e70ff48a9b90905a97d473d81`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:25:52.523813 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-00531f20-ca72-4557-ae98-2e834bd57c63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:25:52.542765 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:25:52.678984 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 677/1351] 10.222.0.27 () {58 vars in 1018 bytes} [Wed Aug 24 11:25:52 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:25:56.829962 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf60b00-20bc-4951-9dd1-bc343f4cc166 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:25:56.830618 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf60b00-20bc-4951-9dd1-bc343f4cc166 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:25:56.830618 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf60b00-20bc-4951-9dd1-bc343f4cc166 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:25:56.832124 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 675/1352] 10.222.0.27 () {54 vars in 921 bytes} [Wed Aug 24 11:25:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:25:56.837291 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07d1b56-15de-4021-afff-3959885274be None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:25:56.837788 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07d1b56-15de-4021-afff-3959885274be None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:25:56.838250 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07d1b56-15de-4021-afff-3959885274be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:25:56.923790 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-c07d1b56-15de-4021-afff-3959885274be None None] MFA Rules not processed for user `ad45431e70ff48a9b90905a97d473d81`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:25:56.925172 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-c07d1b56-15de-4021-afff-3959885274be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:25:57.001398 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:25:57.040523 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 678/1353] 10.222.0.27 () {58 vars in 1018 bytes} [Wed Aug 24 11:25:56 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:25:58.372214 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeab132-9e43-40b4-b0ee-8314475a76be None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:25:58.372800 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeab132-9e43-40b4-b0ee-8314475a76be None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:25:58.372800 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeab132-9e43-40b4-b0ee-8314475a76be None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:25:58.374240 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 676/1354] 10.222.0.27 () {54 vars in 921 bytes} [Wed Aug 24 11:25:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:25:58.379471 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9097affb-45e7-4b96-977c-47b4588bcbad None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:25:58.379921 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9097affb-45e7-4b96-977c-47b4588bcbad None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:25:58.380152 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9097affb-45e7-4b96-977c-47b4588bcbad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:25:58.460230 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-9097affb-45e7-4b96-977c-47b4588bcbad None None] MFA Rules not processed for user `ad45431e70ff48a9b90905a97d473d81`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:25:58.461441 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-9097affb-45e7-4b96-977c-47b4588bcbad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:25:58.569682 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 679/1355] 10.222.0.27 () {58 vars in 1018 bytes} [Wed Aug 24 11:25:58 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:26:01.861985 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa7724c-c1ae-41ac-a7e0-ee4c3eb5d7a1 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:26:01.862570 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa7724c-c1ae-41ac-a7e0-ee4c3eb5d7a1 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:26:01.862570 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa7724c-c1ae-41ac-a7e0-ee4c3eb5d7a1 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:26:01.863934 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 677/1356] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:26:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:26:01.869802 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde8fbbb-12ea-462f-8ec5-793bed1897bc None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:26:01.870255 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde8fbbb-12ea-462f-8ec5-793bed1897bc None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:26:01.870345 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde8fbbb-12ea-462f-8ec5-793bed1897bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:26:01.909227 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:26:01.954047 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-dde8fbbb-12ea-462f-8ec5-793bed1897bc None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:26:01.955411 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-dde8fbbb-12ea-462f-8ec5-793bed1897bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:26:02.072927 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 680/1357] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:26:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 11:26:02.395426 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046721b1-de68-489f-bc3c-d98cdc2769cd None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:26:02.396040 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046721b1-de68-489f-bc3c-d98cdc2769cd None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:26:02.396540 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046721b1-de68-489f-bc3c-d98cdc2769cd None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:26:02.398940 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 678/1358] 10.222.0.27 () {54 vars in 962 bytes} [Wed Aug 24 11:26:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:26:02.409991 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2d858f-60de-42f7-8b11-ceb0357dcc93 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:26:02.409991 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2d858f-60de-42f7-8b11-ceb0357dcc93 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:26:02.410290 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2d858f-60de-42f7-8b11-ceb0357dcc93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:26:02.491837 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-0a2d858f-60de-42f7-8b11-ceb0357dcc93 None None] MFA Rules not processed for user `282ec32864d046b2bea170f6a3845cc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:26:02.493448 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-0a2d858f-60de-42f7-8b11-ceb0357dcc93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:26:02.546704 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:26:02.650745 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 681/1359] 10.222.0.27 () {58 vars in 1059 bytes} [Wed Aug 24 11:26:02 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:26:02.656041 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046721b1-de68-489f-bc3c-d98cdc2769cd None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:26:02.657683 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-046721b1-de68-489f-bc3c-d98cdc2769cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:26:02.811989 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046721b1-de68-489f-bc3c-d98cdc2769cd None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:26:02.888982 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:26:02.931988 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58443e59-577d-4285-afa7-a11bc2b3120d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '282ec32864d046b2bea170f6a3845cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:26:02.932609 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58443e59-577d-4285-afa7-a11bc2b3120d service nova] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:26:02.932886 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58443e59-577d-4285-afa7-a11bc2b3120d service nova] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:26:02.933169 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58443e59-577d-4285-afa7-a11bc2b3120d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:26:02.934811 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-58443e59-577d-4285-afa7-a11bc2b3120d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:26:03.031388 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58443e59-577d-4285-afa7-a11bc2b3120d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:26:03.033213 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58443e59-577d-4285-afa7-a11bc2b3120d service nova] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:26:03.052555 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 679/1360] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:26:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:26:05.141709 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b56fe6-26ed-427f-8e46-605cdc815839 None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:26:05.142792 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b56fe6-26ed-427f-8e46-605cdc815839 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:26:05.142792 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b56fe6-26ed-427f-8e46-605cdc815839 None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:26:05.146235 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 682/1361] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:26:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:26:05.149399 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cd16c4-b546-47fa-aa33-03c262970c0c None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:26:05.149856 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cd16c4-b546-47fa-aa33-03c262970c0c None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:26:05.150140 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cd16c4-b546-47fa-aa33-03c262970c0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:26:05.221190 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-22cd16c4-b546-47fa-aa33-03c262970c0c None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:26:05.222598 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-22cd16c4-b546-47fa-aa33-03c262970c0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:26:05.264116 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:26:05.354388 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 680/1362] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:26:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:26:05.645435 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b56fe6-26ed-427f-8e46-605cdc815839 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:26:05.647113 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-f4b56fe6-26ed-427f-8e46-605cdc815839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:26:05.807840 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b56fe6-26ed-427f-8e46-605cdc815839 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:26:05.817027 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:26:05.931453 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc16787-a1b8-40cc-b1e8-5a52764b5413 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '282ec32864d046b2bea170f6a3845cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:26:05.932269 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc16787-a1b8-40cc-b1e8-5a52764b5413 service nova] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:26:05.932698 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc16787-a1b8-40cc-b1e8-5a52764b5413 service nova] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:26:05.933073 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc16787-a1b8-40cc-b1e8-5a52764b5413 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:26:05.934899 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-8cc16787-a1b8-40cc-b1e8-5a52764b5413 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:26:06.031910 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc16787-a1b8-40cc-b1e8-5a52764b5413 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:26:06.033725 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc16787-a1b8-40cc-b1e8-5a52764b5413 service nova] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:26:06.053947 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 683/1363] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:26:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:26:08.275865 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b1dc7b-fce5-4193-bcc6-61d35ba3afa2 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:26:08.276410 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b1dc7b-fce5-4193-bcc6-61d35ba3afa2 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:26:08.276410 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b1dc7b-fce5-4193-bcc6-61d35ba3afa2 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:26:08.278007 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 681/1364] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:26:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:26:08.283340 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadd3854-c6e9-4fa0-82eb-7d126def4b1a None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:26:08.283806 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadd3854-c6e9-4fa0-82eb-7d126def4b1a None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:26:08.284337 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadd3854-c6e9-4fa0-82eb-7d126def4b1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:26:08.305492 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:26:08.370663 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-cadd3854-c6e9-4fa0-82eb-7d126def4b1a None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:26:08.371787 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-cadd3854-c6e9-4fa0-82eb-7d126def4b1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:26:08.486049 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 684/1365] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:26:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:26:08.775541 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8ffc11-28ca-4c4f-a88c-66c7d3169615 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:26:08.775824 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8ffc11-28ca-4c4f-a88c-66c7d3169615 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:26:08.776279 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8ffc11-28ca-4c4f-a88c-66c7d3169615 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:26:08.777628 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 682/1366] 10.222.0.27 () {54 vars in 962 bytes} [Wed Aug 24 11:26:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:26:08.783842 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31baab9-0287-41a8-bf81-0100e69136f5 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:26:08.784202 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31baab9-0287-41a8-bf81-0100e69136f5 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:26:08.784589 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31baab9-0287-41a8-bf81-0100e69136f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:26:08.872160 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-e31baab9-0287-41a8-bf81-0100e69136f5 None None] MFA Rules not processed for user `282ec32864d046b2bea170f6a3845cc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:26:08.873553 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-e31baab9-0287-41a8-bf81-0100e69136f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:26:08.911544 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:26:09.003370 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 685/1367] 10.222.0.27 () {58 vars in 1059 bytes} [Wed Aug 24 11:26:08 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:26:09.011317 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8ffc11-28ca-4c4f-a88c-66c7d3169615 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:26:09.012770 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-fc8ffc11-28ca-4c4f-a88c-66c7d3169615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:26:09.205215 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8ffc11-28ca-4c4f-a88c-66c7d3169615 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:26:09.241401 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:26:09.372601 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c98db76-05ec-4256-80c4-9f88575bba57 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '282ec32864d046b2bea170f6a3845cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:26:09.373285 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c98db76-05ec-4256-80c4-9f88575bba57 service nova] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:26:09.373647 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c98db76-05ec-4256-80c4-9f88575bba57 service nova] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:26:09.374023 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c98db76-05ec-4256-80c4-9f88575bba57 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:26:09.375774 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-3c98db76-05ec-4256-80c4-9f88575bba57 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:26:09.489944 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c98db76-05ec-4256-80c4-9f88575bba57 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:26:09.491916 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c98db76-05ec-4256-80c4-9f88575bba57 service nova] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:26:09.511479 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 683/1368] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:26:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 500 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:26:09.987462 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac076fb6-c331-48c7-bd5c-13829c7e0753 None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:26:09.988041 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac076fb6-c331-48c7-bd5c-13829c7e0753 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:26:09.988041 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac076fb6-c331-48c7-bd5c-13829c7e0753 None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:26:09.989333 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 686/1369] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:26:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:26:09.995123 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58de07be-aa5e-4301-9206-34c5719cf39d None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:26:09.995476 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58de07be-aa5e-4301-9206-34c5719cf39d None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:26:09.995759 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58de07be-aa5e-4301-9206-34c5719cf39d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:26:10.030615 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:26:10.073166 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-58de07be-aa5e-4301-9206-34c5719cf39d None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:26:10.074716 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-58de07be-aa5e-4301-9206-34c5719cf39d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:26:10.181498 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 684/1370] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:26:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:26:10.767677 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d20156-8d00-48df-a902-5921745e85d5 None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:26:10.767677 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d20156-8d00-48df-a902-5921745e85d5 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:26:10.767677 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d20156-8d00-48df-a902-5921745e85d5 None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:26:10.769311 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 687/1371] 10.222.0.27 () {54 vars in 964 bytes} [Wed Aug 24 11:26:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:26:10.775101 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc7fa95-e934-4109-bb80-46f168f0ca74 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:26:10.775630 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc7fa95-e934-4109-bb80-46f168f0ca74 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:26:10.775630 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc7fa95-e934-4109-bb80-46f168f0ca74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:26:10.862560 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-3dc7fa95-e934-4109-bb80-46f168f0ca74 None None] MFA Rules not processed for user `92862b76ba3b4513b5dc5b5c962faac9`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:26:10.863911 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-3dc7fa95-e934-4109-bb80-46f168f0ca74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:26:10.914621 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:26:10.947187 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 685/1372] 10.222.0.27 () {58 vars in 1061 bytes} [Wed Aug 24 11:26:10 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:26:10.955154 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d20156-8d00-48df-a902-5921745e85d5 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:26:10.956883 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-87d20156-8d00-48df-a902-5921745e85d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:26:11.079378 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d20156-8d00-48df-a902-5921745e85d5 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:26:11.134743 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:26:11.183691 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a75cb4f-f6dc-4dce-8540-4cd20c7a791e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92862b76ba3b4513b5dc5b5c962faac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:26:11.184286 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a75cb4f-f6dc-4dce-8540-4cd20c7a791e service cinder] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:26:11.184572 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a75cb4f-f6dc-4dce-8540-4cd20c7a791e service cinder] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:26:11.184816 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a75cb4f-f6dc-4dce-8540-4cd20c7a791e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:26:11.186529 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-9a75cb4f-f6dc-4dce-8540-4cd20c7a791e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:26:11.393130 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a75cb4f-f6dc-4dce-8540-4cd20c7a791e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:26:11.394549 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a75cb4f-f6dc-4dce-8540-4cd20c7a791e service cinder] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:26:11.413732 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 688/1373] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:26:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:26:11.490248 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c009e3-b033-43f7-8827-5179464024b4 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:26:11.490248 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c009e3-b033-43f7-8827-5179464024b4 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:26:11.490248 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c009e3-b033-43f7-8827-5179464024b4 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:26:11.495579 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 686/1374] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:26:11 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:26:11.497380 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8001dec-2f0a-4185-b690-e69803ff9e81 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:26:11.498665 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8001dec-2f0a-4185-b690-e69803ff9e81 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:26:11.501168 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8001dec-2f0a-4185-b690-e69803ff9e81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:26:11.574071 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-a8001dec-2f0a-4185-b690-e69803ff9e81 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:26:11.575324 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-a8001dec-2f0a-4185-b690-e69803ff9e81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:26:11.597008 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:26:11.680844 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 689/1375] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:26:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:26:11.966491 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c009e3-b033-43f7-8827-5179464024b4 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:26:11.968100 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-29c009e3-b033-43f7-8827-5179464024b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:26:12.124271 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c009e3-b033-43f7-8827-5179464024b4 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:26:12.176010 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:26:12.238311 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08274f1f-4734-4d75-b13b-94855123457b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '282ec32864d046b2bea170f6a3845cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:26:12.238949 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08274f1f-4734-4d75-b13b-94855123457b service nova] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:26:12.239209 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08274f1f-4734-4d75-b13b-94855123457b service nova] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:26:12.239477 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08274f1f-4734-4d75-b13b-94855123457b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:26:12.241200 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-08274f1f-4734-4d75-b13b-94855123457b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:26:12.333202 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08274f1f-4734-4d75-b13b-94855123457b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:26:12.335034 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08274f1f-4734-4d75-b13b-94855123457b service nova] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:26:12.354295 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 687/1376] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:26:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:26:14.281714 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53b8671-fe1c-4ca6-8f6e-0ef4c3b38084 None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:26:14.282303 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53b8671-fe1c-4ca6-8f6e-0ef4c3b38084 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:26:14.282303 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53b8671-fe1c-4ca6-8f6e-0ef4c3b38084 None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:26:14.283714 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 690/1377] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:26:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:26:14.289483 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdcb13e-f652-4d71-a3b7-b32e020c6450 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:26:14.289907 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdcb13e-f652-4d71-a3b7-b32e020c6450 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:26:14.290047 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdcb13e-f652-4d71-a3b7-b32e020c6450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:26:14.369354 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-9cdcb13e-f652-4d71-a3b7-b32e020c6450 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:26:14.370612 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-9cdcb13e-f652-4d71-a3b7-b32e020c6450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:26:14.378306 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:26:14.495073 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 688/1378] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:26:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:26:14.791069 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53b8671-fe1c-4ca6-8f6e-0ef4c3b38084 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:26:14.792593 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-e53b8671-fe1c-4ca6-8f6e-0ef4c3b38084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:26:14.993964 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53b8671-fe1c-4ca6-8f6e-0ef4c3b38084 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:26:15.000200 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:26:15.127943 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3da1b06-19ff-4319-868c-9e2de8f9264f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '282ec32864d046b2bea170f6a3845cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:26:15.128925 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3da1b06-19ff-4319-868c-9e2de8f9264f service nova] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:26:15.129213 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3da1b06-19ff-4319-868c-9e2de8f9264f service nova] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:26:15.129498 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3da1b06-19ff-4319-868c-9e2de8f9264f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:26:15.131284 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-f3da1b06-19ff-4319-868c-9e2de8f9264f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:26:15.233396 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3da1b06-19ff-4319-868c-9e2de8f9264f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:26:15.235216 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3da1b06-19ff-4319-868c-9e2de8f9264f service nova] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:26:15.254966 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 691/1379] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:26:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:26:17.180923 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760f7e25-ee8a-4d90-854b-ec27d13b07ef None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:26:17.181476 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760f7e25-ee8a-4d90-854b-ec27d13b07ef None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:26:17.181476 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760f7e25-ee8a-4d90-854b-ec27d13b07ef None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:26:17.183066 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 689/1380] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:26:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:26:17.188533 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e65ffb-24cc-4587-9408-fb70adfec7be None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:26:17.189010 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e65ffb-24cc-4587-9408-fb70adfec7be None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:26:17.189010 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e65ffb-24cc-4587-9408-fb70adfec7be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:26:17.201712 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:26:17.261449 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-73e65ffb-24cc-4587-9408-fb70adfec7be None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:26:17.262809 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-73e65ffb-24cc-4587-9408-fb70adfec7be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:26:17.364804 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 692/1381] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:26:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 11:26:17.650096 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760f7e25-ee8a-4d90-854b-ec27d13b07ef None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:26:17.651808 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-760f7e25-ee8a-4d90-854b-ec27d13b07ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:26:17.809222 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:26:17.821041 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760f7e25-ee8a-4d90-854b-ec27d13b07ef None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:26:17.954057 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40657c4-a6cd-474d-8975-c5839c14d823 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '282ec32864d046b2bea170f6a3845cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:26:17.954057 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40657c4-a6cd-474d-8975-c5839c14d823 service nova] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:26:17.954057 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40657c4-a6cd-474d-8975-c5839c14d823 service nova] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:26:17.954057 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40657c4-a6cd-474d-8975-c5839c14d823 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:26:17.954548 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-b40657c4-a6cd-474d-8975-c5839c14d823 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:26:18.057244 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40657c4-a6cd-474d-8975-c5839c14d823 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:26:18.059110 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40657c4-a6cd-474d-8975-c5839c14d823 service nova] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:26:18.070963 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:26:18.081085 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 690/1382] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:26:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:26:20.017853 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbba058-2796-4c98-931c-d37f78a0e4f0 None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:26:20.018629 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbba058-2796-4c98-931c-d37f78a0e4f0 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:26:20.018629 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbba058-2796-4c98-931c-d37f78a0e4f0 None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:26:20.020195 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 693/1383] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:26:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:26:20.026378 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bfc42b-a894-476f-92b1-990181bba0ef None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:26:20.026883 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bfc42b-a894-476f-92b1-990181bba0ef None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:26:20.027126 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bfc42b-a894-476f-92b1-990181bba0ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:26:20.109160 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-23bfc42b-a894-476f-92b1-990181bba0ef None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:26:20.110752 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-23bfc42b-a894-476f-92b1-990181bba0ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:26:20.209263 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 691/1384] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:26:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:26:20.497022 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbba058-2796-4c98-931c-d37f78a0e4f0 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:26:20.499128 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-8bbba058-2796-4c98-931c-d37f78a0e4f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:26:20.600683 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:26:20.677044 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbba058-2796-4c98-931c-d37f78a0e4f0 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:26:20.810986 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3f5427-5e2e-4b9c-a159-dd4a1bcb2233 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '282ec32864d046b2bea170f6a3845cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:26:20.811661 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3f5427-5e2e-4b9c-a159-dd4a1bcb2233 service nova] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:26:20.812081 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3f5427-5e2e-4b9c-a159-dd4a1bcb2233 service nova] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:26:20.812427 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3f5427-5e2e-4b9c-a159-dd4a1bcb2233 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:26:20.814548 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-1f3f5427-5e2e-4b9c-a159-dd4a1bcb2233 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:26:20.878953 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:26:20.947278 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3f5427-5e2e-4b9c-a159-dd4a1bcb2233 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:26:20.950212 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3f5427-5e2e-4b9c-a159-dd4a1bcb2233 service nova] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:26:20.974338 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 694/1385] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:26:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:26:22.958544 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7123f47c-287c-4622-8f83-2a979036e377 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:26:22.959210 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7123f47c-287c-4622-8f83-2a979036e377 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:26:22.959210 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7123f47c-287c-4622-8f83-2a979036e377 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:26:22.960572 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 692/1386] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:26:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:26:22.966597 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c46d0f8-1bea-43e7-b33f-6a9d20e6a95e None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:26:22.967225 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c46d0f8-1bea-43e7-b33f-6a9d20e6a95e None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:26:22.967225 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c46d0f8-1bea-43e7-b33f-6a9d20e6a95e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:26:23.038259 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-1c46d0f8-1bea-43e7-b33f-6a9d20e6a95e None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:26:23.039541 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-1c46d0f8-1bea-43e7-b33f-6a9d20e6a95e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:26:23.142218 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 695/1387] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:26:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:26:23.423825 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7123f47c-287c-4622-8f83-2a979036e377 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:26:23.425887 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-7123f47c-287c-4622-8f83-2a979036e377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:26:23.519742 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:26:23.597087 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7123f47c-287c-4622-8f83-2a979036e377 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:26:23.716774 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1431098-f44c-4b5e-af18-da1725597b87 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '282ec32864d046b2bea170f6a3845cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:26:23.717232 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1431098-f44c-4b5e-af18-da1725597b87 service nova] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:26:23.717511 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1431098-f44c-4b5e-af18-da1725597b87 service nova] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:26:23.717780 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1431098-f44c-4b5e-af18-da1725597b87 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:26:23.719429 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-b1431098-f44c-4b5e-af18-da1725597b87 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:26:23.761701 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:26:23.824817 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1431098-f44c-4b5e-af18-da1725597b87 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:26:23.826492 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1431098-f44c-4b5e-af18-da1725597b87 service nova] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:26:23.845447 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 693/1388] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:26:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:26:25.892069 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a62ba27-ad21-4362-a89f-f66b6a305e12 None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:26:25.892678 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a62ba27-ad21-4362-a89f-f66b6a305e12 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:26:25.892678 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a62ba27-ad21-4362-a89f-f66b6a305e12 None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:26:25.893974 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 696/1389] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:26:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:26:25.899470 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3894ad32-2f66-4a88-b5e0-64aea01e37e3 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:26:25.899953 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3894ad32-2f66-4a88-b5e0-64aea01e37e3 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:26:25.899953 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3894ad32-2f66-4a88-b5e0-64aea01e37e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:26:25.967328 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-3894ad32-2f66-4a88-b5e0-64aea01e37e3 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:26:25.968548 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-3894ad32-2f66-4a88-b5e0-64aea01e37e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:26:26.068577 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 694/1390] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:26:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:26:26.353618 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a62ba27-ad21-4362-a89f-f66b6a305e12 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:26:26.355203 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-2a62ba27-ad21-4362-a89f-f66b6a305e12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:26:26.389318 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:26:26.396428 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8874093-6992-4d8f-b84e-d853dd5fb66b None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:26:26.396724 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8874093-6992-4d8f-b84e-d853dd5fb66b None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:26:26.396974 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8874093-6992-4d8f-b84e-d853dd5fb66b None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:26:26.398387 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 695/1391] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:26:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:26:26.403428 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c162482-27eb-4b72-9486-337f2125945f None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:26:26.403715 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c162482-27eb-4b72-9486-337f2125945f None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:26:26.403973 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c162482-27eb-4b72-9486-337f2125945f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:26:26.419227 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:26:26.471492 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-8c162482-27eb-4b72-9486-337f2125945f None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:26:26.473099 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-8c162482-27eb-4b72-9486-337f2125945f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:26:26.517329 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a62ba27-ad21-4362-a89f-f66b6a305e12 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:26:26.578178 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 696/1392] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:26:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 11:26:26.622187 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:26:26.634346 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f21d50-3a70-46ab-bbef-ad308e92f862 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '282ec32864d046b2bea170f6a3845cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:26:26.634978 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f21d50-3a70-46ab-bbef-ad308e92f862 service nova] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:26:26.635245 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f21d50-3a70-46ab-bbef-ad308e92f862 service nova] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:26:26.635510 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f21d50-3a70-46ab-bbef-ad308e92f862 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:26:26.637108 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-b6f21d50-3a70-46ab-bbef-ad308e92f862 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:26:26.848275 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f21d50-3a70-46ab-bbef-ad308e92f862 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:26:26.849912 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f21d50-3a70-46ab-bbef-ad308e92f862 service nova] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:26:26.868193 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 697/1393] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:26:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 515 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:26:26.893186 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557436d6-f194-4814-a053-7f0fb8826a62 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:26:26.893472 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557436d6-f194-4814-a053-7f0fb8826a62 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:26:26.893748 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557436d6-f194-4814-a053-7f0fb8826a62 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:26:26.898527 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 697/1394] 10.222.0.27 () {54 vars in 967 bytes} [Wed Aug 24 11:26:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:26:26.900654 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d134cf14-cbb4-4b41-afc1-974e2eced563 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:26:26.901203 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d134cf14-cbb4-4b41-afc1-974e2eced563 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:26:26.901203 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d134cf14-cbb4-4b41-afc1-974e2eced563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:26:26.984551 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-d134cf14-cbb4-4b41-afc1-974e2eced563 None None] MFA Rules not processed for user `abffba24649e49d28a01cbee51924ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:26:26.985789 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-d134cf14-cbb4-4b41-afc1-974e2eced563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:26:27.053987 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:26:27.081384 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 698/1395] 10.222.0.27 () {58 vars in 1064 bytes} [Wed Aug 24 11:26:26 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 11:26:27.089951 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557436d6-f194-4814-a053-7f0fb8826a62 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:26:27.092360 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-557436d6-f194-4814-a053-7f0fb8826a62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:26:27.194176 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:26:27.201029 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557436d6-f194-4814-a053-7f0fb8826a62 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:26:27.275287 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89da8646-88b4-4421-9fa3-9b6c0fe658c7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abffba24649e49d28a01cbee51924ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:26:27.275888 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89da8646-88b4-4421-9fa3-9b6c0fe658c7 service glance] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:26:27.276157 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89da8646-88b4-4421-9fa3-9b6c0fe658c7 service glance] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:26:27.276420 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89da8646-88b4-4421-9fa3-9b6c0fe658c7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:26:27.277995 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-89da8646-88b4-4421-9fa3-9b6c0fe658c7 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:26:27.388278 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89da8646-88b4-4421-9fa3-9b6c0fe658c7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:26:27.389731 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89da8646-88b4-4421-9fa3-9b6c0fe658c7 service glance] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:26:27.408788 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 698/1396] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:26:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:26:28.140563 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66728dcd-01b3-46df-bffc-67f07cf97cc4 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:26:28.141079 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66728dcd-01b3-46df-bffc-67f07cf97cc4 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:26:28.141589 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66728dcd-01b3-46df-bffc-67f07cf97cc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:26:28.213729 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-66728dcd-01b3-46df-bffc-67f07cf97cc4 None None] MFA Rules not processed for user `a5915030f01941fc89f92228ff57c7f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:26:28.214967 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-66728dcd-01b3-46df-bffc-67f07cf97cc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:26:28.304623 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 699/1397] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Aug 24 11:26:28 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:26:28.347750 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60f65e6-f442-4af3-a7c4-314b268b814c None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:26:28.348273 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60f65e6-f442-4af3-a7c4-314b268b814c None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:26:28.348370 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60f65e6-f442-4af3-a7c4-314b268b814c None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:26:28.349878 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 699/1398] 10.222.0.27 () {54 vars in 943 bytes} [Wed Aug 24 11:26:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:26:28.356464 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441d23bb-1ede-4b7c-8377-6c5756c4268a None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:26:28.356746 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441d23bb-1ede-4b7c-8377-6c5756c4268a None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:26:28.356985 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441d23bb-1ede-4b7c-8377-6c5756c4268a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:26:28.436224 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-441d23bb-1ede-4b7c-8377-6c5756c4268a None None] MFA Rules not processed for user `f1069558c085449f9e4c9f06013b2a85`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:26:28.437478 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-441d23bb-1ede-4b7c-8377-6c5756c4268a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:26:28.452438 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:26:28.549498 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 700/1399] 10.222.0.27 () {58 vars in 1040 bytes} [Wed Aug 24 11:26:28 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:26:28.560072 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60f65e6-f442-4af3-a7c4-314b268b814c None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:26:28.561583 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-c60f65e6-f442-4af3-a7c4-314b268b814c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:26:28.585785 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:26:28.703965 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60f65e6-f442-4af3-a7c4-314b268b814c None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:26:28.807150 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b055897f-db0b-452f-9ce9-b25efc0fd1a8 None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:26:28.807594 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b055897f-db0b-452f-9ce9-b25efc0fd1a8 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:26:28.807883 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b055897f-db0b-452f-9ce9-b25efc0fd1a8 None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:26:28.809196 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d4209a-6bc7-411a-9733-539a7349fc76 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1069558c085449f9e4c9f06013b2a85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:26:28.809348 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 701/1400] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:26:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:26:28.809808 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d4209a-6bc7-411a-9733-539a7349fc76 service swift] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:26:28.810082 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d4209a-6bc7-411a-9733-539a7349fc76 service swift] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:26:28.810376 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d4209a-6bc7-411a-9733-539a7349fc76 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:26:28.812024 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-b0d4209a-6bc7-411a-9733-539a7349fc76 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:26:28.814478 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f971e5ac-8d88-4e25-a4ba-75fc44e2c0a2 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:26:28.814701 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f971e5ac-8d88-4e25-a4ba-75fc44e2c0a2 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:26:28.814973 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f971e5ac-8d88-4e25-a4ba-75fc44e2c0a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:26:28.819567 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:26:28.880130 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-f971e5ac-8d88-4e25-a4ba-75fc44e2c0a2 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:26:28.881354 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-f971e5ac-8d88-4e25-a4ba-75fc44e2c0a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:26:28.901362 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d4209a-6bc7-411a-9733-539a7349fc76 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:26:28.903127 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d4209a-6bc7-411a-9733-539a7349fc76 service swift] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:26:28.911909 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 700/1401] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Aug 24 11:26:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 11:26:28.960630 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:26:28.983571 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 702/1402] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:26:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 11:26:29.279605 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d4209a-6bc7-411a-9733-539a7349fc76 service swift] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:26:29.280849 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-b0d4209a-6bc7-411a-9733-539a7349fc76 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:26:29.381119 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d4209a-6bc7-411a-9733-539a7349fc76 service swift] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:26:29.441040 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:26:29.502346 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca311c2-22d0-4b43-a3f4-6f179dd4e1f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '282ec32864d046b2bea170f6a3845cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:26:29.503298 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca311c2-22d0-4b43-a3f4-6f179dd4e1f7 service nova] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:26:29.503560 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca311c2-22d0-4b43-a3f4-6f179dd4e1f7 service nova] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:26:29.503834 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca311c2-22d0-4b43-a3f4-6f179dd4e1f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:26:29.505413 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-9ca311c2-22d0-4b43-a3f4-6f179dd4e1f7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:26:29.609216 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca311c2-22d0-4b43-a3f4-6f179dd4e1f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:26:29.610772 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca311c2-22d0-4b43-a3f4-6f179dd4e1f7 service nova] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:26:29.629267 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 701/1403] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:26:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:26:31.546282 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beed19ca-da44-4b3f-93c1-50aca7174620 None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:26:31.546900 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beed19ca-da44-4b3f-93c1-50aca7174620 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:26:31.546900 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beed19ca-da44-4b3f-93c1-50aca7174620 None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:26:31.548185 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 703/1404] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:26:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:26:31.553984 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57769ae-4504-4d8f-b1cc-90d58c2fcb56 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:26:31.554501 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57769ae-4504-4d8f-b1cc-90d58c2fcb56 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:26:31.554606 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57769ae-4504-4d8f-b1cc-90d58c2fcb56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:26:31.631774 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-b57769ae-4504-4d8f-b1cc-90d58c2fcb56 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:26:31.632990 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-b57769ae-4504-4d8f-b1cc-90d58c2fcb56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:26:31.648266 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:26:31.742629 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 702/1405] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:26:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 11:26:32.025917 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beed19ca-da44-4b3f-93c1-50aca7174620 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:26:32.027477 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-beed19ca-da44-4b3f-93c1-50aca7174620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:26:32.193399 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beed19ca-da44-4b3f-93c1-50aca7174620 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:26:32.256143 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:26:32.320090 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4881b517-8983-41e3-b3e2-3270eadf9dad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '282ec32864d046b2bea170f6a3845cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:26:32.320750 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4881b517-8983-41e3-b3e2-3270eadf9dad service nova] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:26:32.321021 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4881b517-8983-41e3-b3e2-3270eadf9dad service nova] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:26:32.321285 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4881b517-8983-41e3-b3e2-3270eadf9dad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:26:32.323479 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-4881b517-8983-41e3-b3e2-3270eadf9dad service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:26:32.421945 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4881b517-8983-41e3-b3e2-3270eadf9dad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:26:32.423579 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4881b517-8983-41e3-b3e2-3270eadf9dad service nova] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:26:32.444338 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 704/1406] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:26:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:26:34.438092 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6ed453-0702-4543-8bbe-28dee54266f9 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:26:34.438773 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6ed453-0702-4543-8bbe-28dee54266f9 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:26:34.438773 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6ed453-0702-4543-8bbe-28dee54266f9 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:26:34.440117 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 703/1407] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:26:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:26:34.445741 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3ecb39-997b-447f-980e-372e00fb4215 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:26:34.446340 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3ecb39-997b-447f-980e-372e00fb4215 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:26:34.446743 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3ecb39-997b-447f-980e-372e00fb4215 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:26:34.518770 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-5d3ecb39-997b-447f-980e-372e00fb4215 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:26:34.520245 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-5d3ecb39-997b-447f-980e-372e00fb4215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:26:34.540029 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:26:34.627709 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 705/1408] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:26:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:26:34.920110 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6ed453-0702-4543-8bbe-28dee54266f9 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:26:34.923425 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-5a6ed453-0702-4543-8bbe-28dee54266f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:26:35.083606 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:26:35.086479 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6ed453-0702-4543-8bbe-28dee54266f9 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:26:35.212045 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617c2c24-f2c5-4994-87fd-2c2ca2b964a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '282ec32864d046b2bea170f6a3845cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:26:35.212576 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617c2c24-f2c5-4994-87fd-2c2ca2b964a8 service nova] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:26:35.212851 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617c2c24-f2c5-4994-87fd-2c2ca2b964a8 service nova] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:26:35.213114 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617c2c24-f2c5-4994-87fd-2c2ca2b964a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:26:35.214759 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-617c2c24-f2c5-4994-87fd-2c2ca2b964a8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:26:35.318479 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617c2c24-f2c5-4994-87fd-2c2ca2b964a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:26:35.320269 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617c2c24-f2c5-4994-87fd-2c2ca2b964a8 service nova] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:26:35.340291 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 704/1409] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:26:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:26:44.625924 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=35 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:26:45.337699 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=99 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:26:50.890850 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a025c7-d2c1-4802-b334-b742d461d60d None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:26:50.891758 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a025c7-d2c1-4802-b334-b742d461d60d None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:26:50.891758 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a025c7-d2c1-4802-b334-b742d461d60d None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:26:50.893537 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 706/1410] 10.222.0.27 () {54 vars in 918 bytes} [Wed Aug 24 11:26:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:26:50.898952 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7574f6fb-0fba-42a6-98b4-1d5786be153d None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:26:50.899400 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7574f6fb-0fba-42a6-98b4-1d5786be153d None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:26:50.899521 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7574f6fb-0fba-42a6-98b4-1d5786be153d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:26:50.978506 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-7574f6fb-0fba-42a6-98b4-1d5786be153d None None] MFA Rules not processed for user `ad45431e70ff48a9b90905a97d473d81`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:26:50.979734 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-7574f6fb-0fba-42a6-98b4-1d5786be153d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:26:51.103134 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 705/1411] 10.222.0.27 () {58 vars in 1015 bytes} [Wed Aug 24 11:26:50 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:26:51.118012 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d997c723-af6d-4738-8058-5a67440080ea None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:26:51.118293 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d997c723-af6d-4738-8058-5a67440080ea None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:26:51.118608 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d997c723-af6d-4738-8058-5a67440080ea None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:26:51.119978 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 707/1412] 10.222.0.27 () {54 vars in 918 bytes} [Wed Aug 24 11:26:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:26:51.132197 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5732c663-e554-4b2d-b4ea-8f6cbad77237 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:26:51.132489 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5732c663-e554-4b2d-b4ea-8f6cbad77237 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:26:51.132756 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5732c663-e554-4b2d-b4ea-8f6cbad77237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:26:51.210850 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:26:51.213874 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-5732c663-e554-4b2d-b4ea-8f6cbad77237 None None] MFA Rules not processed for user `282ec32864d046b2bea170f6a3845cc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:26:51.215715 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-5732c663-e554-4b2d-b4ea-8f6cbad77237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:26:51.336783 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 706/1413] 10.222.0.27 () {58 vars in 1015 bytes} [Wed Aug 24 11:26:51 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:26:53.732438 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f9deac-7478-4bca-ba77-b38bfc92e245 None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:26:53.733032 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f9deac-7478-4bca-ba77-b38bfc92e245 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:26:53.733032 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f9deac-7478-4bca-ba77-b38bfc92e245 None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:26:53.734344 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 708/1414] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 11:26:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:26:53.740567 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e70231c-1585-4dc6-9516-5075aa1522a9 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:26:53.741053 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e70231c-1585-4dc6-9516-5075aa1522a9 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:26:53.741148 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e70231c-1585-4dc6-9516-5075aa1522a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:26:53.809069 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-6e70231c-1585-4dc6-9516-5075aa1522a9 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:26:53.810195 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-6e70231c-1585-4dc6-9516-5075aa1522a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:26:53.868703 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:26:53.917002 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 707/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 11:26:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:26:54.198982 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f9deac-7478-4bca-ba77-b38bfc92e245 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:26:54.200578 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-b5f9deac-7478-4bca-ba77-b38bfc92e245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:26:54.360646 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f9deac-7478-4bca-ba77-b38bfc92e245 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:26:54.440933 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:26:54.483812 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84d2758-6c3a-4d97-a85a-9d20040cde57 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '282ec32864d046b2bea170f6a3845cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:26:54.484425 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84d2758-6c3a-4d97-a85a-9d20040cde57 service nova] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:26:54.484691 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84d2758-6c3a-4d97-a85a-9d20040cde57 service nova] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:26:54.484956 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84d2758-6c3a-4d97-a85a-9d20040cde57 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:26:54.486635 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-c84d2758-6c3a-4d97-a85a-9d20040cde57 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:26:54.602276 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84d2758-6c3a-4d97-a85a-9d20040cde57 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:26:54.603946 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84d2758-6c3a-4d97-a85a-9d20040cde57 service nova] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:26:54.623100 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 709/1416] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:26:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:26:55.526711 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c07c88e-fbf8-47dc-af1e-e898805a8260 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:26:55.527340 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c07c88e-fbf8-47dc-af1e-e898805a8260 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:26:55.527340 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c07c88e-fbf8-47dc-af1e-e898805a8260 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:26:55.528659 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 708/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 11:26:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:26:55.534921 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b852b3de-ef40-417e-9b70-e484c8ce6687 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:26:55.535710 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b852b3de-ef40-417e-9b70-e484c8ce6687 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:26:55.535710 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b852b3de-ef40-417e-9b70-e484c8ce6687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:26:55.617044 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-b852b3de-ef40-417e-9b70-e484c8ce6687 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:26:55.618246 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-b852b3de-ef40-417e-9b70-e484c8ce6687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:26:55.648590 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:26:55.726829 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 710/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 11:26:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:26:55.877930 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c07c88e-fbf8-47dc-af1e-e898805a8260 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:26:55.879402 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-5c07c88e-fbf8-47dc-af1e-e898805a8260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:26:56.047190 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c07c88e-fbf8-47dc-af1e-e898805a8260 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:26:56.097696 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:26:56.183808 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1409c970-4ecd-4ebb-8894-cd423c8683c1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '282ec32864d046b2bea170f6a3845cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:26:56.184503 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1409c970-4ecd-4ebb-8894-cd423c8683c1 service nova] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:26:56.184830 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1409c970-4ecd-4ebb-8894-cd423c8683c1 service nova] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:26:56.185193 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1409c970-4ecd-4ebb-8894-cd423c8683c1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:26:56.187862 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-1409c970-4ecd-4ebb-8894-cd423c8683c1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:26:56.294459 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1409c970-4ecd-4ebb-8894-cd423c8683c1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:26:56.296105 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1409c970-4ecd-4ebb-8894-cd423c8683c1 service nova] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:26:56.315335 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 709/1419] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:26:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:26:57.180172 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303420d2-53d5-41e8-9a92-4fc477176fb9 None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:26:57.181070 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303420d2-53d5-41e8-9a92-4fc477176fb9 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:26:57.181070 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303420d2-53d5-41e8-9a92-4fc477176fb9 None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:26:57.183343 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 711/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 11:26:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:26:57.191758 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f44b84-d5b1-494f-b846-841e2ba025a1 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:26:57.192612 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f44b84-d5b1-494f-b846-841e2ba025a1 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:26:57.192786 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f44b84-d5b1-494f-b846-841e2ba025a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:26:57.248726 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:26:57.271728 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-a6f44b84-d5b1-494f-b846-841e2ba025a1 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:26:57.272951 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-a6f44b84-d5b1-494f-b846-841e2ba025a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:26:57.373772 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 710/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 11:26:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:26:57.527486 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303420d2-53d5-41e8-9a92-4fc477176fb9 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:26:57.529073 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-303420d2-53d5-41e8-9a92-4fc477176fb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:26:57.687648 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303420d2-53d5-41e8-9a92-4fc477176fb9 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:26:57.700446 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:26:57.809401 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58185695-f77e-4ce4-9d76-492d8ee45726 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '282ec32864d046b2bea170f6a3845cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:26:57.810025 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58185695-f77e-4ce4-9d76-492d8ee45726 service nova] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:26:57.810303 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58185695-f77e-4ce4-9d76-492d8ee45726 service nova] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:26:57.810602 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58185695-f77e-4ce4-9d76-492d8ee45726 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:26:57.812256 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-58185695-f77e-4ce4-9d76-492d8ee45726 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:26:57.914234 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58185695-f77e-4ce4-9d76-492d8ee45726 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:26:57.916131 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58185695-f77e-4ce4-9d76-492d8ee45726 service nova] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:26:57.936100 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 712/1422] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:26:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:26:58.800549 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39972a41-3f9b-47b9-a7fb-333e1957bbaa None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:26:58.801135 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39972a41-3f9b-47b9-a7fb-333e1957bbaa None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:26:58.801135 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39972a41-3f9b-47b9-a7fb-333e1957bbaa None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:26:58.803129 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 711/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 11:26:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:26:58.808599 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7c4a99-c818-4d30-95d7-1f7b4a244a66 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:26:58.809113 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7c4a99-c818-4d30-95d7-1f7b4a244a66 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:26:58.809113 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7c4a99-c818-4d30-95d7-1f7b4a244a66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:26:58.830760 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:26:58.888033 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-fd7c4a99-c818-4d30-95d7-1f7b4a244a66 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:26:58.889296 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-fd7c4a99-c818-4d30-95d7-1f7b4a244a66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:26:58.996475 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 713/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 11:26:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 11:26:59.148252 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39972a41-3f9b-47b9-a7fb-333e1957bbaa None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:26:59.149810 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-39972a41-3f9b-47b9-a7fb-333e1957bbaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:26:59.271993 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:26:59.312461 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39972a41-3f9b-47b9-a7fb-333e1957bbaa None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:26:59.437871 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaccce59-4d5f-4341-9067-f511705f21e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '282ec32864d046b2bea170f6a3845cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:26:59.438506 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaccce59-4d5f-4341-9067-f511705f21e0 service nova] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:26:59.438773 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaccce59-4d5f-4341-9067-f511705f21e0 service nova] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:26:59.439043 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaccce59-4d5f-4341-9067-f511705f21e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:26:59.440651 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-eaccce59-4d5f-4341-9067-f511705f21e0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:26:59.520700 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:26:59.535283 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaccce59-4d5f-4341-9067-f511705f21e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:26:59.536894 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaccce59-4d5f-4341-9067-f511705f21e0 service nova] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:26:59.556102 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 712/1425] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:26:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:27:00.413177 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e947f99b-f181-487d-adbd-b60465d688be None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:27:00.414050 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e947f99b-f181-487d-adbd-b60465d688be None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:27:00.414050 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e947f99b-f181-487d-adbd-b60465d688be None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:27:00.416149 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 714/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 11:27:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:27:00.424660 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84fae93-4607-4859-9b16-eeb089273f85 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:27:00.425092 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84fae93-4607-4859-9b16-eeb089273f85 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:27:00.425299 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84fae93-4607-4859-9b16-eeb089273f85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:27:00.505213 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-e84fae93-4607-4859-9b16-eeb089273f85 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:27:00.506482 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-e84fae93-4607-4859-9b16-eeb089273f85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:27:00.605465 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 713/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 11:27:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:27:00.767479 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e947f99b-f181-487d-adbd-b60465d688be None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:27:00.770014 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-e947f99b-f181-487d-adbd-b60465d688be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:27:00.869741 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:27:00.936596 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e947f99b-f181-487d-adbd-b60465d688be None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:27:01.050777 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3073e673-e468-449c-b5ef-28c23fd6718c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '282ec32864d046b2bea170f6a3845cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:27:01.051268 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3073e673-e468-449c-b5ef-28c23fd6718c service nova] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:27:01.051537 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3073e673-e468-449c-b5ef-28c23fd6718c service nova] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:27:01.051785 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3073e673-e468-449c-b5ef-28c23fd6718c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:27:01.053443 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-3073e673-e468-449c-b5ef-28c23fd6718c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:27:01.105662 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:27:01.149432 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3073e673-e468-449c-b5ef-28c23fd6718c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:27:01.151919 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3073e673-e468-449c-b5ef-28c23fd6718c service nova] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:27:01.179300 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 715/1428] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:27:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:27:01.984736 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86471287-0280-49fd-850b-cc12b7370350 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:27:01.985283 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86471287-0280-49fd-850b-cc12b7370350 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:27:01.985283 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86471287-0280-49fd-850b-cc12b7370350 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:27:01.986673 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 714/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 11:27:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:27:01.991980 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a89790-9ec7-4dbd-b60c-29b2f86c3234 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:27:01.992429 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a89790-9ec7-4dbd-b60c-29b2f86c3234 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:27:01.992534 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a89790-9ec7-4dbd-b60c-29b2f86c3234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:27:02.089488 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-e5a89790-9ec7-4dbd-b60c-29b2f86c3234 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:27:02.090761 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-e5a89790-9ec7-4dbd-b60c-29b2f86c3234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:27:02.194773 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 716/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 11:27:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:27:02.348772 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86471287-0280-49fd-850b-cc12b7370350 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:27:02.351966 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-86471287-0280-49fd-850b-cc12b7370350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:27:02.415562 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:27:02.519347 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86471287-0280-49fd-850b-cc12b7370350 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:27:02.639231 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0e6c22-0797-4f4d-bba2-a93bddcf0d57 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '282ec32864d046b2bea170f6a3845cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:27:02.639841 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0e6c22-0797-4f4d-bba2-a93bddcf0d57 service nova] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:27:02.640113 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0e6c22-0797-4f4d-bba2-a93bddcf0d57 service nova] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:27:02.640378 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0e6c22-0797-4f4d-bba2-a93bddcf0d57 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:27:02.642405 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-dd0e6c22-0797-4f4d-bba2-a93bddcf0d57 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:27:02.650011 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:27:02.735817 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0e6c22-0797-4f4d-bba2-a93bddcf0d57 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:27:02.737446 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0e6c22-0797-4f4d-bba2-a93bddcf0d57 service nova] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:27:02.755308 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 715/1431] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:27:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:27:03.569199 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08254cf-bbcc-4a78-bf67-bd2fbd2b35f4 None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:27:03.569886 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08254cf-bbcc-4a78-bf67-bd2fbd2b35f4 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:27:03.569886 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08254cf-bbcc-4a78-bf67-bd2fbd2b35f4 None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:27:03.571698 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 717/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 11:27:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:27:03.578790 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86637642-4313-4987-b089-e5c590c92117 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:27:03.579296 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86637642-4313-4987-b089-e5c590c92117 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:27:03.579296 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86637642-4313-4987-b089-e5c590c92117 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:27:03.660833 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-86637642-4313-4987-b089-e5c590c92117 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:27:03.662184 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-86637642-4313-4987-b089-e5c590c92117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:27:03.745892 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:27:03.776676 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 716/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 11:27:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:27:03.928545 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08254cf-bbcc-4a78-bf67-bd2fbd2b35f4 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:27:03.930220 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-f08254cf-bbcc-4a78-bf67-bd2fbd2b35f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:27:03.950218 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:27:04.091095 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08254cf-bbcc-4a78-bf67-bd2fbd2b35f4 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:27:04.184735 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:27:04.213156 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861a3a3b-500f-462e-a5b7-f0f6adabf947 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '282ec32864d046b2bea170f6a3845cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:27:04.213774 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861a3a3b-500f-462e-a5b7-f0f6adabf947 service nova] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:27:04.214040 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861a3a3b-500f-462e-a5b7-f0f6adabf947 service nova] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:27:04.214309 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861a3a3b-500f-462e-a5b7-f0f6adabf947 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:27:04.215946 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-861a3a3b-500f-462e-a5b7-f0f6adabf947 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:27:04.313641 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861a3a3b-500f-462e-a5b7-f0f6adabf947 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:27:04.315385 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861a3a3b-500f-462e-a5b7-f0f6adabf947 service nova] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:27:04.335001 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 718/1434] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:27:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:27:05.145992 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685e32b4-ad29-41da-ae57-2819280027da None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:27:05.146600 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685e32b4-ad29-41da-ae57-2819280027da None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:27:05.146600 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685e32b4-ad29-41da-ae57-2819280027da None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:27:05.147959 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 717/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 11:27:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:27:05.153982 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3084e6a-97ee-47b8-bb7f-94e26df2eccf None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:27:05.154465 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3084e6a-97ee-47b8-bb7f-94e26df2eccf None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:27:05.154581 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3084e6a-97ee-47b8-bb7f-94e26df2eccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:27:05.236193 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-c3084e6a-97ee-47b8-bb7f-94e26df2eccf None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:27:05.238225 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-c3084e6a-97ee-47b8-bb7f-94e26df2eccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:27:05.289330 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:27:05.346839 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 719/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 11:27:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:27:05.496655 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685e32b4-ad29-41da-ae57-2819280027da None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:27:05.498173 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-685e32b4-ad29-41da-ae57-2819280027da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:27:05.647335 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685e32b4-ad29-41da-ae57-2819280027da None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:27:05.704647 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:27:05.765064 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdc0b33-1890-4c14-91ff-ca8b21add3f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '282ec32864d046b2bea170f6a3845cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:27:05.765665 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdc0b33-1890-4c14-91ff-ca8b21add3f3 service nova] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:27:05.766279 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdc0b33-1890-4c14-91ff-ca8b21add3f3 service nova] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:27:05.766573 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdc0b33-1890-4c14-91ff-ca8b21add3f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:27:05.768162 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-7cdc0b33-1890-4c14-91ff-ca8b21add3f3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:27:05.869812 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdc0b33-1890-4c14-91ff-ca8b21add3f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:27:05.871496 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdc0b33-1890-4c14-91ff-ca8b21add3f3 service nova] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:27:05.891991 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 718/1437] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:27:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 11:27:06.711841 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49d7de3-e923-4100-ba24-357a42a9f50e None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:27:06.712542 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49d7de3-e923-4100-ba24-357a42a9f50e None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:27:06.712542 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49d7de3-e923-4100-ba24-357a42a9f50e None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:27:06.714498 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 720/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 11:27:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:27:06.720738 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85281a8-3e92-44ee-80d1-dde5dfad6d4b None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:27:06.721262 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85281a8-3e92-44ee-80d1-dde5dfad6d4b None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:27:06.721367 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85281a8-3e92-44ee-80d1-dde5dfad6d4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:27:06.812345 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-a85281a8-3e92-44ee-80d1-dde5dfad6d4b None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:27:06.813541 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-a85281a8-3e92-44ee-80d1-dde5dfad6d4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:27:06.815613 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:27:06.927477 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 719/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 11:27:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:27:07.082171 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49d7de3-e923-4100-ba24-357a42a9f50e None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:27:07.084651 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-e49d7de3-e923-4100-ba24-357a42a9f50e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:27:07.245614 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49d7de3-e923-4100-ba24-357a42a9f50e None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:27:07.275505 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:27:07.373894 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d661009b-2ae5-47db-b4f4-1912eca4f7ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '282ec32864d046b2bea170f6a3845cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:27:07.374410 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d661009b-2ae5-47db-b4f4-1912eca4f7ab service nova] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:27:07.374719 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d661009b-2ae5-47db-b4f4-1912eca4f7ab service nova] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:27:07.374986 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d661009b-2ae5-47db-b4f4-1912eca4f7ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:27:07.376643 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-d661009b-2ae5-47db-b4f4-1912eca4f7ab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:27:07.484071 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d661009b-2ae5-47db-b4f4-1912eca4f7ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:27:07.485698 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d661009b-2ae5-47db-b4f4-1912eca4f7ab service nova] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:27:07.505100 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 721/1440] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:27:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:27:09.316029 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a362862-ab17-4f8c-890a-864e7dbae84d None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:27:09.316651 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a362862-ab17-4f8c-890a-864e7dbae84d None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:27:09.316651 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a362862-ab17-4f8c-890a-864e7dbae84d None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:27:09.317935 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 720/1441] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 11:27:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:27:09.324640 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc0b4eb-4387-4156-bebb-dd12ab1c7328 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:27:09.325115 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc0b4eb-4387-4156-bebb-dd12ab1c7328 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:27:09.325229 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc0b4eb-4387-4156-bebb-dd12ab1c7328 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:27:09.369142 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:27:09.397403 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-1dc0b4eb-4387-4156-bebb-dd12ab1c7328 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:27:09.405286 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-1dc0b4eb-4387-4156-bebb-dd12ab1c7328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:27:09.505263 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 722/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 11:27:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:27:09.789792 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a362862-ab17-4f8c-890a-864e7dbae84d None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:27:09.791402 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-5a362862-ab17-4f8c-890a-864e7dbae84d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:27:09.903352 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a362862-ab17-4f8c-890a-864e7dbae84d None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:27:09.935864 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:27:09.977913 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9475eda1-64d2-4b29-84a3-af65b3d1fd9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2d061d25d83443c9232218c90792d51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:27:09.978539 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9475eda1-64d2-4b29-84a3-af65b3d1fd9f service neutron] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:27:09.978809 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9475eda1-64d2-4b29-84a3-af65b3d1fd9f service neutron] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:27:09.979076 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9475eda1-64d2-4b29-84a3-af65b3d1fd9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:27:09.980661 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-9475eda1-64d2-4b29-84a3-af65b3d1fd9f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:27:10.106067 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9475eda1-64d2-4b29-84a3-af65b3d1fd9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:27:10.108301 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9475eda1-64d2-4b29-84a3-af65b3d1fd9f service neutron] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:27:10.129476 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 721/1443] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:27:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:27:12.278958 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d97c62b-00e8-4763-a809-992b1cefc66e None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:27:12.279572 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d97c62b-00e8-4763-a809-992b1cefc66e None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:27:12.279572 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d97c62b-00e8-4763-a809-992b1cefc66e None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:27:12.280823 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 723/1444] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 11:27:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:27:12.286109 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e5708e-c581-4752-b9dc-fb60e4077d55 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:27:12.286591 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e5708e-c581-4752-b9dc-fb60e4077d55 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:27:12.286696 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e5708e-c581-4752-b9dc-fb60e4077d55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:27:12.366974 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-47e5708e-c581-4752-b9dc-fb60e4077d55 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:27:12.368203 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-47e5708e-c581-4752-b9dc-fb60e4077d55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:27:12.382258 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:27:12.477479 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 722/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 11:27:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:27:12.769352 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d97c62b-00e8-4763-a809-992b1cefc66e None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:27:12.771375 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-4d97c62b-00e8-4763-a809-992b1cefc66e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:27:12.886968 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d97c62b-00e8-4763-a809-992b1cefc66e None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:27:12.900143 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:27:12.969734 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07733b17-90e3-4207-8b00-f93d83ab1380 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2d061d25d83443c9232218c90792d51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:27:12.970417 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07733b17-90e3-4207-8b00-f93d83ab1380 service neutron] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:27:12.970696 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07733b17-90e3-4207-8b00-f93d83ab1380 service neutron] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:27:12.970969 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07733b17-90e3-4207-8b00-f93d83ab1380 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:27:12.972689 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-07733b17-90e3-4207-8b00-f93d83ab1380 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:27:13.098242 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07733b17-90e3-4207-8b00-f93d83ab1380 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:27:13.099759 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07733b17-90e3-4207-8b00-f93d83ab1380 service neutron] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:27:13.119838 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 724/1446] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:27:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:27:15.338339 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c1e5b5-71c4-4445-b5be-1cd8befe18ca None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:27:15.338954 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c1e5b5-71c4-4445-b5be-1cd8befe18ca None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:27:15.338954 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c1e5b5-71c4-4445-b5be-1cd8befe18ca None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:27:15.340251 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 723/1447] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 11:27:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:27:15.346751 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5d7ed5-8e4a-4227-b8c1-416b7e8efa05 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:27:15.347510 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5d7ed5-8e4a-4227-b8c1-416b7e8efa05 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:27:15.347702 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5d7ed5-8e4a-4227-b8c1-416b7e8efa05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:27:15.406475 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:27:15.426082 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-fa5d7ed5-8e4a-4227-b8c1-416b7e8efa05 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:27:15.427337 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-fa5d7ed5-8e4a-4227-b8c1-416b7e8efa05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:27:15.540623 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 725/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 11:27:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:27:15.836603 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c1e5b5-71c4-4445-b5be-1cd8befe18ca None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:27:15.839214 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-34c1e5b5-71c4-4445-b5be-1cd8befe18ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:27:15.960155 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c1e5b5-71c4-4445-b5be-1cd8befe18ca None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:27:16.001737 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:27:16.038964 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827030eb-b5c5-4066-9aff-792ef3cc798f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2d061d25d83443c9232218c90792d51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:27:16.039611 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827030eb-b5c5-4066-9aff-792ef3cc798f service neutron] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:27:16.039918 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827030eb-b5c5-4066-9aff-792ef3cc798f service neutron] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:27:16.040208 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827030eb-b5c5-4066-9aff-792ef3cc798f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:27:16.041840 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-827030eb-b5c5-4066-9aff-792ef3cc798f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:27:16.165279 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827030eb-b5c5-4066-9aff-792ef3cc798f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:27:16.167001 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827030eb-b5c5-4066-9aff-792ef3cc798f service neutron] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:27:16.192662 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 724/1449] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:27:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:27:18.221164 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fd3c1e-dbe6-4e4d-bb74-ca3e22aeb5c9 None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:27:18.221742 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fd3c1e-dbe6-4e4d-bb74-ca3e22aeb5c9 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:27:18.221742 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fd3c1e-dbe6-4e4d-bb74-ca3e22aeb5c9 None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:27:18.223111 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 726/1450] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 11:27:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:27:18.228596 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecfcfaf-0a12-42f0-82eb-6ce6573afe4a None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:27:18.229089 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecfcfaf-0a12-42f0-82eb-6ce6573afe4a None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:27:18.229182 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecfcfaf-0a12-42f0-82eb-6ce6573afe4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:27:18.298577 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-1ecfcfaf-0a12-42f0-82eb-6ce6573afe4a None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:27:18.299823 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-1ecfcfaf-0a12-42f0-82eb-6ce6573afe4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:27:18.322714 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:27:18.402506 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 725/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 11:27:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:27:18.689887 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fd3c1e-dbe6-4e4d-bb74-ca3e22aeb5c9 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:27:18.692579 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-77fd3c1e-dbe6-4e4d-bb74-ca3e22aeb5c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:27:18.801485 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fd3c1e-dbe6-4e4d-bb74-ca3e22aeb5c9 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:27:18.823071 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:27:18.878635 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98be6eca-902b-4b84-86cd-703533cb70c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2d061d25d83443c9232218c90792d51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:27:18.879240 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98be6eca-902b-4b84-86cd-703533cb70c7 service neutron] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:27:18.879509 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98be6eca-902b-4b84-86cd-703533cb70c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:27:18.879773 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98be6eca-902b-4b84-86cd-703533cb70c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:27:18.881485 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-98be6eca-902b-4b84-86cd-703533cb70c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:27:19.007192 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98be6eca-902b-4b84-86cd-703533cb70c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:27:19.008689 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98be6eca-902b-4b84-86cd-703533cb70c7 service neutron] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:27:19.029409 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 727/1452] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:27:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:27:21.004989 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87729269-d44a-484e-9bb5-b5a17865e94f None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:27:21.005929 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87729269-d44a-484e-9bb5-b5a17865e94f None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:27:21.005929 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87729269-d44a-484e-9bb5-b5a17865e94f None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:27:21.007304 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 726/1453] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 11:27:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:27:21.013737 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c4294a-2c97-409f-9447-20dfbfdda559 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:27:21.014183 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c4294a-2c97-409f-9447-20dfbfdda559 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:27:21.014322 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c4294a-2c97-409f-9447-20dfbfdda559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:27:21.093600 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:27:21.097735 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-08c4294a-2c97-409f-9447-20dfbfdda559 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:27:21.099500 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-08c4294a-2c97-409f-9447-20dfbfdda559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:27:21.198392 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 728/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 11:27:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:27:21.486274 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87729269-d44a-484e-9bb5-b5a17865e94f None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:27:21.488828 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-87729269-d44a-484e-9bb5-b5a17865e94f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:27:21.605193 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87729269-d44a-484e-9bb5-b5a17865e94f None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:27:21.658813 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:27:21.685380 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6823f439-0532-4bbd-8648-c3a867d68b85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2d061d25d83443c9232218c90792d51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:27:21.686036 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6823f439-0532-4bbd-8648-c3a867d68b85 service neutron] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:27:21.686287 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6823f439-0532-4bbd-8648-c3a867d68b85 service neutron] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:27:21.686666 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6823f439-0532-4bbd-8648-c3a867d68b85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:27:21.688354 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-6823f439-0532-4bbd-8648-c3a867d68b85 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:27:21.802740 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6823f439-0532-4bbd-8648-c3a867d68b85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:27:21.804136 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6823f439-0532-4bbd-8648-c3a867d68b85 service neutron] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:27:21.823267 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 727/1455] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:27:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:27:23.784867 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4938e0-3dfa-4486-8db5-05cce0ec6638 None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:27:23.785487 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4938e0-3dfa-4486-8db5-05cce0ec6638 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:27:23.785487 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4938e0-3dfa-4486-8db5-05cce0ec6638 None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:27:23.786820 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 729/1456] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 11:27:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:27:23.792845 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52923cc0-8614-4488-8620-196b2ea66e84 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:27:23.793345 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52923cc0-8614-4488-8620-196b2ea66e84 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:27:23.793484 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52923cc0-8614-4488-8620-196b2ea66e84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:27:23.867190 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-52923cc0-8614-4488-8620-196b2ea66e84 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:27:23.868412 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-52923cc0-8614-4488-8620-196b2ea66e84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:27:23.898929 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:27:23.973164 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 728/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 11:27:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:27:24.273149 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4938e0-3dfa-4486-8db5-05cce0ec6638 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:27:24.275676 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-7a4938e0-3dfa-4486-8db5-05cce0ec6638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:27:24.396531 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4938e0-3dfa-4486-8db5-05cce0ec6638 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:27:24.426349 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:27:24.476195 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f753b5d1-6a4b-416f-aee1-df7c381d0c0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2d061d25d83443c9232218c90792d51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:27:24.476814 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f753b5d1-6a4b-416f-aee1-df7c381d0c0c service neutron] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:27:24.477090 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f753b5d1-6a4b-416f-aee1-df7c381d0c0c service neutron] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:27:24.477355 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f753b5d1-6a4b-416f-aee1-df7c381d0c0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:27:24.479018 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-f753b5d1-6a4b-416f-aee1-df7c381d0c0c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:27:24.595753 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f753b5d1-6a4b-416f-aee1-df7c381d0c0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:27:24.597193 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f753b5d1-6a4b-416f-aee1-df7c381d0c0c service neutron] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:27:24.618254 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 730/1458] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:27:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:27:26.564293 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5aaa97-23ad-4be2-a6e1-70b2d447e1e9 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:27:26.564895 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5aaa97-23ad-4be2-a6e1-70b2d447e1e9 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:27:26.564895 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5aaa97-23ad-4be2-a6e1-70b2d447e1e9 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:27:26.566175 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 729/1459] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 11:27:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:27:26.571849 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab4917d-1b46-42c4-ba69-1b97e0084383 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:27:26.572271 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab4917d-1b46-42c4-ba69-1b97e0084383 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:27:26.572366 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab4917d-1b46-42c4-ba69-1b97e0084383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:27:26.640971 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-bab4917d-1b46-42c4-ba69-1b97e0084383 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:27:26.642196 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-bab4917d-1b46-42c4-ba69-1b97e0084383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:27:26.650967 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:27:26.742176 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 731/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 11:27:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:27:27.026134 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5aaa97-23ad-4be2-a6e1-70b2d447e1e9 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:27:27.028542 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-dc5aaa97-23ad-4be2-a6e1-70b2d447e1e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:27:27.153839 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5aaa97-23ad-4be2-a6e1-70b2d447e1e9 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:27:27.210262 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:27:27.231072 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d9242f-d89f-4c12-bd05-21efe873c68f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2d061d25d83443c9232218c90792d51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:27:27.231701 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d9242f-d89f-4c12-bd05-21efe873c68f service neutron] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:27:27.231974 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d9242f-d89f-4c12-bd05-21efe873c68f service neutron] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:27:27.232237 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d9242f-d89f-4c12-bd05-21efe873c68f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:27:27.233856 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-b7d9242f-d89f-4c12-bd05-21efe873c68f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:27:27.349549 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d9242f-d89f-4c12-bd05-21efe873c68f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:27:27.351175 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d9242f-d89f-4c12-bd05-21efe873c68f service neutron] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:27:27.370691 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 730/1461] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:27:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:27:29.305806 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fe1076-9fe3-4760-8a9c-bf5a1143e64c None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:27:29.306736 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fe1076-9fe3-4760-8a9c-bf5a1143e64c None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:27:29.306736 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fe1076-9fe3-4760-8a9c-bf5a1143e64c None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:27:29.308955 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 732/1462] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 11:27:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:27:29.314548 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3919d93-b8fc-4493-8705-da7752a884e7 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:27:29.315052 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3919d93-b8fc-4493-8705-da7752a884e7 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:27:29.315052 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3919d93-b8fc-4493-8705-da7752a884e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:27:29.381934 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-f3919d93-b8fc-4493-8705-da7752a884e7 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:27:29.383079 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-f3919d93-b8fc-4493-8705-da7752a884e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:27:29.422264 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:27:29.484030 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 731/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 11:27:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:27:29.764191 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fe1076-9fe3-4760-8a9c-bf5a1143e64c None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:27:29.767050 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-18fe1076-9fe3-4760-8a9c-bf5a1143e64c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:27:29.888365 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fe1076-9fe3-4760-8a9c-bf5a1143e64c None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:27:29.931444 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:27:29.971628 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0815f3-6f76-47d7-a3b1-a57fb4c026ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2d061d25d83443c9232218c90792d51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:27:29.972238 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0815f3-6f76-47d7-a3b1-a57fb4c026ff service neutron] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:27:29.972519 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0815f3-6f76-47d7-a3b1-a57fb4c026ff service neutron] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:27:29.972797 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0815f3-6f76-47d7-a3b1-a57fb4c026ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:27:29.974545 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-ec0815f3-6f76-47d7-a3b1-a57fb4c026ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:27:30.095509 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0815f3-6f76-47d7-a3b1-a57fb4c026ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:27:30.096879 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0815f3-6f76-47d7-a3b1-a57fb4c026ff service neutron] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:27:30.117753 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 733/1464] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:27:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:27:32.053910 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b419a5f3-99d8-4d4a-91b7-ad01963c93bc None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:27:32.054865 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b419a5f3-99d8-4d4a-91b7-ad01963c93bc None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:27:32.054865 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b419a5f3-99d8-4d4a-91b7-ad01963c93bc None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:27:32.057219 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 732/1465] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 11:27:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:27:32.066726 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4ea513-6c7d-4b61-9281-f1ec5f597ae7 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:27:32.067173 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4ea513-6c7d-4b61-9281-f1ec5f597ae7 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:27:32.067288 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4ea513-6c7d-4b61-9281-f1ec5f597ae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:27:32.143609 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-8f4ea513-6c7d-4b61-9281-f1ec5f597ae7 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:27:32.144850 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-8f4ea513-6c7d-4b61-9281-f1ec5f597ae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:27:32.163664 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:27:32.244965 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 734/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 11:27:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:27:32.525181 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b419a5f3-99d8-4d4a-91b7-ad01963c93bc None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:27:32.526816 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-b419a5f3-99d8-4d4a-91b7-ad01963c93bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:27:32.644671 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b419a5f3-99d8-4d4a-91b7-ad01963c93bc None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:27:32.716761 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:27:32.724196 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73162722-8135-4027-a98d-7cb1b08691fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2d061d25d83443c9232218c90792d51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:27:32.724811 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73162722-8135-4027-a98d-7cb1b08691fb service neutron] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:27:32.725089 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73162722-8135-4027-a98d-7cb1b08691fb service neutron] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:27:32.725356 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73162722-8135-4027-a98d-7cb1b08691fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:27:32.727001 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-73162722-8135-4027-a98d-7cb1b08691fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:27:32.855177 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73162722-8135-4027-a98d-7cb1b08691fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:27:32.856551 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73162722-8135-4027-a98d-7cb1b08691fb service neutron] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:27:32.877702 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 733/1467] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:27:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:27:34.817885 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c92364-99aa-425e-a688-9c8ec4344bc3 None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:27:34.818671 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c92364-99aa-425e-a688-9c8ec4344bc3 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:27:34.818671 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c92364-99aa-425e-a688-9c8ec4344bc3 None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:27:34.820129 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 735/1468] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 11:27:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:27:34.831028 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3c0650-a871-4757-9732-eaf803f2d53c None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:27:34.831538 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3c0650-a871-4757-9732-eaf803f2d53c None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:27:34.831538 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3c0650-a871-4757-9732-eaf803f2d53c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:27:34.900629 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-8e3c0650-a871-4757-9732-eaf803f2d53c None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:27:34.901851 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-8e3c0650-a871-4757-9732-eaf803f2d53c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:27:34.953349 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:27:35.014773 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 734/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 11:27:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:27:35.312464 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c92364-99aa-425e-a688-9c8ec4344bc3 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:27:35.314027 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-04c92364-99aa-425e-a688-9c8ec4344bc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:27:35.436766 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c92364-99aa-425e-a688-9c8ec4344bc3 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:27:35.484849 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:27:35.514456 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4d9fa3-a4b6-4a09-a46c-9fa1fe773335 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2d061d25d83443c9232218c90792d51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:27:35.515095 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4d9fa3-a4b6-4a09-a46c-9fa1fe773335 service neutron] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:27:35.515364 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4d9fa3-a4b6-4a09-a46c-9fa1fe773335 service neutron] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:27:35.515992 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4d9fa3-a4b6-4a09-a46c-9fa1fe773335 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:27:35.517584 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-5e4d9fa3-a4b6-4a09-a46c-9fa1fe773335 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:27:35.632697 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4d9fa3-a4b6-4a09-a46c-9fa1fe773335 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:27:35.634149 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4d9fa3-a4b6-4a09-a46c-9fa1fe773335 service neutron] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:27:35.653515 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 736/1470] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:27:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 11:27:45.012737 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=22 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:27:45.650962 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=66 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:27:55.078270 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05e452b-3c04-442a-8b47-2961ee31f4bc None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:27:55.079257 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05e452b-3c04-442a-8b47-2961ee31f4bc None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:27:55.079257 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05e452b-3c04-442a-8b47-2961ee31f4bc None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:27:55.081387 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 735/1471] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:27:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:27:55.088023 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d429e7e4-56ba-4160-8296-7fab8ee85faf None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:27:55.089061 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d429e7e4-56ba-4160-8296-7fab8ee85faf None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:27:55.089340 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d429e7e4-56ba-4160-8296-7fab8ee85faf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:27:55.165701 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-d429e7e4-56ba-4160-8296-7fab8ee85faf None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:27:55.166947 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-d429e7e4-56ba-4160-8296-7fab8ee85faf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:27:55.276298 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 737/1472] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:27:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:27:55.577060 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91f6223-b065-4345-ab73-48b6cddd66a6 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:27:55.577345 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91f6223-b065-4345-ab73-48b6cddd66a6 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:27:55.577616 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91f6223-b065-4345-ab73-48b6cddd66a6 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:27:55.579033 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 736/1473] 10.222.0.27 () {54 vars in 967 bytes} [Wed Aug 24 11:27:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:27:55.584943 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923d4b9e-d442-488d-8637-576ff1849839 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:27:55.585283 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923d4b9e-d442-488d-8637-576ff1849839 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:27:55.585618 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923d4b9e-d442-488d-8637-576ff1849839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:27:55.666980 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-923d4b9e-d442-488d-8637-576ff1849839 None None] MFA Rules not processed for user `abffba24649e49d28a01cbee51924ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:27:55.668155 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-923d4b9e-d442-488d-8637-576ff1849839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:27:55.693740 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:27:55.769132 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 738/1474] 10.222.0.27 () {58 vars in 1064 bytes} [Wed Aug 24 11:27:55 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:27:55.778272 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91f6223-b065-4345-ab73-48b6cddd66a6 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:27:55.779965 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-d91f6223-b065-4345-ab73-48b6cddd66a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:27:55.889750 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91f6223-b065-4345-ab73-48b6cddd66a6 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:27:55.968127 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b298ab7c-d28e-4e34-b3f2-3abca1fed844 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abffba24649e49d28a01cbee51924ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:27:55.968757 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b298ab7c-d28e-4e34-b3f2-3abca1fed844 service glance] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:27:55.969033 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b298ab7c-d28e-4e34-b3f2-3abca1fed844 service glance] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:27:55.969298 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b298ab7c-d28e-4e34-b3f2-3abca1fed844 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:27:55.970936 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-b298ab7c-d28e-4e34-b3f2-3abca1fed844 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:27:56.026698 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:27:56.085583 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b298ab7c-d28e-4e34-b3f2-3abca1fed844 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:27:56.087086 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b298ab7c-d28e-4e34-b3f2-3abca1fed844 service glance] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:27:56.106751 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 737/1475] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:27:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:27:58.079000 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d3703f-990a-4878-a168-1b2a93beca01 None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:27:58.079566 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d3703f-990a-4878-a168-1b2a93beca01 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:27:58.079566 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d3703f-990a-4878-a168-1b2a93beca01 None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:27:58.080921 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 739/1476] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:27:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:27:58.087529 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d1fe62-d7c6-431d-994d-27dd6cf79f02 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:27:58.088175 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d1fe62-d7c6-431d-994d-27dd6cf79f02 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:27:58.088175 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d1fe62-d7c6-431d-994d-27dd6cf79f02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:27:58.159843 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-07d1fe62-d7c6-431d-994d-27dd6cf79f02 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:27:58.161072 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-07d1fe62-d7c6-431d-994d-27dd6cf79f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:27:58.262804 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 738/1477] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:27:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:27:58.534686 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d3703f-990a-4878-a168-1b2a93beca01 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:27:58.536165 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-08d3703f-990a-4878-a168-1b2a93beca01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:27:58.676374 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d3703f-990a-4878-a168-1b2a93beca01 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:27:58.727073 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:27:58.775041 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39113d0f-d6ba-483b-aa4c-8ff57377db29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:27:58.775667 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39113d0f-d6ba-483b-aa4c-8ff57377db29 admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:27:58.775948 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39113d0f-d6ba-483b-aa4c-8ff57377db29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:27:58.776240 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39113d0f-d6ba-483b-aa4c-8ff57377db29 admin admin] PATH_INFO: `/v3/projects` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:27:58.776872 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39113d0f-d6ba-483b-aa4c-8ff57377db29 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:27:58.778686 dv-cinder-848899-3-smb devstack@keystone.service[81502]: WARNING py.warnings [None req-39113d0f-d6ba-483b-aa4c-8ff57377db29 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 11:27:58.778686 dv-cinder-848899-3-smb devstack@keystone.service[81502]: warnings.warn(msg) Aug 24 11:27:58.778686 dv-cinder-848899-3-smb devstack@keystone.service[81502]: Aug 24 11:27:58.779844 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39113d0f-d6ba-483b-aa4c-8ff57377db29 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:27:58.800816 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 740/1478] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 24 11:27:58 2022] GET /identity/v3/projects => generated 2553 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:28:00.740205 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c61457-55c1-4382-8237-f704883123c8 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:28:00.741096 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c61457-55c1-4382-8237-f704883123c8 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:28:00.741096 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c61457-55c1-4382-8237-f704883123c8 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:28:00.743372 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 739/1479] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:28:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:28:00.751583 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7495eb-7c6a-4bb2-b9b2-d6a0f94ccfe9 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:28:00.752044 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7495eb-7c6a-4bb2-b9b2-d6a0f94ccfe9 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:28:00.752171 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7495eb-7c6a-4bb2-b9b2-d6a0f94ccfe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:28:00.837991 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-4f7495eb-7c6a-4bb2-b9b2-d6a0f94ccfe9 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:28:00.839450 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-4f7495eb-7c6a-4bb2-b9b2-d6a0f94ccfe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:28:00.947257 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 741/1480] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:28:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 11:28:01.246640 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c61457-55c1-4382-8237-f704883123c8 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:28:01.248227 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-d9c61457-55c1-4382-8237-f704883123c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:28:01.258485 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:28:01.399217 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c61457-55c1-4382-8237-f704883123c8 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:28:01.485071 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:28:01.520247 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a0736b-e648-4634-b1e1-fc1373ed9a45 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '282ec32864d046b2bea170f6a3845cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:28:01.520855 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a0736b-e648-4634-b1e1-fc1373ed9a45 service nova] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:28:01.521123 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a0736b-e648-4634-b1e1-fc1373ed9a45 service nova] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:28:01.521388 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a0736b-e648-4634-b1e1-fc1373ed9a45 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:28:01.523005 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-51a0736b-e648-4634-b1e1-fc1373ed9a45 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:28:01.637085 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a0736b-e648-4634-b1e1-fc1373ed9a45 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:28:01.638778 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a0736b-e648-4634-b1e1-fc1373ed9a45 service nova] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:28:01.658118 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 740/1481] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:28:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:28:03.736859 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffa0c0a-8497-4058-8bc3-995dca4bb69b None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:28:03.737460 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffa0c0a-8497-4058-8bc3-995dca4bb69b None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:28:03.737460 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffa0c0a-8497-4058-8bc3-995dca4bb69b None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:28:03.738853 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 742/1482] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:28:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:28:03.744484 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44b6f07-76fd-42a9-a229-aafc8badf0c6 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:28:03.744938 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44b6f07-76fd-42a9-a229-aafc8badf0c6 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:28:03.745062 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44b6f07-76fd-42a9-a229-aafc8badf0c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:28:03.812547 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-d44b6f07-76fd-42a9-a229-aafc8badf0c6 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:28:03.813760 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-d44b6f07-76fd-42a9-a229-aafc8badf0c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:28:03.861872 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:28:03.915719 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 741/1483] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:28:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:28:04.200512 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffa0c0a-8497-4058-8bc3-995dca4bb69b None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:28:04.203240 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-9ffa0c0a-8497-4058-8bc3-995dca4bb69b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:28:04.231586 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:28:04.315795 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffa0c0a-8497-4058-8bc3-995dca4bb69b None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:28:04.395240 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15b5585-275f-4ab8-a3c3-c7469abc282e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2d061d25d83443c9232218c90792d51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:28:04.395772 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15b5585-275f-4ab8-a3c3-c7469abc282e service neutron] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:28:04.396045 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15b5585-275f-4ab8-a3c3-c7469abc282e service neutron] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:28:04.396312 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15b5585-275f-4ab8-a3c3-c7469abc282e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:28:04.397932 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-a15b5585-275f-4ab8-a3c3-c7469abc282e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:28:04.475257 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:28:04.520922 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15b5585-275f-4ab8-a3c3-c7469abc282e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:28:04.522409 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15b5585-275f-4ab8-a3c3-c7469abc282e service neutron] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:28:04.542836 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 743/1484] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:28:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:28:06.505705 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb2a81f-3c4f-446f-986d-4f37cc22c5cd None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:28:06.506514 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb2a81f-3c4f-446f-986d-4f37cc22c5cd None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:28:06.506514 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb2a81f-3c4f-446f-986d-4f37cc22c5cd None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:28:06.507645 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 742/1485] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:28:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:28:06.514136 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d9c744-15e9-4f66-bbb0-a76a95871145 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:28:06.514628 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d9c744-15e9-4f66-bbb0-a76a95871145 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:28:06.514744 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d9c744-15e9-4f66-bbb0-a76a95871145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:28:06.591749 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-38d9c744-15e9-4f66-bbb0-a76a95871145 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:28:06.592958 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-38d9c744-15e9-4f66-bbb0-a76a95871145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:28:06.691041 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 744/1486] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:28:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:28:06.978305 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb2a81f-3c4f-446f-986d-4f37cc22c5cd None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:28:06.979927 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-8eb2a81f-3c4f-446f-986d-4f37cc22c5cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:28:07.102073 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb2a81f-3c4f-446f-986d-4f37cc22c5cd None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:28:07.180628 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:28:07.182827 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31d1de6-2148-491c-9112-d1afa2a23787 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2d061d25d83443c9232218c90792d51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:28:07.183339 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31d1de6-2148-491c-9112-d1afa2a23787 service neutron] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:28:07.183659 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31d1de6-2148-491c-9112-d1afa2a23787 service neutron] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:28:07.183920 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31d1de6-2148-491c-9112-d1afa2a23787 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:28:07.186641 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-f31d1de6-2148-491c-9112-d1afa2a23787 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:28:07.311753 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31d1de6-2148-491c-9112-d1afa2a23787 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:28:07.313213 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31d1de6-2148-491c-9112-d1afa2a23787 service neutron] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:28:07.331808 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 743/1487] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:28:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:28:09.387946 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7cbfcc-db0e-475e-896b-71de0db675bf None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:28:09.388513 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7cbfcc-db0e-475e-896b-71de0db675bf None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:28:09.388513 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7cbfcc-db0e-475e-896b-71de0db675bf None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:28:09.389750 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 745/1488] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:28:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:28:09.396612 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6306440a-384d-47ce-8a03-8fcff08763df None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:28:09.397083 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6306440a-384d-47ce-8a03-8fcff08763df None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:28:09.397190 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6306440a-384d-47ce-8a03-8fcff08763df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:28:09.476611 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-6306440a-384d-47ce-8a03-8fcff08763df None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:28:09.477854 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-6306440a-384d-47ce-8a03-8fcff08763df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:28:09.532904 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:28:09.583272 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 744/1489] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:28:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:28:09.875010 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7cbfcc-db0e-475e-896b-71de0db675bf None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:28:09.877497 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-5f7cbfcc-db0e-475e-896b-71de0db675bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:28:09.918587 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:28:09.989196 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7cbfcc-db0e-475e-896b-71de0db675bf None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:28:10.068832 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0f703b-e24c-419f-b021-874ddd96c7b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2d061d25d83443c9232218c90792d51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:28:10.069460 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0f703b-e24c-419f-b021-874ddd96c7b6 service neutron] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:28:10.069729 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0f703b-e24c-419f-b021-874ddd96c7b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:28:10.069990 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0f703b-e24c-419f-b021-874ddd96c7b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:28:10.071623 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-ab0f703b-e24c-419f-b021-874ddd96c7b6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:28:10.160990 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:28:10.191944 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0f703b-e24c-419f-b021-874ddd96c7b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:28:10.193428 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0f703b-e24c-419f-b021-874ddd96c7b6 service neutron] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:28:10.213147 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 746/1490] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:28:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:28:12.375156 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2cd3f8-7e62-492e-853c-fa01f50209e8 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:28:12.376059 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2cd3f8-7e62-492e-853c-fa01f50209e8 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:28:12.376059 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2cd3f8-7e62-492e-853c-fa01f50209e8 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:28:12.378243 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 745/1491] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 24 11:28:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:28:12.384627 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92a08ba-854f-4454-b146-d9825307d075 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:28:12.385091 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92a08ba-854f-4454-b146-d9825307d075 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:28:12.385196 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92a08ba-854f-4454-b146-d9825307d075 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:28:12.461165 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-e92a08ba-854f-4454-b146-d9825307d075 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:28:12.462509 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-e92a08ba-854f-4454-b146-d9825307d075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:28:12.567051 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 747/1492] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 24 11:28:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:28:12.854869 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2cd3f8-7e62-492e-853c-fa01f50209e8 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:28:12.856414 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-bc2cd3f8-7e62-492e-853c-fa01f50209e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:28:12.971485 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2cd3f8-7e62-492e-853c-fa01f50209e8 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:28:13.051112 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc60662-47e4-49c5-ae13-b51ca8c1f73a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2d061d25d83443c9232218c90792d51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:28:13.051725 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc60662-47e4-49c5-ae13-b51ca8c1f73a service neutron] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:28:13.052006 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc60662-47e4-49c5-ae13-b51ca8c1f73a service neutron] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:28:13.052273 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc60662-47e4-49c5-ae13-b51ca8c1f73a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:28:13.054627 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-adc60662-47e4-49c5-ae13-b51ca8c1f73a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:28:13.064699 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:28:13.190281 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc60662-47e4-49c5-ae13-b51ca8c1f73a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:28:13.191788 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc60662-47e4-49c5-ae13-b51ca8c1f73a service neutron] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:28:13.211615 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 746/1493] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:28:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:28:22.564839 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=82 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:28:23.208783 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=50 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:29:41.318934 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04b2947-f457-4b86-9b6d-9ae7b217a6fe None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:29:41.319558 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04b2947-f457-4b86-9b6d-9ae7b217a6fe None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:29:41.319558 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04b2947-f457-4b86-9b6d-9ae7b217a6fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:29:41.398224 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-e04b2947-f457-4b86-9b6d-9ae7b217a6fe None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:29:41.399381 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-e04b2947-f457-4b86-9b6d-9ae7b217a6fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:29:41.499083 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 748/1494] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:29:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:29:41.507567 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4901381b-0397-4ac4-8318-5e5d756ecaa2 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:29:41.508089 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4901381b-0397-4ac4-8318-5e5d756ecaa2 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:29:41.508195 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4901381b-0397-4ac4-8318-5e5d756ecaa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:29:41.590117 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-4901381b-0397-4ac4-8318-5e5d756ecaa2 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:29:41.591381 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-4901381b-0397-4ac4-8318-5e5d756ecaa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:29:41.693988 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 747/1495] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:29:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:29:41.698982 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04b2947-f457-4b86-9b6d-9ae7b217a6fe None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:29:41.700309 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-e04b2947-f457-4b86-9b6d-9ae7b217a6fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:29:41.712105 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04b2947-f457-4b86-9b6d-9ae7b217a6fe None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:29:41.779103 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:29:41.813854 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e140578-d938-4e8e-9027-8f7eae22f912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:29:41.814485 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e140578-d938-4e8e-9027-8f7eae22f912 admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:29:41.814760 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e140578-d938-4e8e-9027-8f7eae22f912 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:29:41.815023 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e140578-d938-4e8e-9027-8f7eae22f912 admin admin] PATH_INFO: `/v3/domains` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:29:41.815671 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e140578-d938-4e8e-9027-8f7eae22f912 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:29:41.815962 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e140578-d938-4e8e-9027-8f7eae22f912 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:29:41.816985 dv-cinder-848899-3-smb devstack@keystone.service[81502]: WARNING py.warnings [None req-2e140578-d938-4e8e-9027-8f7eae22f912 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 11:29:41.816985 dv-cinder-848899-3-smb devstack@keystone.service[81502]: warnings.warn(msg) Aug 24 11:29:41.816985 dv-cinder-848899-3-smb devstack@keystone.service[81502]: Aug 24 11:29:41.817872 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e140578-d938-4e8e-9027-8f7eae22f912 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:29:41.829409 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 749/1496] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 24 11:29:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:29:41.838041 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4901381b-0397-4ac4-8318-5e5d756ecaa2 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:29:41.848050 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4901381b-0397-4ac4-8318-5e5d756ecaa2 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:29:41.925913 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:29:41.960775 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13d283a-024f-40a8-bd7e-243f61bc23da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:29:41.961306 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13d283a-024f-40a8-bd7e-243f61bc23da admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:29:41.961588 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13d283a-024f-40a8-bd7e-243f61bc23da admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:29:41.961839 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13d283a-024f-40a8-bd7e-243f61bc23da admin admin] PATH_INFO: `/v3/projects` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:29:41.962522 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13d283a-024f-40a8-bd7e-243f61bc23da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:29:41.964344 dv-cinder-848899-3-smb devstack@keystone.service[81501]: WARNING py.warnings [None req-f13d283a-024f-40a8-bd7e-243f61bc23da admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 11:29:41.964344 dv-cinder-848899-3-smb devstack@keystone.service[81501]: warnings.warn(msg) Aug 24 11:29:41.964344 dv-cinder-848899-3-smb devstack@keystone.service[81501]: Aug 24 11:29:41.965695 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13d283a-024f-40a8-bd7e-243f61bc23da admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:29:42.027852 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 748/1497] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 11:29:41 2022] POST /identity/v3/projects => generated 379 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:29:42.032559 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e140578-d938-4e8e-9027-8f7eae22f912 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:29:42.034111 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-2e140578-d938-4e8e-9027-8f7eae22f912 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:29:42.069051 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e140578-d938-4e8e-9027-8f7eae22f912 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:29:42.169071 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa5454e-401e-450d-8147-8e8aaafe92a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:29:42.169673 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa5454e-401e-450d-8147-8e8aaafe92a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:29:42.169948 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa5454e-401e-450d-8147-8e8aaafe92a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:29:42.170213 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa5454e-401e-450d-8147-8e8aaafe92a6 admin admin] PATH_INFO: `/v3/users` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:29:42.170875 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa5454e-401e-450d-8147-8e8aaafe92a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:29:42.171897 dv-cinder-848899-3-smb devstack@keystone.service[81502]: WARNING py.warnings [None req-dfa5454e-401e-450d-8147-8e8aaafe92a6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 11:29:42.171897 dv-cinder-848899-3-smb devstack@keystone.service[81502]: warnings.warn(msg) Aug 24 11:29:42.171897 dv-cinder-848899-3-smb devstack@keystone.service[81502]: Aug 24 11:29:42.173115 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa5454e-401e-450d-8147-8e8aaafe92a6 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:29:42.225125 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 750/1498] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 11:29:42 2022] POST /identity/v3/users => generated 290 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:29:42.231395 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13d283a-024f-40a8-bd7e-243f61bc23da admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:29:42.233679 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-f13d283a-024f-40a8-bd7e-243f61bc23da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:29:42.301983 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13d283a-024f-40a8-bd7e-243f61bc23da admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:29:42.398373 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:29:42.413351 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9ba119-4877-42b2-b813-9059ae73c1b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:29:42.414180 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9ba119-4877-42b2-b813-9059ae73c1b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:29:42.414579 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9ba119-4877-42b2-b813-9059ae73c1b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:29:42.414925 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9ba119-4877-42b2-b813-9059ae73c1b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:29:42.415869 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9ba119-4877-42b2-b813-9059ae73c1b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:29:42.417424 dv-cinder-848899-3-smb devstack@keystone.service[81501]: WARNING py.warnings [None req-9d9ba119-4877-42b2-b813-9059ae73c1b2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 11:29:42.417424 dv-cinder-848899-3-smb devstack@keystone.service[81501]: warnings.warn(msg) Aug 24 11:29:42.417424 dv-cinder-848899-3-smb devstack@keystone.service[81501]: Aug 24 11:29:42.418580 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9ba119-4877-42b2-b813-9059ae73c1b2 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:29:42.431142 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 749/1499] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:29:42 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:29:42.435523 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa5454e-401e-450d-8147-8e8aaafe92a6 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:29:42.437003 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-dfa5454e-401e-450d-8147-8e8aaafe92a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:29:42.448860 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa5454e-401e-450d-8147-8e8aaafe92a6 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:29:42.476641 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:29:42.549445 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edcc667-c02a-4b11-9a81-69320a568f1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:29:42.550043 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edcc667-c02a-4b11-9a81-69320a568f1e admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:29:42.550318 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edcc667-c02a-4b11-9a81-69320a568f1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:29:42.550621 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edcc667-c02a-4b11-9a81-69320a568f1e admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:29:42.551266 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edcc667-c02a-4b11-9a81-69320a568f1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:29:42.552279 dv-cinder-848899-3-smb devstack@keystone.service[81502]: WARNING py.warnings [None req-9edcc667-c02a-4b11-9a81-69320a568f1e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 11:29:42.552279 dv-cinder-848899-3-smb devstack@keystone.service[81502]: warnings.warn(msg) Aug 24 11:29:42.552279 dv-cinder-848899-3-smb devstack@keystone.service[81502]: Aug 24 11:29:42.553181 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edcc667-c02a-4b11-9a81-69320a568f1e admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:29:42.565728 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 751/1500] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:29:42 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:29:42.571968 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9ba119-4877-42b2-b813-9059ae73c1b2 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:29:42.573751 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-9d9ba119-4877-42b2-b813-9059ae73c1b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:29:42.608236 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9ba119-4877-42b2-b813-9059ae73c1b2 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:29:42.711459 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3886c21-4720-4151-b848-7c977dd215fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:29:42.712110 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3886c21-4720-4151-b848-7c977dd215fa admin admin] REQUEST_METHOD: `PUT` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:29:42.712417 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3886c21-4720-4151-b848-7c977dd215fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:29:42.712643 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3886c21-4720-4151-b848-7c977dd215fa admin admin] PATH_INFO: `/v3/projects/f91bc9e482bc44f0b515d6bb870706cb/users/423564eb864a4ab9aaa02a9b0b55d02a/roles/27e3e65e24df4b86b0d3d18d3212101d` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:29:42.734879 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3886c21-4720-4151-b848-7c977dd215fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=f91bc9e482bc44f0b515d6bb870706cb, user_id=423564eb864a4ab9aaa02a9b0b55d02a, role_id=27e3e65e24df4b86b0d3d18d3212101d)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:29:42.735869 dv-cinder-848899-3-smb devstack@keystone.service[81501]: WARNING py.warnings [None req-c3886c21-4720-4151-b848-7c977dd215fa admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 11:29:42.735869 dv-cinder-848899-3-smb devstack@keystone.service[81501]: warnings.warn(msg) Aug 24 11:29:42.735869 dv-cinder-848899-3-smb devstack@keystone.service[81501]: Aug 24 11:29:42.737797 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3886c21-4720-4151-b848-7c977dd215fa admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:29:42.764522 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 750/1501] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 11:29:42 2022] PUT /identity/v3/projects/f91bc9e482bc44f0b515d6bb870706cb/users/423564eb864a4ab9aaa02a9b0b55d02a/roles/27e3e65e24df4b86b0d3d18d3212101d => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 11:29:42.776878 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34df8e58-7c61-42b5-9450-4c6d1d659b2f None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:29:42.777162 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34df8e58-7c61-42b5-9450-4c6d1d659b2f None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:29:42.777467 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34df8e58-7c61-42b5-9450-4c6d1d659b2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:29:42.843280 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-34df8e58-7c61-42b5-9450-4c6d1d659b2f None None] MFA Rules not processed for user `423564eb864a4ab9aaa02a9b0b55d02a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:29:42.844490 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-34df8e58-7c61-42b5-9450-4c6d1d659b2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:29:42.928838 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 752/1502] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:29:42 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:29:42.946175 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f797ed99-4619-42ec-8641-2af56ab34d7f None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:29:42.946489 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f797ed99-4619-42ec-8641-2af56ab34d7f None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:29:42.946764 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f797ed99-4619-42ec-8641-2af56ab34d7f None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:29:42.948135 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 751/1503] 10.222.0.27 () {54 vars in 964 bytes} [Wed Aug 24 11:29:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:29:42.955394 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77a46eb-d89d-4d95-9012-700e855972cc None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:29:42.955781 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77a46eb-d89d-4d95-9012-700e855972cc None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:29:42.956139 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77a46eb-d89d-4d95-9012-700e855972cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:29:42.992549 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:29:43.038508 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-b77a46eb-d89d-4d95-9012-700e855972cc None None] MFA Rules not processed for user `92862b76ba3b4513b5dc5b5c962faac9`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:29:43.039753 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-b77a46eb-d89d-4d95-9012-700e855972cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:29:43.121548 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 753/1504] 10.222.0.27 () {58 vars in 1061 bytes} [Wed Aug 24 11:29:42 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:29:43.129917 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f797ed99-4619-42ec-8641-2af56ab34d7f None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:29:43.131509 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-f797ed99-4619-42ec-8641-2af56ab34d7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:29:43.184693 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:29:43.238853 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f797ed99-4619-42ec-8641-2af56ab34d7f None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:29:43.311500 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c4f402-5de7-497b-9154-ee898b40d122 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92862b76ba3b4513b5dc5b5c962faac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:29:43.312035 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c4f402-5de7-497b-9154-ee898b40d122 service cinder] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:29:43.312304 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c4f402-5de7-497b-9154-ee898b40d122 service cinder] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:29:43.312570 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c4f402-5de7-497b-9154-ee898b40d122 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:29:43.314196 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-48c4f402-5de7-497b-9154-ee898b40d122 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:29:43.413912 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c4f402-5de7-497b-9154-ee898b40d122 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:29:43.415370 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c4f402-5de7-497b-9154-ee898b40d122 service cinder] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:29:43.418906 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:29:43.433549 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 752/1505] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:29:43 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:29:43.483531 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747a2fa2-e89e-4946-941d-b27731966c29 None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:29:43.483996 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747a2fa2-e89e-4946-941d-b27731966c29 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:29:43.484101 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747a2fa2-e89e-4946-941d-b27731966c29 None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:29:43.485328 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 754/1506] 10.222.0.27 () {52 vars in 830 bytes} [Wed Aug 24 11:29:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:29:43.488946 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c4f402-5de7-497b-9154-ee898b40d122 service cinder] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:29:43.490196 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-48c4f402-5de7-497b-9154-ee898b40d122 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:29:43.599805 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c4f402-5de7-497b-9154-ee898b40d122 service cinder] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:29:43.705993 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fec4bc-6316-459c-bf58-dde6cda5c191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:29:43.706664 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fec4bc-6316-459c-bf58-dde6cda5c191 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:29:43.706940 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fec4bc-6316-459c-bf58-dde6cda5c191 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:29:43.707213 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fec4bc-6316-459c-bf58-dde6cda5c191 admin admin] PATH_INFO: `/v3/users/423564eb864a4ab9aaa02a9b0b55d02a` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:29:43.721142 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fec4bc-6316-459c-bf58-dde6cda5c191 admin admin] RBAC: Authorizing `identity:delete_user(user_id=423564eb864a4ab9aaa02a9b0b55d02a)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:29:43.722187 dv-cinder-848899-3-smb devstack@keystone.service[81501]: WARNING py.warnings [None req-46fec4bc-6316-459c-bf58-dde6cda5c191 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 11:29:43.722187 dv-cinder-848899-3-smb devstack@keystone.service[81501]: warnings.warn(msg) Aug 24 11:29:43.722187 dv-cinder-848899-3-smb devstack@keystone.service[81501]: Aug 24 11:29:43.723521 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fec4bc-6316-459c-bf58-dde6cda5c191 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:29:43.733995 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:29:43.805128 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-46fec4bc-6316-459c-bf58-dde6cda5c191 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '423564eb864a4ab9aaa02a9b0b55d02a'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:29:43.805567 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-46fec4bc-6316-459c-bf58-dde6cda5c191 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '423564eb864a4ab9aaa02a9b0b55d02a'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:29:43.806093 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-46fec4bc-6316-459c-bf58-dde6cda5c191 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '423564eb864a4ab9aaa02a9b0b55d02a'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:29:43.816389 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-46fec4bc-6316-459c-bf58-dde6cda5c191 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '423564eb864a4ab9aaa02a9b0b55d02a'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:29:43.831583 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-46fec4bc-6316-459c-bf58-dde6cda5c191 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '423564eb864a4ab9aaa02a9b0b55d02a'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:29:43.862160 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 753/1507] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 11:29:43 2022] DELETE /identity/v3/users/423564eb864a4ab9aaa02a9b0b55d02a => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:29:43.867548 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800bbecb-0a24-4f80-bffb-cb514a064740 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:29:43.867857 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800bbecb-0a24-4f80-bffb-cb514a064740 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:29:43.868156 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800bbecb-0a24-4f80-bffb-cb514a064740 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:29:43.928124 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-800bbecb-0a24-4f80-bffb-cb514a064740 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:29:43.929507 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-800bbecb-0a24-4f80-bffb-cb514a064740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:29:44.014395 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:29:44.038040 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 755/1508] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:29:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:29:44.050459 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fec4bc-6316-459c-bf58-dde6cda5c191 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:29:44.051830 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-46fec4bc-6316-459c-bf58-dde6cda5c191 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:29:44.155940 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fec4bc-6316-459c-bf58-dde6cda5c191 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:29:44.213234 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:29:44.234693 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7b5224-7b2c-4f97-be94-f481ac3eac41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2d061d25d83443c9232218c90792d51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:29:44.235327 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7b5224-7b2c-4f97-be94-f481ac3eac41 service neutron] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:29:44.235612 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7b5224-7b2c-4f97-be94-f481ac3eac41 service neutron] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:29:44.235885 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7b5224-7b2c-4f97-be94-f481ac3eac41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:29:44.237492 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-8d7b5224-7b2c-4f97-be94-f481ac3eac41 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:29:44.480899 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7b5224-7b2c-4f97-be94-f481ac3eac41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:29:44.482390 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7b5224-7b2c-4f97-be94-f481ac3eac41 service neutron] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:29:44.501528 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 754/1509] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:29:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:29:44.889716 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800bbecb-0a24-4f80-bffb-cb514a064740 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:29:44.890971 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-800bbecb-0a24-4f80-bffb-cb514a064740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:29:44.902679 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800bbecb-0a24-4f80-bffb-cb514a064740 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:29:45.003959 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ceb4eac-4c88-4363-b5c9-570e99b25928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:29:45.004509 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceb4eac-4c88-4363-b5c9-570e99b25928 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:29:45.004787 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceb4eac-4c88-4363-b5c9-570e99b25928 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:29:45.005057 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceb4eac-4c88-4363-b5c9-570e99b25928 admin admin] PATH_INFO: `/v3/projects/f91bc9e482bc44f0b515d6bb870706cb` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:29:45.015312 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ceb4eac-4c88-4363-b5c9-570e99b25928 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f91bc9e482bc44f0b515d6bb870706cb)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:29:45.016338 dv-cinder-848899-3-smb devstack@keystone.service[81502]: WARNING py.warnings [None req-9ceb4eac-4c88-4363-b5c9-570e99b25928 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 11:29:45.016338 dv-cinder-848899-3-smb devstack@keystone.service[81502]: warnings.warn(msg) Aug 24 11:29:45.016338 dv-cinder-848899-3-smb devstack@keystone.service[81502]: Aug 24 11:29:45.017548 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ceb4eac-4c88-4363-b5c9-570e99b25928 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:29:45.092120 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-9ceb4eac-4c88-4363-b5c9-570e99b25928 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f91bc9e482bc44f0b515d6bb870706cb', 'request_id': 'req-9ceb4eac-4c88-4363-b5c9-570e99b25928'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:29:45.105659 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-9ceb4eac-4c88-4363-b5c9-570e99b25928 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f91bc9e482bc44f0b515d6bb870706cb', 'request_id': 'req-9ceb4eac-4c88-4363-b5c9-570e99b25928'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:29:45.112892 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-9ceb4eac-4c88-4363-b5c9-570e99b25928 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f91bc9e482bc44f0b515d6bb870706cb', 'request_id': 'req-9ceb4eac-4c88-4363-b5c9-570e99b25928'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:29:45.140320 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-9ceb4eac-4c88-4363-b5c9-570e99b25928 admin admin] The token cache is being invalidate because project f91bc9e482bc44f0b515d6bb870706cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:29:45.140602 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-9ceb4eac-4c88-4363-b5c9-570e99b25928 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:29:45.141103 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-9ceb4eac-4c88-4363-b5c9-570e99b25928 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:29:45.142439 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 756/1510] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 11:29:44 2022] DELETE /identity/v3/projects/f91bc9e482bc44f0b515d6bb870706cb => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:29:54.499166 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=62 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:29:55.138248 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:31:22.212454 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ea9428-d1d0-4b25-aee4-33a69cb3bc6c None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:31:22.213081 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ea9428-d1d0-4b25-aee4-33a69cb3bc6c None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:31:22.213081 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ea9428-d1d0-4b25-aee4-33a69cb3bc6c None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:31:22.214414 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 755/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 11:31:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:31:22.220467 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc317640-0459-470a-a195-1d006f33db96 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:31:22.221324 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc317640-0459-470a-a195-1d006f33db96 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:31:22.221324 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc317640-0459-470a-a195-1d006f33db96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:31:22.311143 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-bc317640-0459-470a-a195-1d006f33db96 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:31:22.312268 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-bc317640-0459-470a-a195-1d006f33db96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:31:22.418544 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 757/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 11:31:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:31:22.574636 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ea9428-d1d0-4b25-aee4-33a69cb3bc6c None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:31:22.578848 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-00ea9428-d1d0-4b25-aee4-33a69cb3bc6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:31:22.708281 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ea9428-d1d0-4b25-aee4-33a69cb3bc6c None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:31:22.713825 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8449c76b-3df6-4d86-99bb-a066f970d057 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '282ec32864d046b2bea170f6a3845cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:31:22.714466 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8449c76b-3df6-4d86-99bb-a066f970d057 service nova] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:31:22.714738 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8449c76b-3df6-4d86-99bb-a066f970d057 service nova] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:31:22.715000 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8449c76b-3df6-4d86-99bb-a066f970d057 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:31:22.723041 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8449c76b-3df6-4d86-99bb-a066f970d057 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:31:22.724643 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8449c76b-3df6-4d86-99bb-a066f970d057 service nova] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:31:22.733981 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 756/1513] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:31:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:31:23.578178 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5e3aad-fc86-4bda-a2e4-331614dad2c2 None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:31:23.579150 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5e3aad-fc86-4bda-a2e4-331614dad2c2 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:31:23.579150 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5e3aad-fc86-4bda-a2e4-331614dad2c2 None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:31:23.581133 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 758/1514] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 11:31:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:31:23.589117 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1af0b2-4de8-4f3d-a3de-16c0cfdbc8bd None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:31:23.589576 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1af0b2-4de8-4f3d-a3de-16c0cfdbc8bd None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:31:23.589679 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1af0b2-4de8-4f3d-a3de-16c0cfdbc8bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:31:23.616515 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-db1af0b2-4de8-4f3d-a3de-16c0cfdbc8bd None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:31:23.617659 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-db1af0b2-4de8-4f3d-a3de-16c0cfdbc8bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:31:23.626966 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 757/1515] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 11:31:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:31:23.782020 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5e3aad-fc86-4bda-a2e4-331614dad2c2 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:31:23.802331 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5e3aad-fc86-4bda-a2e4-331614dad2c2 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:31:23.808989 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0368067-9619-4992-859d-0f3a216166b6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '282ec32864d046b2bea170f6a3845cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:31:23.809603 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0368067-9619-4992-859d-0f3a216166b6 service nova] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:31:23.809945 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0368067-9619-4992-859d-0f3a216166b6 service nova] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:31:23.810214 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0368067-9619-4992-859d-0f3a216166b6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:31:23.819229 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0368067-9619-4992-859d-0f3a216166b6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:31:23.820853 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0368067-9619-4992-859d-0f3a216166b6 service nova] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:31:23.833947 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 759/1516] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:31:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:31:24.422217 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3f478b-ae4f-400e-8b70-7b35a0895355 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:31:24.422475 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3f478b-ae4f-400e-8b70-7b35a0895355 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:31:24.422701 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3f478b-ae4f-400e-8b70-7b35a0895355 None None] PATH_INFO: `/v3` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:31:24.424089 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 758/1517] 10.222.0.97 () {54 vars in 925 bytes} [Wed Aug 24 11:31:24 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:31:24.430790 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3fdbc3-03be-45de-9f4c-34a704fce6b7 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:31:24.431059 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3fdbc3-03be-45de-9f4c-34a704fce6b7 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:31:24.431330 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3fdbc3-03be-45de-9f4c-34a704fce6b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:31:24.497745 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-9c3fdbc3-03be-45de-9f4c-34a704fce6b7 None None] MFA Rules not processed for user `ad45431e70ff48a9b90905a97d473d81`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:31:24.498979 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-9c3fdbc3-03be-45de-9f4c-34a704fce6b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:31:24.517489 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:31:24.577218 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 760/1518] 10.222.0.97 () {58 vars in 1015 bytes} [Wed Aug 24 11:31:24 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:31:28.370277 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f91e8b-dfa7-4494-bdb5-b9b6834841e4 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:31:28.370872 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f91e8b-dfa7-4494-bdb5-b9b6834841e4 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:31:28.370872 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f91e8b-dfa7-4494-bdb5-b9b6834841e4 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:31:28.372067 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 759/1519] 10.222.0.27 () {54 vars in 961 bytes} [Wed Aug 24 11:31:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:31:28.378542 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee535ea-f07c-4f89-82bd-1153f96da89d None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:31:28.379278 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee535ea-f07c-4f89-82bd-1153f96da89d None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:31:28.379477 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee535ea-f07c-4f89-82bd-1153f96da89d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:31:28.409913 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-eee535ea-f07c-4f89-82bd-1153f96da89d None None] MFA Rules not processed for user `ad45431e70ff48a9b90905a97d473d81`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:31:28.411163 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-eee535ea-f07c-4f89-82bd-1153f96da89d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:31:28.421211 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 761/1520] 10.222.0.27 () {58 vars in 1058 bytes} [Wed Aug 24 11:31:28 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:31:28.429004 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f91e8b-dfa7-4494-bdb5-b9b6834841e4 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:31:28.446956 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f91e8b-dfa7-4494-bdb5-b9b6834841e4 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:31:28.452984 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec055b0-70df-4eff-a628-2a46843ba0fc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad45431e70ff48a9b90905a97d473d81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:31:28.453594 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec055b0-70df-4eff-a628-2a46843ba0fc service placement] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:31:28.453868 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec055b0-70df-4eff-a628-2a46843ba0fc service placement] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:31:28.454136 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec055b0-70df-4eff-a628-2a46843ba0fc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:31:28.462596 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec055b0-70df-4eff-a628-2a46843ba0fc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:31:28.464218 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec055b0-70df-4eff-a628-2a46843ba0fc service placement] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:31:28.473818 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 760/1521] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:31:28 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:31:35.088094 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aa95a4-21ff-4f12-8616-fc22e34d140c None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:31:35.089299 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aa95a4-21ff-4f12-8616-fc22e34d140c None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:31:35.089299 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aa95a4-21ff-4f12-8616-fc22e34d140c None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:31:35.089975 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 762/1522] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 11:31:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:31:35.094984 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a780d30b-9244-46aa-afaf-320fc537c160 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:31:35.095436 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a780d30b-9244-46aa-afaf-320fc537c160 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:31:35.095533 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a780d30b-9244-46aa-afaf-320fc537c160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:31:35.124718 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-a780d30b-9244-46aa-afaf-320fc537c160 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:31:35.126730 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-a780d30b-9244-46aa-afaf-320fc537c160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:31:35.137311 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 761/1523] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 11:31:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:31:35.290808 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8aa95a4-21ff-4f12-8616-fc22e34d140c None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:31:35.310048 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8aa95a4-21ff-4f12-8616-fc22e34d140c None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:31:35.317095 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef9bfa8-bb3f-4f65-894c-42660cc9af44 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '282ec32864d046b2bea170f6a3845cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:31:35.317728 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef9bfa8-bb3f-4f65-894c-42660cc9af44 service nova] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:31:35.317999 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef9bfa8-bb3f-4f65-894c-42660cc9af44 service nova] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:31:35.318263 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef9bfa8-bb3f-4f65-894c-42660cc9af44 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:31:35.327024 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef9bfa8-bb3f-4f65-894c-42660cc9af44 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:31:35.328694 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef9bfa8-bb3f-4f65-894c-42660cc9af44 service nova] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:31:35.339077 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 763/1524] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:31:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:31:36.155451 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadaa85c-0cdd-4bdd-9e9d-48d620478446 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:31:36.156064 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadaa85c-0cdd-4bdd-9e9d-48d620478446 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:31:36.156064 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadaa85c-0cdd-4bdd-9e9d-48d620478446 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:31:36.157372 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 762/1525] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 11:31:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:31:36.162847 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0800eb3e-043f-483d-b6d8-349af0aba745 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:31:36.163334 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0800eb3e-043f-483d-b6d8-349af0aba745 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:31:36.163446 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0800eb3e-043f-483d-b6d8-349af0aba745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:31:36.186217 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-0800eb3e-043f-483d-b6d8-349af0aba745 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:31:36.187429 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-0800eb3e-043f-483d-b6d8-349af0aba745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:31:36.197666 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 764/1526] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 11:31:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:31:36.350209 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadaa85c-0cdd-4bdd-9e9d-48d620478446 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:31:36.371663 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadaa85c-0cdd-4bdd-9e9d-48d620478446 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:31:36.377898 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0beb6af-065d-4063-8fd1-6beb32194a12 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '282ec32864d046b2bea170f6a3845cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:31:36.378527 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0beb6af-065d-4063-8fd1-6beb32194a12 service nova] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:31:36.378803 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0beb6af-065d-4063-8fd1-6beb32194a12 service nova] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:31:36.379068 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0beb6af-065d-4063-8fd1-6beb32194a12 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:31:36.387641 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0beb6af-065d-4063-8fd1-6beb32194a12 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:31:36.389272 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0beb6af-065d-4063-8fd1-6beb32194a12 service nova] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:31:36.399078 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 763/1527] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:31:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:31:40.467489 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d98b9e-56cd-4c78-b341-4cf900ce122c None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:31:40.468436 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d98b9e-56cd-4c78-b341-4cf900ce122c None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:31:40.468436 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d98b9e-56cd-4c78-b341-4cf900ce122c None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:31:40.470399 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 765/1528] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 11:31:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:31:40.475906 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac45258-294a-44cf-b37c-0ce12b039277 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:31:40.476417 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac45258-294a-44cf-b37c-0ce12b039277 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:31:40.476417 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac45258-294a-44cf-b37c-0ce12b039277 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:31:40.497698 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-fac45258-294a-44cf-b37c-0ce12b039277 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:31:40.498923 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-fac45258-294a-44cf-b37c-0ce12b039277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:31:40.507946 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 764/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 11:31:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:31:40.789815 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d98b9e-56cd-4c78-b341-4cf900ce122c None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:31:40.792102 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-75d98b9e-56cd-4c78-b341-4cf900ce122c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:31:40.879735 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d98b9e-56cd-4c78-b341-4cf900ce122c None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:31:40.884323 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17825c71-6291-4b1e-ad88-23c88d8bb629 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2d061d25d83443c9232218c90792d51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:31:40.885277 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17825c71-6291-4b1e-ad88-23c88d8bb629 service neutron] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:31:40.885557 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17825c71-6291-4b1e-ad88-23c88d8bb629 service neutron] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:31:40.885830 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17825c71-6291-4b1e-ad88-23c88d8bb629 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:31:40.896263 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17825c71-6291-4b1e-ad88-23c88d8bb629 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:31:40.897694 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17825c71-6291-4b1e-ad88-23c88d8bb629 service neutron] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:31:40.907791 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 766/1530] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:31:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:31:42.759128 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebdf9c4-8df5-4244-a696-a4b599ee107f None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:31:42.760088 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebdf9c4-8df5-4244-a696-a4b599ee107f None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:31:42.760088 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebdf9c4-8df5-4244-a696-a4b599ee107f None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:31:42.761415 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 765/1531] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 11:31:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:31:42.767894 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1bd3fe-d13e-4dfb-a994-8fb714a8358b None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:31:42.768366 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1bd3fe-d13e-4dfb-a994-8fb714a8358b None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:31:42.768466 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1bd3fe-d13e-4dfb-a994-8fb714a8358b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:31:42.792552 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-0c1bd3fe-d13e-4dfb-a994-8fb714a8358b None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:31:42.793790 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-0c1bd3fe-d13e-4dfb-a994-8fb714a8358b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:31:42.805331 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 767/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 11:31:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:31:43.090170 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebdf9c4-8df5-4244-a696-a4b599ee107f None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:31:43.107967 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebdf9c4-8df5-4244-a696-a4b599ee107f None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:31:43.113074 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826d42ad-dd91-4578-97b8-8a4ed8a2c4b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2d061d25d83443c9232218c90792d51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:31:43.113687 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826d42ad-dd91-4578-97b8-8a4ed8a2c4b3 service neutron] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:31:43.113960 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826d42ad-dd91-4578-97b8-8a4ed8a2c4b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:31:43.115349 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826d42ad-dd91-4578-97b8-8a4ed8a2c4b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:31:43.126203 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826d42ad-dd91-4578-97b8-8a4ed8a2c4b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:31:43.127689 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826d42ad-dd91-4578-97b8-8a4ed8a2c4b3 service neutron] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:31:43.137936 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 766/1533] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:31:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:31:46.685393 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa265c57-8edc-44c4-b1b9-94d001ae93a2 None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:31:46.686023 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa265c57-8edc-44c4-b1b9-94d001ae93a2 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:31:46.686023 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa265c57-8edc-44c4-b1b9-94d001ae93a2 None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:31:46.687377 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 768/1534] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 11:31:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:31:46.694009 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a456108-3338-4436-bb69-ea3f407847d7 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:31:46.694789 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a456108-3338-4436-bb69-ea3f407847d7 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:31:46.694896 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a456108-3338-4436-bb69-ea3f407847d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:31:46.708132 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=81 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:31:46.724418 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-6a456108-3338-4436-bb69-ea3f407847d7 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:31:46.725682 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-6a456108-3338-4436-bb69-ea3f407847d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:31:46.735242 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 767/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 11:31:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:31:47.293026 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa265c57-8edc-44c4-b1b9-94d001ae93a2 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:31:47.296360 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-aa265c57-8edc-44c4-b1b9-94d001ae93a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:31:47.369002 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:31:47.383501 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa265c57-8edc-44c4-b1b9-94d001ae93a2 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:31:47.387763 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a064efc-42df-4971-b1f8-1d5d44a892fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92862b76ba3b4513b5dc5b5c962faac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:31:47.388370 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a064efc-42df-4971-b1f8-1d5d44a892fd service cinder] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:31:47.388643 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a064efc-42df-4971-b1f8-1d5d44a892fd service cinder] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:31:47.388912 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a064efc-42df-4971-b1f8-1d5d44a892fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:31:47.398057 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a064efc-42df-4971-b1f8-1d5d44a892fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:31:47.399517 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a064efc-42df-4971-b1f8-1d5d44a892fd service cinder] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:31:47.408935 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 769/1536] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:31:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:31:49.314859 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08066cf7-6a20-4048-a218-74e2d10d25f8 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:31:49.315471 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08066cf7-6a20-4048-a218-74e2d10d25f8 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:31:49.315471 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08066cf7-6a20-4048-a218-74e2d10d25f8 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:31:49.316818 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 768/1537] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 11:31:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:31:49.323238 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c0e9b4-3303-4307-b756-16635f0d44e7 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:31:49.323948 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c0e9b4-3303-4307-b756-16635f0d44e7 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:31:49.324054 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c0e9b4-3303-4307-b756-16635f0d44e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:31:49.353170 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-e0c0e9b4-3303-4307-b756-16635f0d44e7 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:31:49.354393 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-e0c0e9b4-3303-4307-b756-16635f0d44e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:31:49.363302 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 770/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 11:31:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:31:49.913785 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08066cf7-6a20-4048-a218-74e2d10d25f8 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:31:49.915989 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-08066cf7-6a20-4048-a218-74e2d10d25f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:31:49.931001 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08066cf7-6a20-4048-a218-74e2d10d25f8 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:31:49.934973 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203a3c61-b84b-4321-9239-61757a8d1d9f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92862b76ba3b4513b5dc5b5c962faac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:31:49.935572 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203a3c61-b84b-4321-9239-61757a8d1d9f service cinder] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:31:49.935848 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203a3c61-b84b-4321-9239-61757a8d1d9f service cinder] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:31:49.936115 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203a3c61-b84b-4321-9239-61757a8d1d9f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:31:49.945457 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203a3c61-b84b-4321-9239-61757a8d1d9f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:31:49.946935 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203a3c61-b84b-4321-9239-61757a8d1d9f service cinder] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:31:49.956288 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 769/1539] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:31:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:31:59.346738 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=11 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:31:59.952382 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=8 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:16.040494 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb4846f-d5c4-4b08-88d1-c32827eb3a7a None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:16.042559 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb4846f-d5c4-4b08-88d1-c32827eb3a7a None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:16.042559 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb4846f-d5c4-4b08-88d1-c32827eb3a7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:16.068443 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-9bb4846f-d5c4-4b08-88d1-c32827eb3a7a None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:33:16.069871 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-9bb4846f-d5c4-4b08-88d1-c32827eb3a7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:16.081690 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 771/1540] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:33:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 11:33:16.091573 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46d623c-c4fb-4c5e-883c-bd49c2d301d7 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:16.092201 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46d623c-c4fb-4c5e-883c-bd49c2d301d7 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:16.092201 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46d623c-c4fb-4c5e-883c-bd49c2d301d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:16.135292 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-f46d623c-c4fb-4c5e-883c-bd49c2d301d7 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:33:16.136555 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-f46d623c-c4fb-4c5e-883c-bd49c2d301d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:16.152842 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 770/1541] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:33:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:33:16.157791 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb4846f-d5c4-4b08-88d1-c32827eb3a7a None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:16.173409 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb4846f-d5c4-4b08-88d1-c32827eb3a7a None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:16.181576 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820751dc-09f3-4286-b12e-b92de1c44cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:16.182674 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820751dc-09f3-4286-b12e-b92de1c44cc7 admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:16.183197 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820751dc-09f3-4286-b12e-b92de1c44cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:16.183723 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820751dc-09f3-4286-b12e-b92de1c44cc7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:16.184684 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820751dc-09f3-4286-b12e-b92de1c44cc7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:16.185236 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820751dc-09f3-4286-b12e-b92de1c44cc7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:16.187519 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820751dc-09f3-4286-b12e-b92de1c44cc7 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:16.209100 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 772/1542] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 24 11:33:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:33:16.217097 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46d623c-c4fb-4c5e-883c-bd49c2d301d7 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:16.226912 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46d623c-c4fb-4c5e-883c-bd49c2d301d7 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:16.243074 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bf9738-a422-4f2a-a33b-f95369ef568a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:16.243715 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bf9738-a422-4f2a-a33b-f95369ef568a admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:16.243994 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bf9738-a422-4f2a-a33b-f95369ef568a admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:16.244269 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bf9738-a422-4f2a-a33b-f95369ef568a admin admin] PATH_INFO: `/v3/projects` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:16.244907 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bf9738-a422-4f2a-a33b-f95369ef568a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:16.246986 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bf9738-a422-4f2a-a33b-f95369ef568a admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:16.307988 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 771/1543] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 11:33:16 2022] POST /identity/v3/projects => generated 383 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:33:16.312232 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820751dc-09f3-4286-b12e-b92de1c44cc7 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:16.333135 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820751dc-09f3-4286-b12e-b92de1c44cc7 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:16.432281 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9e4bfe-d9b9-4901-b3a4-f1d20e7fc52a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:16.433385 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9e4bfe-d9b9-4901-b3a4-f1d20e7fc52a admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:16.433887 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9e4bfe-d9b9-4901-b3a4-f1d20e7fc52a admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:16.434505 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9e4bfe-d9b9-4901-b3a4-f1d20e7fc52a admin admin] PATH_INFO: `/v3/users` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:16.435373 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9e4bfe-d9b9-4901-b3a4-f1d20e7fc52a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:16.436412 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031c3cbd-6d0d-4ee7-ba75-02e04de7397a None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:16.436705 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031c3cbd-6d0d-4ee7-ba75-02e04de7397a None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:16.436979 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031c3cbd-6d0d-4ee7-ba75-02e04de7397a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:16.438298 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9e4bfe-d9b9-4901-b3a4-f1d20e7fc52a admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:16.478011 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 773/1544] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 11:33:16 2022] POST /identity/v3/users => generated 292 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:33:16.482394 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-031c3cbd-6d0d-4ee7-ba75-02e04de7397a None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:33:16.482394 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-031c3cbd-6d0d-4ee7-ba75-02e04de7397a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:16.486660 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9e4bfe-d9b9-4901-b3a4-f1d20e7fc52a admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:16.496383 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 772/1545] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:33:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:33:16.502668 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9e4bfe-d9b9-4901-b3a4-f1d20e7fc52a admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:16.505588 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939e4523-0bda-4437-982b-079c97d61bc3 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:16.505871 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939e4523-0bda-4437-982b-079c97d61bc3 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:16.506129 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939e4523-0bda-4437-982b-079c97d61bc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:16.518347 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934c6c80-bd7b-4976-9100-c83ad2681d4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:16.519488 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934c6c80-bd7b-4976-9100-c83ad2681d4d admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:16.520013 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934c6c80-bd7b-4976-9100-c83ad2681d4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:16.520515 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934c6c80-bd7b-4976-9100-c83ad2681d4d admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:16.521482 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934c6c80-bd7b-4976-9100-c83ad2681d4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:16.523438 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934c6c80-bd7b-4976-9100-c83ad2681d4d admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:16.544679 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 774/1546] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:33:16 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 11:33:16.551399 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934c6c80-bd7b-4976-9100-c83ad2681d4d admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:16.559498 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-939e4523-0bda-4437-982b-079c97d61bc3 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:33:16.560681 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-939e4523-0bda-4437-982b-079c97d61bc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:16.565184 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934c6c80-bd7b-4976-9100-c83ad2681d4d admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:16.573255 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1356b5-cc43-4d02-bad2-1657dfcfafc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:16.574155 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1356b5-cc43-4d02-bad2-1657dfcfafc1 admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:16.574672 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1356b5-cc43-4d02-bad2-1657dfcfafc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:16.575160 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1356b5-cc43-4d02-bad2-1657dfcfafc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:16.576062 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1356b5-cc43-4d02-bad2-1657dfcfafc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:16.578021 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1356b5-cc43-4d02-bad2-1657dfcfafc1 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:16.581010 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 773/1547] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:33:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:33:16.583823 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511d5c0e-339b-4582-bfd2-7da268f20780 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:16.584107 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511d5c0e-339b-4582-bfd2-7da268f20780 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:16.584378 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511d5c0e-339b-4582-bfd2-7da268f20780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:16.596459 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 775/1548] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:33:16 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:33:16.598208 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1356b5-cc43-4d02-bad2-1657dfcfafc1 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:16.615953 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1356b5-cc43-4d02-bad2-1657dfcfafc1 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:16.623131 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3144739e-1a2b-4fb7-8e83-5dfc3d23f1e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:16.623397 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-511d5c0e-339b-4582-bfd2-7da268f20780 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:33:16.624334 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3144739e-1a2b-4fb7-8e83-5dfc3d23f1e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:16.624623 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-511d5c0e-339b-4582-bfd2-7da268f20780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:16.625026 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3144739e-1a2b-4fb7-8e83-5dfc3d23f1e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:16.625492 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3144739e-1a2b-4fb7-8e83-5dfc3d23f1e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:16.626327 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3144739e-1a2b-4fb7-8e83-5dfc3d23f1e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:16.630998 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3144739e-1a2b-4fb7-8e83-5dfc3d23f1e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:16.633684 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3144739e-1a2b-4fb7-8e83-5dfc3d23f1e8 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:16.643469 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 774/1549] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:33:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 11:33:16.644459 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511d5c0e-339b-4582-bfd2-7da268f20780 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:16.654270 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 776/1550] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 24 11:33:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:33:16.656856 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f2eadd-9c40-4c4b-8f92-63c29ee0528c None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:16.657405 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f2eadd-9c40-4c4b-8f92-63c29ee0528c None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:16.657880 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f2eadd-9c40-4c4b-8f92-63c29ee0528c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:16.666173 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511d5c0e-339b-4582-bfd2-7da268f20780 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:16.676937 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4a9dce-9480-415f-9ea0-8309d284c5cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:16.677625 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4a9dce-9480-415f-9ea0-8309d284c5cb admin admin] REQUEST_METHOD: `PUT` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:16.677901 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4a9dce-9480-415f-9ea0-8309d284c5cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:16.678173 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4a9dce-9480-415f-9ea0-8309d284c5cb admin admin] PATH_INFO: `/v3/projects/55a65acab6e644b3a5505a17f2ee6071/users/73625201f6e14ccd8d756a6631f3f80e/roles/27e3e65e24df4b86b0d3d18d3212101d` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:16.696712 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-99f2eadd-9c40-4c4b-8f92-63c29ee0528c None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:33:16.697950 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-99f2eadd-9c40-4c4b-8f92-63c29ee0528c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:16.720650 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4a9dce-9480-415f-9ea0-8309d284c5cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=55a65acab6e644b3a5505a17f2ee6071, user_id=73625201f6e14ccd8d756a6631f3f80e, role_id=27e3e65e24df4b86b0d3d18d3212101d)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:16.723469 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4a9dce-9480-415f-9ea0-8309d284c5cb admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:16.728050 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 777/1551] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:33:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:33:16.728979 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f2eadd-9c40-4c4b-8f92-63c29ee0528c None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:16.747931 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f2eadd-9c40-4c4b-8f92-63c29ee0528c None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:16.757801 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 775/1552] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 11:33:16 2022] PUT /identity/v3/projects/55a65acab6e644b3a5505a17f2ee6071/users/73625201f6e14ccd8d756a6631f3f80e/roles/27e3e65e24df4b86b0d3d18d3212101d => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:33:16.759408 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51573a2d-e654-44fd-b1b4-f843782f1f6c None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:16.759744 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51573a2d-e654-44fd-b1b4-f843782f1f6c None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:16.760019 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51573a2d-e654-44fd-b1b4-f843782f1f6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:16.788250 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-51573a2d-e654-44fd-b1b4-f843782f1f6c None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:33:16.790004 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-51573a2d-e654-44fd-b1b4-f843782f1f6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:16.817238 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc11480-2101-4edf-b684-de7e8d4d4bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:16.817788 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc11480-2101-4edf-b684-de7e8d4d4bd8 admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:16.818048 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc11480-2101-4edf-b684-de7e8d4d4bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:16.818316 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc11480-2101-4edf-b684-de7e8d4d4bd8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:16.818976 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc11480-2101-4edf-b684-de7e8d4d4bd8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:16.820000 dv-cinder-848899-3-smb devstack@keystone.service[81502]: WARNING py.warnings [None req-9bc11480-2101-4edf-b684-de7e8d4d4bd8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 11:33:16.820000 dv-cinder-848899-3-smb devstack@keystone.service[81502]: warnings.warn(msg) Aug 24 11:33:16.820000 dv-cinder-848899-3-smb devstack@keystone.service[81502]: Aug 24 11:33:16.821540 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc11480-2101-4edf-b684-de7e8d4d4bd8 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:16.848959 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 778/1553] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 11:33:16 2022] POST /identity/v3/projects => generated 383 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:33:16.850017 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc11480-2101-4edf-b684-de7e8d4d4bd8 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:16.864728 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 776/1554] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:33:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:33:16.864728 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e566e6eb-b031-474b-9b1f-9afc2aaf57c5 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:16.864728 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e566e6eb-b031-474b-9b1f-9afc2aaf57c5 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:16.864728 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e566e6eb-b031-474b-9b1f-9afc2aaf57c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:16.869505 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:16.885020 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-e566e6eb-b031-474b-9b1f-9afc2aaf57c5 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:33:16.886500 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-e566e6eb-b031-474b-9b1f-9afc2aaf57c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:16.914965 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc11480-2101-4edf-b684-de7e8d4d4bd8 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:16.919699 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493dabf8-77bf-40c6-a62c-28bf08c89456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:16.920320 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493dabf8-77bf-40c6-a62c-28bf08c89456 admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:16.920591 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493dabf8-77bf-40c6-a62c-28bf08c89456 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:16.920863 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493dabf8-77bf-40c6-a62c-28bf08c89456 admin admin] PATH_INFO: `/v3/domains` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:16.921513 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493dabf8-77bf-40c6-a62c-28bf08c89456 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:16.921815 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493dabf8-77bf-40c6-a62c-28bf08c89456 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:16.923508 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493dabf8-77bf-40c6-a62c-28bf08c89456 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:16.934995 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 779/1555] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 24 11:33:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:33:16.936198 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4549f2-9c17-4348-b876-ef885ea31f9d None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:16.936480 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4549f2-9c17-4348-b876-ef885ea31f9d None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:16.936756 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4549f2-9c17-4348-b876-ef885ea31f9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:16.947876 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 777/1556] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:33:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:33:16.949125 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0ff127-ab7c-4a94-8dc8-e8b591894171 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:16.949408 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0ff127-ab7c-4a94-8dc8-e8b591894171 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:16.949682 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0ff127-ab7c-4a94-8dc8-e8b591894171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:16.956546 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-7a4549f2-9c17-4348-b876-ef885ea31f9d None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:33:16.957830 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-7a4549f2-9c17-4348-b876-ef885ea31f9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:16.965745 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 780/1557] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:33:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:33:16.966960 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dbb07d-34fd-40cb-8c92-b73934a550d8 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:16.967241 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dbb07d-34fd-40cb-8c92-b73934a550d8 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:16.967507 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dbb07d-34fd-40cb-8c92-b73934a550d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:16.982965 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-3f0ff127-ab7c-4a94-8dc8-e8b591894171 None None] MFA Rules not processed for user `73625201f6e14ccd8d756a6631f3f80e`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:33:16.984249 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-3f0ff127-ab7c-4a94-8dc8-e8b591894171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:16.987507 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-f7dbb07d-34fd-40cb-8c92-b73934a550d8 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:33:16.988717 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-f7dbb07d-34fd-40cb-8c92-b73934a550d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:16.992869 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:16.996557 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 781/1558] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:33:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:33:16.997737 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbed2ae-e64d-402b-b2c6-37ae58666464 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:16.998018 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbed2ae-e64d-402b-b2c6-37ae58666464 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:16.998286 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbed2ae-e64d-402b-b2c6-37ae58666464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:17.019066 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-ffbed2ae-e64d-402b-b2c6-37ae58666464 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:33:17.020289 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-ffbed2ae-e64d-402b-b2c6-37ae58666464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:17.028349 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 782/1559] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:33:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:33:17.029102 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbed2ae-e64d-402b-b2c6-37ae58666464 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:17.040832 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbed2ae-e64d-402b-b2c6-37ae58666464 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:17.045952 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacf8adc-dd0c-4d39-a56a-0fc5748de3b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:17.046682 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacf8adc-dd0c-4d39-a56a-0fc5748de3b4 admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:17.046960 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacf8adc-dd0c-4d39-a56a-0fc5748de3b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:17.047230 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacf8adc-dd0c-4d39-a56a-0fc5748de3b4 admin admin] PATH_INFO: `/v3/users` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:17.047915 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacf8adc-dd0c-4d39-a56a-0fc5748de3b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:17.050086 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacf8adc-dd0c-4d39-a56a-0fc5748de3b4 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:17.065398 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 778/1560] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:33:16 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:33:17.066818 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32d7237-2120-4d25-bec7-1404d0330120 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:17.067099 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32d7237-2120-4d25-bec7-1404d0330120 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:17.067419 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32d7237-2120-4d25-bec7-1404d0330120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:17.079211 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 783/1561] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 11:33:17 2022] POST /identity/v3/users => generated 292 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:33:17.079211 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacf8adc-dd0c-4d39-a56a-0fc5748de3b4 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:17.089018 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-b32d7237-2120-4d25-bec7-1404d0330120 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:33:17.090210 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-b32d7237-2120-4d25-bec7-1404d0330120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:17.090503 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacf8adc-dd0c-4d39-a56a-0fc5748de3b4 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:17.095398 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3759a095-50c2-4f93-8f81-467d8b6f314a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:17.095989 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3759a095-50c2-4f93-8f81-467d8b6f314a admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:17.096261 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3759a095-50c2-4f93-8f81-467d8b6f314a admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:17.096555 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3759a095-50c2-4f93-8f81-467d8b6f314a admin admin] PATH_INFO: `/v3/projects` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:17.097257 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3759a095-50c2-4f93-8f81-467d8b6f314a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:17.098750 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 779/1562] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:33:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:33:17.099788 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3759a095-50c2-4f93-8f81-467d8b6f314a admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:17.099975 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f8993a-987a-468c-91db-a57ea4264fb6 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:17.100239 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f8993a-987a-468c-91db-a57ea4264fb6 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:17.100529 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f8993a-987a-468c-91db-a57ea4264fb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:17.121925 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-78f8993a-987a-468c-91db-a57ea4264fb6 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:33:17.123170 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-78f8993a-987a-468c-91db-a57ea4264fb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:17.132686 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 780/1563] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:33:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:33:17.133969 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2762780-5e22-46d1-86d7-f24dc1e6831f None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:17.134263 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2762780-5e22-46d1-86d7-f24dc1e6831f None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:17.134579 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2762780-5e22-46d1-86d7-f24dc1e6831f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:17.138383 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 784/1564] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 11:33:17 2022] POST /identity/v3/projects => generated 379 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:33:17.139628 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb88b62f-bc9d-4b9d-b31f-1907fb1b28ff None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:17.139926 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb88b62f-bc9d-4b9d-b31f-1907fb1b28ff None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:17.140174 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb88b62f-bc9d-4b9d-b31f-1907fb1b28ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:17.156943 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-f2762780-5e22-46d1-86d7-f24dc1e6831f None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:33:17.158254 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-f2762780-5e22-46d1-86d7-f24dc1e6831f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:17.159471 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-eb88b62f-bc9d-4b9d-b31f-1907fb1b28ff None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:33:17.160711 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-eb88b62f-bc9d-4b9d-b31f-1907fb1b28ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:17.217914 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 781/1565] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:33:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:33:17.218798 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 785/1566] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:33:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:33:17.219738 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7687dffe-b982-4b0a-ba37-d92e569bd584 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:17.220110 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7687dffe-b982-4b0a-ba37-d92e569bd584 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:17.220372 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb88b62f-bc9d-4b9d-b31f-1907fb1b28ff None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:17.220539 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7687dffe-b982-4b0a-ba37-d92e569bd584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:17.231089 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb88b62f-bc9d-4b9d-b31f-1907fb1b28ff None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:17.235799 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32bd3a5-f63d-4321-bde8-902ae89fdce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:17.236400 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32bd3a5-f63d-4321-bde8-902ae89fdce2 admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:17.236675 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32bd3a5-f63d-4321-bde8-902ae89fdce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:17.236945 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32bd3a5-f63d-4321-bde8-902ae89fdce2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:17.237622 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32bd3a5-f63d-4321-bde8-902ae89fdce2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:17.239582 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32bd3a5-f63d-4321-bde8-902ae89fdce2 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:17.240230 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-7687dffe-b982-4b0a-ba37-d92e569bd584 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:33:17.241488 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-7687dffe-b982-4b0a-ba37-d92e569bd584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:17.249363 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 782/1567] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:33:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:33:17.250222 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7687dffe-b982-4b0a-ba37-d92e569bd584 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:17.253804 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 786/1568] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:33:17 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:33:17.255173 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9487be-bc29-4fbd-80dc-2eeb96fbf537 None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:17.255623 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9487be-bc29-4fbd-80dc-2eeb96fbf537 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:17.255904 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9487be-bc29-4fbd-80dc-2eeb96fbf537 None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:17.257492 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 787/1569] 10.222.0.27 () {54 vars in 962 bytes} [Wed Aug 24 11:33:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:33:17.258196 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9487be-bc29-4fbd-80dc-2eeb96fbf537 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:17.260550 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7687dffe-b982-4b0a-ba37-d92e569bd584 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:17.265122 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b48724c-e663-40b5-b435-c580a60840fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:17.265718 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b48724c-e663-40b5-b435-c580a60840fb admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:17.265996 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b48724c-e663-40b5-b435-c580a60840fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:17.266311 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b48724c-e663-40b5-b435-c580a60840fb admin admin] PATH_INFO: `/v3/domains` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:17.266994 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b48724c-e663-40b5-b435-c580a60840fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:17.267330 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b48724c-e663-40b5-b435-c580a60840fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:17.268341 dv-cinder-848899-3-smb devstack@keystone.service[81501]: WARNING py.warnings [None req-7b48724c-e663-40b5-b435-c580a60840fb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 11:33:17.268341 dv-cinder-848899-3-smb devstack@keystone.service[81501]: warnings.warn(msg) Aug 24 11:33:17.268341 dv-cinder-848899-3-smb devstack@keystone.service[81501]: Aug 24 11:33:17.269259 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b48724c-e663-40b5-b435-c580a60840fb admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:17.271394 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9487be-bc29-4fbd-80dc-2eeb96fbf537 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:17.276059 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac22a88c-249e-4c94-a463-f50f66466ab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:17.276631 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac22a88c-249e-4c94-a463-f50f66466ab4 admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:17.276909 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac22a88c-249e-4c94-a463-f50f66466ab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:17.277184 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac22a88c-249e-4c94-a463-f50f66466ab4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:17.277846 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac22a88c-249e-4c94-a463-f50f66466ab4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:17.278534 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac22a88c-249e-4c94-a463-f50f66466ab4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:17.279804 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac22a88c-249e-4c94-a463-f50f66466ab4 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:17.281322 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 783/1570] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 24 11:33:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:33:17.290050 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b48724c-e663-40b5-b435-c580a60840fb admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:17.292408 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 788/1571] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 24 11:33:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:33:17.293258 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac22a88c-249e-4c94-a463-f50f66466ab4 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:17.300856 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b48724c-e663-40b5-b435-c580a60840fb admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:17.305742 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4df7899-fb27-4d41-ae7d-06ccc4a9f59c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:17.306391 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4df7899-fb27-4d41-ae7d-06ccc4a9f59c admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:17.306668 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4df7899-fb27-4d41-ae7d-06ccc4a9f59c admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:17.306941 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4df7899-fb27-4d41-ae7d-06ccc4a9f59c admin admin] PATH_INFO: `/v3/users` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:17.307601 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4df7899-fb27-4d41-ae7d-06ccc4a9f59c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:17.308645 dv-cinder-848899-3-smb devstack@keystone.service[81501]: WARNING py.warnings [None req-e4df7899-fb27-4d41-ae7d-06ccc4a9f59c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 11:33:17.308645 dv-cinder-848899-3-smb devstack@keystone.service[81501]: warnings.warn(msg) Aug 24 11:33:17.308645 dv-cinder-848899-3-smb devstack@keystone.service[81501]: Aug 24 11:33:17.309266 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac22a88c-249e-4c94-a463-f50f66466ab4 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:17.309990 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4df7899-fb27-4d41-ae7d-06ccc4a9f59c admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:17.313927 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42849629-874d-46a6-ae06-a6af38118ef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:17.314555 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42849629-874d-46a6-ae06-a6af38118ef5 admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:17.314840 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42849629-874d-46a6-ae06-a6af38118ef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:17.315110 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42849629-874d-46a6-ae06-a6af38118ef5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:17.315749 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42849629-874d-46a6-ae06-a6af38118ef5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:17.316124 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42849629-874d-46a6-ae06-a6af38118ef5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:17.317769 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42849629-874d-46a6-ae06-a6af38118ef5 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:17.332182 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 789/1572] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 24 11:33:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:33:17.333208 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 784/1573] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 11:33:17 2022] POST /identity/v3/users => generated 290 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:33:17.333401 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42849629-874d-46a6-ae06-a6af38118ef5 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:17.334056 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4df7899-fb27-4d41-ae7d-06ccc4a9f59c admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:17.344287 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42849629-874d-46a6-ae06-a6af38118ef5 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:17.344482 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4df7899-fb27-4d41-ae7d-06ccc4a9f59c admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:17.349139 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9281e819-5aa5-452b-a3d5-af7f0bf62f54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:17.349328 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e6b3ce-8a75-4d41-9116-8f313b9d3eba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:17.349756 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9281e819-5aa5-452b-a3d5-af7f0bf62f54 admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:17.349936 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e6b3ce-8a75-4d41-9116-8f313b9d3eba admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:17.350055 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9281e819-5aa5-452b-a3d5-af7f0bf62f54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:17.350272 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9281e819-5aa5-452b-a3d5-af7f0bf62f54 admin admin] PATH_INFO: `/v3/domains` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:17.350414 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e6b3ce-8a75-4d41-9116-8f313b9d3eba admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:17.350937 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9281e819-5aa5-452b-a3d5-af7f0bf62f54 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:17.351048 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e6b3ce-8a75-4d41-9116-8f313b9d3eba admin admin] PATH_INFO: `/v3/domains` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:17.351234 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9281e819-5aa5-452b-a3d5-af7f0bf62f54 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:17.351673 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e6b3ce-8a75-4d41-9116-8f313b9d3eba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:17.352037 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e6b3ce-8a75-4d41-9116-8f313b9d3eba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:17.352846 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9281e819-5aa5-452b-a3d5-af7f0bf62f54 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:17.353648 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e6b3ce-8a75-4d41-9116-8f313b9d3eba admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:17.360255 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:17.366915 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 790/1574] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 24 11:33:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:33:17.367823 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9281e819-5aa5-452b-a3d5-af7f0bf62f54 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:17.373880 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 785/1575] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 24 11:33:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:33:17.375278 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093fda8a-b4a0-4a90-b384-5d94aa122352 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:17.375565 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093fda8a-b4a0-4a90-b384-5d94aa122352 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:17.375844 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093fda8a-b4a0-4a90-b384-5d94aa122352 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:17.378062 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9281e819-5aa5-452b-a3d5-af7f0bf62f54 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:17.383016 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ca26d4-c0ab-4333-b99c-6f524e32512b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:17.383606 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ca26d4-c0ab-4333-b99c-6f524e32512b admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:17.383882 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ca26d4-c0ab-4333-b99c-6f524e32512b admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:17.384152 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ca26d4-c0ab-4333-b99c-6f524e32512b admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:17.384786 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ca26d4-c0ab-4333-b99c-6f524e32512b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:17.386434 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ca26d4-c0ab-4333-b99c-6f524e32512b admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:17.399745 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 791/1576] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:33:17 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:33:17.399745 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ca26d4-c0ab-4333-b99c-6f524e32512b admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:17.406527 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ca26d4-c0ab-4333-b99c-6f524e32512b admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:17.411109 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c06ee84-2e89-4b8f-aa36-a144344b0830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:17.411685 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c06ee84-2e89-4b8f-aa36-a144344b0830 admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:17.411961 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c06ee84-2e89-4b8f-aa36-a144344b0830 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:17.412228 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c06ee84-2e89-4b8f-aa36-a144344b0830 admin admin] PATH_INFO: `/v3/projects` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:17.412849 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c06ee84-2e89-4b8f-aa36-a144344b0830 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:17.414614 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-093fda8a-b4a0-4a90-b384-5d94aa122352 None None] MFA Rules not processed for user `282ec32864d046b2bea170f6a3845cc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:33:17.414777 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c06ee84-2e89-4b8f-aa36-a144344b0830 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:17.415889 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-093fda8a-b4a0-4a90-b384-5d94aa122352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:17.443462 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 792/1577] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 11:33:17 2022] POST /identity/v3/projects => generated 387 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:33:17.444540 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c06ee84-2e89-4b8f-aa36-a144344b0830 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:17.446388 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:17.484599 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 786/1578] 10.222.0.27 () {58 vars in 1059 bytes} [Wed Aug 24 11:33:17 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:33:17.485453 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093fda8a-b4a0-4a90-b384-5d94aa122352 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:17.495373 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093fda8a-b4a0-4a90-b384-5d94aa122352 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:17.508704 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c06ee84-2e89-4b8f-aa36-a144344b0830 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:17.513366 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17816a24-ed06-4970-97a1-d0f05ac3419d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:17.513972 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17816a24-ed06-4970-97a1-d0f05ac3419d admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:17.514244 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17816a24-ed06-4970-97a1-d0f05ac3419d admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:17.514540 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17816a24-ed06-4970-97a1-d0f05ac3419d admin admin] PATH_INFO: `/v3/projects` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:17.515193 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17816a24-ed06-4970-97a1-d0f05ac3419d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:17.517125 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17816a24-ed06-4970-97a1-d0f05ac3419d admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:17.544117 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 793/1579] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 11:33:17 2022] POST /identity/v3/projects => generated 381 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:33:17.544976 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17816a24-ed06-4970-97a1-d0f05ac3419d admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:17.551553 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af75aba-71ab-4e0f-9fd0-4cdc4a127bae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:17.552307 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af75aba-71ab-4e0f-9fd0-4cdc4a127bae admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:17.552647 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af75aba-71ab-4e0f-9fd0-4cdc4a127bae admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:17.552980 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af75aba-71ab-4e0f-9fd0-4cdc4a127bae admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:17.553703 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af75aba-71ab-4e0f-9fd0-4cdc4a127bae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:17.555376 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af75aba-71ab-4e0f-9fd0-4cdc4a127bae admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:17.565306 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 787/1580] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:33:17 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:33:17.566154 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af75aba-71ab-4e0f-9fd0-4cdc4a127bae admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:17.575779 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af75aba-71ab-4e0f-9fd0-4cdc4a127bae admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:17.612006 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17816a24-ed06-4970-97a1-d0f05ac3419d admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:17.617546 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36737c4e-c9c5-4d3e-a23f-c89864037700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:17.618158 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36737c4e-c9c5-4d3e-a23f-c89864037700 admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:17.618482 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36737c4e-c9c5-4d3e-a23f-c89864037700 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:17.618760 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36737c4e-c9c5-4d3e-a23f-c89864037700 admin admin] PATH_INFO: `/v3/projects` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:17.619391 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36737c4e-c9c5-4d3e-a23f-c89864037700 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:17.621366 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36737c4e-c9c5-4d3e-a23f-c89864037700 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:17.632964 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28f331e-7a13-4bf6-bc5f-ad2fb6f94e3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:17.633670 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28f331e-7a13-4bf6-bc5f-ad2fb6f94e3f admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:17.633946 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28f331e-7a13-4bf6-bc5f-ad2fb6f94e3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:17.634256 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28f331e-7a13-4bf6-bc5f-ad2fb6f94e3f admin admin] PATH_INFO: `/v3/projects` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:17.635092 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28f331e-7a13-4bf6-bc5f-ad2fb6f94e3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:17.637025 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28f331e-7a13-4bf6-bc5f-ad2fb6f94e3f admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:17.648590 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 794/1581] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 11:33:17 2022] POST /identity/v3/projects => generated 363 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:33:17.649550 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36737c4e-c9c5-4d3e-a23f-c89864037700 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:17.671266 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 788/1582] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 11:33:17 2022] POST /identity/v3/projects => generated 387 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:33:17.671266 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28f331e-7a13-4bf6-bc5f-ad2fb6f94e3f admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:17.693901 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:17.716576 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:17.718556 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36737c4e-c9c5-4d3e-a23f-c89864037700 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:17.732302 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28f331e-7a13-4bf6-bc5f-ad2fb6f94e3f admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:17.737838 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34f594d-e0a7-485f-aa8a-e550b3e71b3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:17.738562 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34f594d-e0a7-485f-aa8a-e550b3e71b3a admin admin] REQUEST_METHOD: `PUT` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:17.738835 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34f594d-e0a7-485f-aa8a-e550b3e71b3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:17.739101 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34f594d-e0a7-485f-aa8a-e550b3e71b3a admin admin] PATH_INFO: `/v3/projects/a87b560b6a3e4f9baa16d0ad4758b1ff/users/c53eb370dc294248b3be2248570d1b04/roles/27e3e65e24df4b86b0d3d18d3212101d` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:17.753925 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34f594d-e0a7-485f-aa8a-e550b3e71b3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a87b560b6a3e4f9baa16d0ad4758b1ff, user_id=c53eb370dc294248b3be2248570d1b04, role_id=27e3e65e24df4b86b0d3d18d3212101d)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:17.756944 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34f594d-e0a7-485f-aa8a-e550b3e71b3a admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:17.772146 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 789/1583] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 11:33:17 2022] PUT /identity/v3/projects/a87b560b6a3e4f9baa16d0ad4758b1ff/users/c53eb370dc294248b3be2248570d1b04/roles/27e3e65e24df4b86b0d3d18d3212101d => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:33:17.772977 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34f594d-e0a7-485f-aa8a-e550b3e71b3a admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:17.779607 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15d0398-81aa-4570-ac18-fe8ca3a0a60f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:17.780232 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15d0398-81aa-4570-ac18-fe8ca3a0a60f admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:17.780511 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15d0398-81aa-4570-ac18-fe8ca3a0a60f admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:17.780781 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15d0398-81aa-4570-ac18-fe8ca3a0a60f admin admin] PATH_INFO: `/v3/projects` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:17.781412 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15d0398-81aa-4570-ac18-fe8ca3a0a60f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:17.783372 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15d0398-81aa-4570-ac18-fe8ca3a0a60f admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:17.811986 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 795/1584] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 11:33:17 2022] POST /identity/v3/projects => generated 393 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:33:17.816296 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15d0398-81aa-4570-ac18-fe8ca3a0a60f admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:17.835102 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34f594d-e0a7-485f-aa8a-e550b3e71b3a admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:17.889255 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15d0398-81aa-4570-ac18-fe8ca3a0a60f admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:17.892934 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ab3c4b-a0f0-404f-b853-40038eb32d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:17.893551 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ab3c4b-a0f0-404f-b853-40038eb32d6d admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:17.893831 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ab3c4b-a0f0-404f-b853-40038eb32d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:17.894159 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ab3c4b-a0f0-404f-b853-40038eb32d6d admin admin] PATH_INFO: `/v3/users` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:17.894805 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ab3c4b-a0f0-404f-b853-40038eb32d6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:17.894929 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50842e19-ad17-4478-ba1a-3c209510717b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '282ec32864d046b2bea170f6a3845cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:17.895548 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50842e19-ad17-4478-ba1a-3c209510717b service nova] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:17.895831 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50842e19-ad17-4478-ba1a-3c209510717b service nova] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:17.896102 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50842e19-ad17-4478-ba1a-3c209510717b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:17.896745 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ab3c4b-a0f0-404f-b853-40038eb32d6d admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:17.920610 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 790/1585] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 11:33:17 2022] POST /identity/v3/users => generated 294 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:33:17.921268 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ab3c4b-a0f0-404f-b853-40038eb32d6d admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:17.931089 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ab3c4b-a0f0-404f-b853-40038eb32d6d admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:17.935937 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89c9c39-f1fc-4ef7-82a1-f86a570c19ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:17.936541 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89c9c39-f1fc-4ef7-82a1-f86a570c19ed admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:17.937006 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89c9c39-f1fc-4ef7-82a1-f86a570c19ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:17.937133 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89c9c39-f1fc-4ef7-82a1-f86a570c19ed admin admin] PATH_INFO: `/v3/users` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:17.937706 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89c9c39-f1fc-4ef7-82a1-f86a570c19ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:17.939686 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89c9c39-f1fc-4ef7-82a1-f86a570c19ed admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:17.956679 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50842e19-ad17-4478-ba1a-3c209510717b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:17.958386 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50842e19-ad17-4478-ba1a-3c209510717b service nova] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:17.961267 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 791/1586] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 11:33:17 2022] POST /identity/v3/users => generated 291 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:33:17.962118 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89c9c39-f1fc-4ef7-82a1-f86a570c19ed admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:17.970551 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 796/1587] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:33:17 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:33:17.972432 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89c9c39-f1fc-4ef7-82a1-f86a570c19ed admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:17.975304 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50842e19-ad17-4478-ba1a-3c209510717b service nova] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:17.977166 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5b7d6d-b41a-4139-9132-af37cc32b335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:17.977846 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5b7d6d-b41a-4139-9132-af37cc32b335 admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:17.978097 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5b7d6d-b41a-4139-9132-af37cc32b335 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:17.978386 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5b7d6d-b41a-4139-9132-af37cc32b335 admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:17.979036 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5b7d6d-b41a-4139-9132-af37cc32b335 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:17.980654 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5b7d6d-b41a-4139-9132-af37cc32b335 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:17.981733 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:17.987666 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50842e19-ad17-4478-ba1a-3c209510717b service nova] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:17.994503 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 792/1588] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:33:17 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:33:17.994651 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bfbe5d-472e-4ba7-a5a7-658391d03e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:17.995379 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bfbe5d-472e-4ba7-a5a7-658391d03e92 admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:17.995661 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bfbe5d-472e-4ba7-a5a7-658391d03e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:17.995877 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5b7d6d-b41a-4139-9132-af37cc32b335 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:17.995996 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bfbe5d-472e-4ba7-a5a7-658391d03e92 admin admin] PATH_INFO: `/v3/users` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:17.996709 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bfbe5d-472e-4ba7-a5a7-658391d03e92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:17.999130 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bfbe5d-472e-4ba7-a5a7-658391d03e92 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:18.006753 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5b7d6d-b41a-4139-9132-af37cc32b335 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:18.011676 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329ac583-268e-4610-9b35-576e4bb820be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:18.012297 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329ac583-268e-4610-9b35-576e4bb820be admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:18.012548 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329ac583-268e-4610-9b35-576e4bb820be admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:18.012967 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329ac583-268e-4610-9b35-576e4bb820be admin admin] PATH_INFO: `/v3/users` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:18.013437 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329ac583-268e-4610-9b35-576e4bb820be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:18.015428 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329ac583-268e-4610-9b35-576e4bb820be admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:18.030176 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 797/1589] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 11:33:17 2022] POST /identity/v3/users => generated 282 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:33:18.031711 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b630e4c1-43af-4ef4-8ca7-a7a47a3fdd50 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:18.032003 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b630e4c1-43af-4ef4-8ca7-a7a47a3fdd50 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:18.032291 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b630e4c1-43af-4ef4-8ca7-a7a47a3fdd50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:18.041463 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 793/1590] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 11:33:17 2022] POST /identity/v3/users => generated 294 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:33:18.042312 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329ac583-268e-4610-9b35-576e4bb820be admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:18.052672 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329ac583-268e-4610-9b35-576e4bb820be admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:18.052836 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-b630e4c1-43af-4ef4-8ca7-a7a47a3fdd50 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:33:18.053859 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-b630e4c1-43af-4ef4-8ca7-a7a47a3fdd50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:18.057487 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d5da4b-7e79-4eec-a72d-e54cd32bb44a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:18.058088 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d5da4b-7e79-4eec-a72d-e54cd32bb44a admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:18.058398 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d5da4b-7e79-4eec-a72d-e54cd32bb44a admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:18.058678 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d5da4b-7e79-4eec-a72d-e54cd32bb44a admin admin] PATH_INFO: `/v3/users` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:18.059433 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d5da4b-7e79-4eec-a72d-e54cd32bb44a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:18.061353 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d5da4b-7e79-4eec-a72d-e54cd32bb44a admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:18.061823 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 798/1591] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:33:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:33:18.062384 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b630e4c1-43af-4ef4-8ca7-a7a47a3fdd50 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:18.071863 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b630e4c1-43af-4ef4-8ca7-a7a47a3fdd50 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:18.077015 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215c2332-774f-42d8-a0a5-9686420433f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:18.077659 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215c2332-774f-42d8-a0a5-9686420433f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:18.077995 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215c2332-774f-42d8-a0a5-9686420433f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:18.078261 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215c2332-774f-42d8-a0a5-9686420433f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:18.078934 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215c2332-774f-42d8-a0a5-9686420433f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:18.080680 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215c2332-774f-42d8-a0a5-9686420433f4 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:18.091844 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 794/1592] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 11:33:18 2022] POST /identity/v3/users => generated 297 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:33:18.091844 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d5da4b-7e79-4eec-a72d-e54cd32bb44a admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:18.095570 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=87,keystone:INSERT=13 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:18.098761 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 799/1593] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:33:18 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:33:18.098761 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215c2332-774f-42d8-a0a5-9686420433f4 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:18.108913 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d5da4b-7e79-4eec-a72d-e54cd32bb44a admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:18.109510 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215c2332-774f-42d8-a0a5-9686420433f4 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:18.114920 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596d07bd-9ba5-4519-a81b-2611b9cbbcad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:18.115780 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596d07bd-9ba5-4519-a81b-2611b9cbbcad admin admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:18.116063 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596d07bd-9ba5-4519-a81b-2611b9cbbcad admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:18.116325 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596d07bd-9ba5-4519-a81b-2611b9cbbcad admin admin] PATH_INFO: `/v3/projects/b6fdd897eaa14182b8cdc89f56fac227/users/83a80b36a7d64f1c95cc7e772acf38e2/roles/27e3e65e24df4b86b0d3d18d3212101d` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:18.123638 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831bab29-12a4-412b-8f49-229a43618c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:18.124450 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831bab29-12a4-412b-8f49-229a43618c75 admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:18.124890 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831bab29-12a4-412b-8f49-229a43618c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:18.125321 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831bab29-12a4-412b-8f49-229a43618c75 admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:18.126679 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831bab29-12a4-412b-8f49-229a43618c75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:18.129786 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831bab29-12a4-412b-8f49-229a43618c75 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:18.133257 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596d07bd-9ba5-4519-a81b-2611b9cbbcad admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6fdd897eaa14182b8cdc89f56fac227, user_id=83a80b36a7d64f1c95cc7e772acf38e2, role_id=27e3e65e24df4b86b0d3d18d3212101d)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:18.134307 dv-cinder-848899-3-smb devstack@keystone.service[81502]: WARNING py.warnings [None req-596d07bd-9ba5-4519-a81b-2611b9cbbcad admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 11:33:18.134307 dv-cinder-848899-3-smb devstack@keystone.service[81502]: warnings.warn(msg) Aug 24 11:33:18.134307 dv-cinder-848899-3-smb devstack@keystone.service[81502]: Aug 24 11:33:18.136278 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596d07bd-9ba5-4519-a81b-2611b9cbbcad admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:18.145032 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 795/1594] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:33:18 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:33:18.145863 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831bab29-12a4-412b-8f49-229a43618c75 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:18.151203 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 800/1595] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 11:33:18 2022] PUT /identity/v3/projects/b6fdd897eaa14182b8cdc89f56fac227/users/83a80b36a7d64f1c95cc7e772acf38e2/roles/27e3e65e24df4b86b0d3d18d3212101d => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:33:18.155572 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831bab29-12a4-412b-8f49-229a43618c75 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:18.155714 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596d07bd-9ba5-4519-a81b-2611b9cbbcad admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:18.223760 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596d07bd-9ba5-4519-a81b-2611b9cbbcad admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:18.226329 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79308de8-c46e-4ac1-8583-904e78f34d61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:18.227062 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79308de8-c46e-4ac1-8583-904e78f34d61 admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:18.227343 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79308de8-c46e-4ac1-8583-904e78f34d61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:18.227765 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79308de8-c46e-4ac1-8583-904e78f34d61 admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:18.228420 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79308de8-c46e-4ac1-8583-904e78f34d61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:18.229030 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fadf8c-5d56-4ea1-b7e5-42badf538b04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:18.229640 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fadf8c-5d56-4ea1-b7e5-42badf538b04 admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:18.229919 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fadf8c-5d56-4ea1-b7e5-42badf538b04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:18.230070 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79308de8-c46e-4ac1-8583-904e78f34d61 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:18.230176 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fadf8c-5d56-4ea1-b7e5-42badf538b04 admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:18.230852 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fadf8c-5d56-4ea1-b7e5-42badf538b04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:18.232474 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fadf8c-5d56-4ea1-b7e5-42badf538b04 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:18.240253 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 796/1596] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:33:18 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:33:18.241440 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79308de8-c46e-4ac1-8583-904e78f34d61 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:18.245792 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 801/1597] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:33:18 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:33:18.245792 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fadf8c-5d56-4ea1-b7e5-42badf538b04 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:18.254009 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fadf8c-5d56-4ea1-b7e5-42badf538b04 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:18.260310 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919baab2-665d-4e7e-971b-02fd1f4dca04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:18.261046 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919baab2-665d-4e7e-971b-02fd1f4dca04 admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:18.261403 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919baab2-665d-4e7e-971b-02fd1f4dca04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:18.261817 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919baab2-665d-4e7e-971b-02fd1f4dca04 admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:18.262546 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919baab2-665d-4e7e-971b-02fd1f4dca04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:18.264182 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919baab2-665d-4e7e-971b-02fd1f4dca04 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:18.274377 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 802/1598] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:33:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:33:18.277429 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919baab2-665d-4e7e-971b-02fd1f4dca04 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:18.284818 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919baab2-665d-4e7e-971b-02fd1f4dca04 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:18.289486 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a6ea1a-0072-4d8b-8449-987092763734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:18.290053 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a6ea1a-0072-4d8b-8449-987092763734 admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:18.290328 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a6ea1a-0072-4d8b-8449-987092763734 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:18.290619 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a6ea1a-0072-4d8b-8449-987092763734 admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:18.291245 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a6ea1a-0072-4d8b-8449-987092763734 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:18.292818 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a6ea1a-0072-4d8b-8449-987092763734 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:18.302696 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79308de8-c46e-4ac1-8583-904e78f34d61 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:18.303196 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 803/1599] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:33:18 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:33:18.304029 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a6ea1a-0072-4d8b-8449-987092763734 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:18.309435 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c9ec00-da96-42ce-9159-564c5eda9f41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2d061d25d83443c9232218c90792d51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:18.310049 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c9ec00-da96-42ce-9159-564c5eda9f41 service neutron] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:18.310322 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c9ec00-da96-42ce-9159-564c5eda9f41 service neutron] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:18.310621 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c9ec00-da96-42ce-9159-564c5eda9f41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:18.313247 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a6ea1a-0072-4d8b-8449-987092763734 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:18.317847 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c3dd7d-0816-4a31-b363-5bc68ea21262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:18.318432 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c3dd7d-0816-4a31-b363-5bc68ea21262 admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:18.318706 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c3dd7d-0816-4a31-b363-5bc68ea21262 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:18.318969 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c3dd7d-0816-4a31-b363-5bc68ea21262 admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:18.319585 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c3dd7d-0816-4a31-b363-5bc68ea21262 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:18.320200 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c9ec00-da96-42ce-9159-564c5eda9f41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:18.321142 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c3dd7d-0816-4a31-b363-5bc68ea21262 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:18.321634 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c9ec00-da96-42ce-9159-564c5eda9f41 service neutron] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:18.331205 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 797/1600] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:33:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:33:18.331365 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 804/1601] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:33:18 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:33:18.332717 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c883cc-148e-4c92-8111-91bf79920a0e None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:18.333003 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c883cc-148e-4c92-8111-91bf79920a0e None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:18.333336 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c883cc-148e-4c92-8111-91bf79920a0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:18.336080 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee130915-3feb-429b-84b7-973353ab42f6 None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:18.336340 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee130915-3feb-429b-84b7-973353ab42f6 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:18.336611 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee130915-3feb-429b-84b7-973353ab42f6 None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:18.338148 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 805/1602] 10.222.0.27 () {54 vars in 912 bytes} [Wed Aug 24 11:33:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:33:18.343145 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee130915-3feb-429b-84b7-973353ab42f6 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:18.354311 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-b2c883cc-148e-4c92-8111-91bf79920a0e None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:33:18.355695 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-b2c883cc-148e-4c92-8111-91bf79920a0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:18.356561 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee130915-3feb-429b-84b7-973353ab42f6 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:18.361803 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14107c0-18cd-492d-8174-6b3f8de747af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:18.362414 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14107c0-18cd-492d-8174-6b3f8de747af admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:18.362692 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14107c0-18cd-492d-8174-6b3f8de747af admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:18.363098 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14107c0-18cd-492d-8174-6b3f8de747af admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:18.363777 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14107c0-18cd-492d-8174-6b3f8de747af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:18.368218 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 798/1603] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:33:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:33:18.368390 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14107c0-18cd-492d-8174-6b3f8de747af admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:18.368502 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c883cc-148e-4c92-8111-91bf79920a0e None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:18.378246 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c883cc-148e-4c92-8111-91bf79920a0e None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:18.385982 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 806/1604] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:33:18 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:33:18.385982 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14107c0-18cd-492d-8174-6b3f8de747af admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:18.387101 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247e6379-7945-485c-ac58-311b0c14fcad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:18.387931 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247e6379-7945-485c-ac58-311b0c14fcad admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:18.388314 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247e6379-7945-485c-ac58-311b0c14fcad admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:18.388703 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247e6379-7945-485c-ac58-311b0c14fcad admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:18.389457 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247e6379-7945-485c-ac58-311b0c14fcad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:18.391288 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247e6379-7945-485c-ac58-311b0c14fcad admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:18.399759 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14107c0-18cd-492d-8174-6b3f8de747af admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:18.404929 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 799/1605] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:33:18 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:33:18.406084 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247e6379-7945-485c-ac58-311b0c14fcad admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:18.406920 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50171a5b-f978-4fde-8bcf-369f9ddcc1f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:18.407944 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50171a5b-f978-4fde-8bcf-369f9ddcc1f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:18.408461 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50171a5b-f978-4fde-8bcf-369f9ddcc1f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:18.408708 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50171a5b-f978-4fde-8bcf-369f9ddcc1f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:18.409589 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50171a5b-f978-4fde-8bcf-369f9ddcc1f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:18.411732 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50171a5b-f978-4fde-8bcf-369f9ddcc1f3 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:18.417274 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247e6379-7945-485c-ac58-311b0c14fcad admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:18.423047 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b277856f-b917-46d2-bf10-3f05dff8ec7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:18.423834 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b277856f-b917-46d2-bf10-3f05dff8ec7f admin admin] REQUEST_METHOD: `PUT` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:18.424207 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b277856f-b917-46d2-bf10-3f05dff8ec7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:18.424596 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b277856f-b917-46d2-bf10-3f05dff8ec7f admin admin] PATH_INFO: `/v3/projects/1df16f22d7ab46dab17aff9c5350dcf7/users/6b08455fa85c4b60af58e9f213a00a4d/roles/27e3e65e24df4b86b0d3d18d3212101d` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:18.425025 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 807/1606] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:33:18 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:33:18.429032 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50171a5b-f978-4fde-8bcf-369f9ddcc1f3 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:18.440852 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50171a5b-f978-4fde-8bcf-369f9ddcc1f3 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:18.443410 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b277856f-b917-46d2-bf10-3f05dff8ec7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1df16f22d7ab46dab17aff9c5350dcf7, user_id=6b08455fa85c4b60af58e9f213a00a4d, role_id=27e3e65e24df4b86b0d3d18d3212101d)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:18.445616 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cb35c0-8fe7-4d12-917a-74585338dc86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:18.446293 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cb35c0-8fe7-4d12-917a-74585338dc86 admin admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:18.446427 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b277856f-b917-46d2-bf10-3f05dff8ec7f admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:18.446608 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cb35c0-8fe7-4d12-917a-74585338dc86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:18.446878 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cb35c0-8fe7-4d12-917a-74585338dc86 admin admin] PATH_INFO: `/v3/projects/427d950fbd984c44a0834e30e6e6f6ad/users/1d5487075cb542bc844ddf3efe1e9659/roles/27e3e65e24df4b86b0d3d18d3212101d` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:18.463642 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 800/1607] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 11:33:18 2022] PUT /identity/v3/projects/1df16f22d7ab46dab17aff9c5350dcf7/users/6b08455fa85c4b60af58e9f213a00a4d/roles/27e3e65e24df4b86b0d3d18d3212101d => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:33:18.467382 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cb35c0-8fe7-4d12-917a-74585338dc86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=427d950fbd984c44a0834e30e6e6f6ad, user_id=1d5487075cb542bc844ddf3efe1e9659, role_id=27e3e65e24df4b86b0d3d18d3212101d)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:18.468914 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f589852-674e-4f58-9948-ade68f4d68e0 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:18.469270 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f589852-674e-4f58-9948-ade68f4d68e0 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:18.469613 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f589852-674e-4f58-9948-ade68f4d68e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:18.470861 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cb35c0-8fe7-4d12-917a-74585338dc86 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:18.496715 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 808/1608] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 11:33:18 2022] PUT /identity/v3/projects/427d950fbd984c44a0834e30e6e6f6ad/users/1d5487075cb542bc844ddf3efe1e9659/roles/27e3e65e24df4b86b0d3d18d3212101d => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:33:18.496715 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cb35c0-8fe7-4d12-917a-74585338dc86 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:18.496715 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-14cb35c0-8fe7-4d12-917a-74585338dc86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:18.505600 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-3f589852-674e-4f58-9948-ade68f4d68e0 None None] MFA Rules not processed for user `282ec32864d046b2bea170f6a3845cc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:33:18.508771 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-3f589852-674e-4f58-9948-ade68f4d68e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:18.534808 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:18.562313 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:18.575190 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cb35c0-8fe7-4d12-917a-74585338dc86 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:18.579252 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8e7b94-1d22-4188-9615-b8b9d8a3ceff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2d061d25d83443c9232218c90792d51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:18.579871 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8e7b94-1d22-4188-9615-b8b9d8a3ceff service neutron] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:18.580152 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8e7b94-1d22-4188-9615-b8b9d8a3ceff service neutron] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:18.580581 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8e7b94-1d22-4188-9615-b8b9d8a3ceff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:18.591672 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 801/1609] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Aug 24 11:33:18 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:33:18.592527 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f589852-674e-4f58-9948-ade68f4d68e0 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:18.652068 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8e7b94-1d22-4188-9615-b8b9d8a3ceff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:18.653953 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8e7b94-1d22-4188-9615-b8b9d8a3ceff service neutron] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:18.666449 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 809/1610] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:33:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:33:18.666662 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f589852-674e-4f58-9948-ade68f4d68e0 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:18.669140 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8e7b94-1d22-4188-9615-b8b9d8a3ceff service neutron] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:18.674443 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c089298-c359-442e-bd11-92576dd3b925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:18.677017 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c089298-c359-442e-bd11-92576dd3b925 admin admin] REQUEST_METHOD: `PUT` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:18.677564 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c089298-c359-442e-bd11-92576dd3b925 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:18.678109 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c089298-c359-442e-bd11-92576dd3b925 admin admin] PATH_INFO: `/v3/projects/ff9f64d5dd4840a4b4221f4f23b6e99b/users/2a85e44153f546f68cfd5f4c97dda313/roles/27e3e65e24df4b86b0d3d18d3212101d` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:18.679476 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8e7b94-1d22-4188-9615-b8b9d8a3ceff service neutron] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:18.684575 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5171af8c-1915-4a15-8ef7-0bd05c80dad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:18.685355 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5171af8c-1915-4a15-8ef7-0bd05c80dad0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:18.685693 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5171af8c-1915-4a15-8ef7-0bd05c80dad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:18.686027 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5171af8c-1915-4a15-8ef7-0bd05c80dad0 admin admin] PATH_INFO: `/v3/projects/2427a28bd95c4f6aa13eb363e972da84/users/26f311db8fa840c8a81809651b4415a9/roles/27e3e65e24df4b86b0d3d18d3212101d` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:18.701911 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c089298-c359-442e-bd11-92576dd3b925 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff9f64d5dd4840a4b4221f4f23b6e99b, user_id=2a85e44153f546f68cfd5f4c97dda313, role_id=27e3e65e24df4b86b0d3d18d3212101d)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:18.705357 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5171af8c-1915-4a15-8ef7-0bd05c80dad0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2427a28bd95c4f6aa13eb363e972da84, user_id=26f311db8fa840c8a81809651b4415a9, role_id=27e3e65e24df4b86b0d3d18d3212101d)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:18.706175 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c089298-c359-442e-bd11-92576dd3b925 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:18.708428 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5171af8c-1915-4a15-8ef7-0bd05c80dad0 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:18.728883 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 802/1612] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 11:33:18 2022] PUT /identity/v3/projects/ff9f64d5dd4840a4b4221f4f23b6e99b/users/2a85e44153f546f68cfd5f4c97dda313/roles/27e3e65e24df4b86b0d3d18d3212101d => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:33:18.729900 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c089298-c359-442e-bd11-92576dd3b925 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:18.734687 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 810/1612] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 11:33:18 2022] PUT /identity/v3/projects/2427a28bd95c4f6aa13eb363e972da84/users/26f311db8fa840c8a81809651b4415a9/roles/27e3e65e24df4b86b0d3d18d3212101d => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:33:18.737651 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb89ca8-106c-4daf-91ac-b0b57f19c793 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:18.738940 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb89ca8-106c-4daf-91ac-b0b57f19c793 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:18.738940 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb89ca8-106c-4daf-91ac-b0b57f19c793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:18.770347 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-dfb89ca8-106c-4daf-91ac-b0b57f19c793 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:33:18.771738 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-dfb89ca8-106c-4daf-91ac-b0b57f19c793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:18.838693 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c089298-c359-442e-bd11-92576dd3b925 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:18.842045 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 811/1613] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:33:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:33:18.844613 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b52e39f-a705-490f-995b-5bb824b23342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:18.844892 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b52e39f-a705-490f-995b-5bb824b23342 admin admin] REQUEST_METHOD: `PUT` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:18.846592 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d749d07-ad9b-4fdf-ba43-53e192018a44 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:18.846759 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b52e39f-a705-490f-995b-5bb824b23342 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:18.846860 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d749d07-ad9b-4fdf-ba43-53e192018a44 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:18.847156 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d749d07-ad9b-4fdf-ba43-53e192018a44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:18.848123 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b52e39f-a705-490f-995b-5bb824b23342 admin admin] PATH_INFO: `/v3/projects/a6fb390da7ba4985b27c83ef80498a4a/users/5bfd72d5fe714437be00c7c5533115b4/roles/27e3e65e24df4b86b0d3d18d3212101d` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:18.869310 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b52e39f-a705-490f-995b-5bb824b23342 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6fb390da7ba4985b27c83ef80498a4a, user_id=5bfd72d5fe714437be00c7c5533115b4, role_id=27e3e65e24df4b86b0d3d18d3212101d)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:18.874459 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b52e39f-a705-490f-995b-5bb824b23342 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:18.877806 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-9d749d07-ad9b-4fdf-ba43-53e192018a44 None None] MFA Rules not processed for user `1d5487075cb542bc844ddf3efe1e9659`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:33:18.879486 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-9d749d07-ad9b-4fdf-ba43-53e192018a44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:18.892059 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 803/1614] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 11:33:18 2022] PUT /identity/v3/projects/a6fb390da7ba4985b27c83ef80498a4a/users/5bfd72d5fe714437be00c7c5533115b4/roles/27e3e65e24df4b86b0d3d18d3212101d => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:33:18.893376 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b52e39f-a705-490f-995b-5bb824b23342 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:18.931984 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:18.951929 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:18.957517 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b52e39f-a705-490f-995b-5bb824b23342 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:18.962703 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8061028c-b0e6-4ed9-8c13-dc4b4a4fdaa5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92862b76ba3b4513b5dc5b5c962faac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:18.963799 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8061028c-b0e6-4ed9-8c13-dc4b4a4fdaa5 service cinder] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:18.964176 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8061028c-b0e6-4ed9-8c13-dc4b4a4fdaa5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:18.964822 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8061028c-b0e6-4ed9-8c13-dc4b4a4fdaa5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:18.966445 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 812/1615] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:33:18 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:33:18.968176 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278f6f52-3c98-4000-a9d4-052153c2335b None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:18.968495 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278f6f52-3c98-4000-a9d4-052153c2335b None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:18.968873 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278f6f52-3c98-4000-a9d4-052153c2335b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:18.998621 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-278f6f52-3c98-4000-a9d4-052153c2335b None None] MFA Rules not processed for user `2a85e44153f546f68cfd5f4c97dda313`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:33:18.999994 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-278f6f52-3c98-4000-a9d4-052153c2335b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:19.049972 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8061028c-b0e6-4ed9-8c13-dc4b4a4fdaa5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:19.052293 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8061028c-b0e6-4ed9-8c13-dc4b4a4fdaa5 service cinder] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:19.067506 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 804/1616] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:33:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:33:19.069432 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd184ae-51e6-438b-90f7-a92ab6405d1f None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:19.069809 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd184ae-51e6-438b-90f7-a92ab6405d1f None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:19.070196 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd184ae-51e6-438b-90f7-a92ab6405d1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:19.073488 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 813/1617] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:33:18 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:33:19.075409 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278f6f52-3c98-4000-a9d4-052153c2335b None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:19.102676 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-1fd184ae-51e6-438b-90f7-a92ab6405d1f None None] MFA Rules not processed for user `26f311db8fa840c8a81809651b4415a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:33:19.104131 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-1fd184ae-51e6-438b-90f7-a92ab6405d1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:19.142646 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278f6f52-3c98-4000-a9d4-052153c2335b None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:19.147243 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c656dd96-6929-42de-8947-532ee586dc24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2d061d25d83443c9232218c90792d51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:19.148085 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c656dd96-6929-42de-8947-532ee586dc24 service neutron] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:19.148394 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c656dd96-6929-42de-8947-532ee586dc24 service neutron] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:19.148666 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c656dd96-6929-42de-8947-532ee586dc24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:19.192111 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 805/1618] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:33:19 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:33:19.194067 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6f3795-037b-4208-980c-0c624dbe5815 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:19.194478 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6f3795-037b-4208-980c-0c624dbe5815 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:19.194888 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6f3795-037b-4208-980c-0c624dbe5815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:19.217893 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-0d6f3795-037b-4208-980c-0c624dbe5815 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:33:19.219634 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-0d6f3795-037b-4208-980c-0c624dbe5815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:19.239745 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c656dd96-6929-42de-8947-532ee586dc24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:19.242560 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c656dd96-6929-42de-8947-532ee586dc24 service neutron] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:19.273072 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 814/1619] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:33:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:33:19.273072 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c656dd96-6929-42de-8947-532ee586dc24 service neutron] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:19.313592 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c656dd96-6929-42de-8947-532ee586dc24 service neutron] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:19.323664 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 806/1620] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:33:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:33:19.325883 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6f3795-037b-4208-980c-0c624dbe5815 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:19.339751 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8467575b-7c9e-4cd9-a606-1ec860ffc8de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:19.340640 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8467575b-7c9e-4cd9-a606-1ec860ffc8de admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:19.341039 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8467575b-7c9e-4cd9-a606-1ec860ffc8de admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:19.341435 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8467575b-7c9e-4cd9-a606-1ec860ffc8de admin admin] PATH_INFO: `/v3/projects` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:19.344892 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8467575b-7c9e-4cd9-a606-1ec860ffc8de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:19.347023 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8467575b-7c9e-4cd9-a606-1ec860ffc8de admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:19.360981 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6f3795-037b-4208-980c-0c624dbe5815 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:19.375093 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e36a76e-5f69-458d-98c3-44ae2c1aeb9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:19.375847 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e36a76e-5f69-458d-98c3-44ae2c1aeb9d admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:19.376238 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e36a76e-5f69-458d-98c3-44ae2c1aeb9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:19.376622 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e36a76e-5f69-458d-98c3-44ae2c1aeb9d admin admin] PATH_INFO: `/v3/projects` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:19.377506 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e36a76e-5f69-458d-98c3-44ae2c1aeb9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:19.381147 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e36a76e-5f69-458d-98c3-44ae2c1aeb9d admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:19.388705 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:19.415499 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 815/1621] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 11:33:19 2022] POST /identity/v3/projects => generated 379 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:33:19.416554 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8467575b-7c9e-4cd9-a606-1ec860ffc8de admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:19.422782 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:19.453920 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 807/1622] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 11:33:19 2022] POST /identity/v3/projects => generated 365 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:33:19.455127 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e36a76e-5f69-458d-98c3-44ae2c1aeb9d admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:19.576701 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8467575b-7c9e-4cd9-a606-1ec860ffc8de admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:19.587915 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e36a76e-5f69-458d-98c3-44ae2c1aeb9d admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:19.592105 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b2bce9-4ec6-4196-bdf7-b0cc4bc2807b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2d061d25d83443c9232218c90792d51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:19.592453 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b2bce9-4ec6-4196-bdf7-b0cc4bc2807b service neutron] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:19.592748 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b2bce9-4ec6-4196-bdf7-b0cc4bc2807b service neutron] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:19.593173 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b2bce9-4ec6-4196-bdf7-b0cc4bc2807b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:19.686943 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b2bce9-4ec6-4196-bdf7-b0cc4bc2807b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:19.691285 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b2bce9-4ec6-4196-bdf7-b0cc4bc2807b service neutron] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:19.702339 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fced7ed6-0b1b-4cdf-a321-8c190c6fa7e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:19.703194 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 808/1623] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:33:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:33:19.703420 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fced7ed6-0b1b-4cdf-a321-8c190c6fa7e5 admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:19.703420 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fced7ed6-0b1b-4cdf-a321-8c190c6fa7e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:19.703852 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fced7ed6-0b1b-4cdf-a321-8c190c6fa7e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:19.704540 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b2bce9-4ec6-4196-bdf7-b0cc4bc2807b service neutron] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:19.704653 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fced7ed6-0b1b-4cdf-a321-8c190c6fa7e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:19.706915 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fced7ed6-0b1b-4cdf-a321-8c190c6fa7e5 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:19.716626 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b2bce9-4ec6-4196-bdf7-b0cc4bc2807b service neutron] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:19.723297 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09883460-2e6b-4ce6-9f2a-b2b795962518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:19.724046 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09883460-2e6b-4ce6-9f2a-b2b795962518 admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:19.724813 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09883460-2e6b-4ce6-9f2a-b2b795962518 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:19.725277 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09883460-2e6b-4ce6-9f2a-b2b795962518 admin admin] PATH_INFO: `/v3/users` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:19.726147 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09883460-2e6b-4ce6-9f2a-b2b795962518 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:19.729746 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09883460-2e6b-4ce6-9f2a-b2b795962518 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:19.768130 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 816/1624] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 11:33:19 2022] POST /identity/v3/projects => generated 385 bytes in 352 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:33:19.774118 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fced7ed6-0b1b-4cdf-a321-8c190c6fa7e5 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:19.782384 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 809/1625] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 11:33:19 2022] POST /identity/v3/users => generated 296 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:33:19.787409 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09883460-2e6b-4ce6-9f2a-b2b795962518 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:19.809801 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09883460-2e6b-4ce6-9f2a-b2b795962518 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:19.924869 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fced7ed6-0b1b-4cdf-a321-8c190c6fa7e5 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:19.949002 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d8567e-4eaf-4349-ac1b-4b4684f45aec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:19.953867 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24001f09-edbc-4720-a38d-acafb7e77f75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:19.954880 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24001f09-edbc-4720-a38d-acafb7e77f75 admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:19.955282 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24001f09-edbc-4720-a38d-acafb7e77f75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:19.955481 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24001f09-edbc-4720-a38d-acafb7e77f75 admin admin] PATH_INFO: `/v3/users` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:19.956287 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d8567e-4eaf-4349-ac1b-4b4684f45aec admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:19.956696 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d8567e-4eaf-4349-ac1b-4b4684f45aec admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:19.957083 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d8567e-4eaf-4349-ac1b-4b4684f45aec admin admin] PATH_INFO: `/v3/users` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:19.957463 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24001f09-edbc-4720-a38d-acafb7e77f75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:19.957767 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d8567e-4eaf-4349-ac1b-4b4684f45aec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:19.960139 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d8567e-4eaf-4349-ac1b-4b4684f45aec admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:19.960395 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24001f09-edbc-4720-a38d-acafb7e77f75 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:19.993598 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 817/1626] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 11:33:19 2022] POST /identity/v3/users => generated 289 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:33:19.995160 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24001f09-edbc-4720-a38d-acafb7e77f75 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:20.010310 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24001f09-edbc-4720-a38d-acafb7e77f75 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:20.014051 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 810/1627] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 11:33:19 2022] POST /identity/v3/users => generated 299 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:33:20.015067 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d8567e-4eaf-4349-ac1b-4b4684f45aec admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:20.023129 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c368515-b321-4e13-ba9e-78d0f2cf4955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:20.023926 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c368515-b321-4e13-ba9e-78d0f2cf4955 admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:20.024437 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c368515-b321-4e13-ba9e-78d0f2cf4955 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:20.024562 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c368515-b321-4e13-ba9e-78d0f2cf4955 admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:20.025233 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c368515-b321-4e13-ba9e-78d0f2cf4955 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:20.027546 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c368515-b321-4e13-ba9e-78d0f2cf4955 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:20.038349 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d8567e-4eaf-4349-ac1b-4b4684f45aec admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:20.046717 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 818/1628] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:33:19 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:33:20.047712 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c368515-b321-4e13-ba9e-78d0f2cf4955 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:20.051396 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4c2448-42fb-48e3-aff5-999a05b41053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:20.051396 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4c2448-42fb-48e3-aff5-999a05b41053 admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:20.051649 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4c2448-42fb-48e3-aff5-999a05b41053 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:20.051924 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4c2448-42fb-48e3-aff5-999a05b41053 admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:20.052601 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4c2448-42fb-48e3-aff5-999a05b41053 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:20.054245 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4c2448-42fb-48e3-aff5-999a05b41053 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:20.061476 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c368515-b321-4e13-ba9e-78d0f2cf4955 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:20.067267 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f5d184-8dc9-431b-a941-fba053c456ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:20.068029 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f5d184-8dc9-431b-a941-fba053c456ed admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:20.068453 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f5d184-8dc9-431b-a941-fba053c456ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:20.068766 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f5d184-8dc9-431b-a941-fba053c456ed admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:20.069498 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f5d184-8dc9-431b-a941-fba053c456ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:20.072252 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f5d184-8dc9-431b-a941-fba053c456ed admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:20.074496 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:20.080694 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 811/1629] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:33:20 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:33:20.086232 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4c2448-42fb-48e3-aff5-999a05b41053 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:20.096380 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 819/1630] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:33:20 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:33:20.098763 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f5d184-8dc9-431b-a941-fba053c456ed admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:20.131057 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f5d184-8dc9-431b-a941-fba053c456ed admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:20.143062 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f3d6e8-e3ad-46ea-866f-1f5441ae001f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:20.145911 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f3d6e8-e3ad-46ea-866f-1f5441ae001f admin admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:20.146540 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f3d6e8-e3ad-46ea-866f-1f5441ae001f admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:20.146825 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f3d6e8-e3ad-46ea-866f-1f5441ae001f admin admin] PATH_INFO: `/v3/projects/ff439b1dfe9b44309ecc95cebfdc4dcc/users/4454c7fd2b554d7285f0f8cdacea6c51/roles/30bb1e97257f4ca5b90c88545777317b` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:20.150912 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4c2448-42fb-48e3-aff5-999a05b41053 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:20.168436 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcecafe-783c-4f11-a4de-65593f8a66ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:20.170560 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcecafe-783c-4f11-a4de-65593f8a66ae admin admin] REQUEST_METHOD: `PUT` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:20.170844 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcecafe-783c-4f11-a4de-65593f8a66ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:20.171119 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcecafe-783c-4f11-a4de-65593f8a66ae admin admin] PATH_INFO: `/v3/projects/a2565f3708484592a910dbe078c69765/users/927fd2118ec04cf8a2d3208c88820363/roles/30bb1e97257f4ca5b90c88545777317b` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:20.181781 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:20.184960 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f3d6e8-e3ad-46ea-866f-1f5441ae001f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff439b1dfe9b44309ecc95cebfdc4dcc, user_id=4454c7fd2b554d7285f0f8cdacea6c51, role_id=30bb1e97257f4ca5b90c88545777317b)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:20.195535 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f3d6e8-e3ad-46ea-866f-1f5441ae001f admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:20.221083 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcecafe-783c-4f11-a4de-65593f8a66ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2565f3708484592a910dbe078c69765, user_id=927fd2118ec04cf8a2d3208c88820363, role_id=30bb1e97257f4ca5b90c88545777317b)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:20.224376 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 820/1631] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 11:33:20 2022] PUT /identity/v3/projects/ff439b1dfe9b44309ecc95cebfdc4dcc/users/4454c7fd2b554d7285f0f8cdacea6c51/roles/30bb1e97257f4ca5b90c88545777317b => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:33:20.225881 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f3d6e8-e3ad-46ea-866f-1f5441ae001f admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:20.234793 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcecafe-783c-4f11-a4de-65593f8a66ae admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:20.264886 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 812/1632] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 11:33:20 2022] PUT /identity/v3/projects/a2565f3708484592a910dbe078c69765/users/927fd2118ec04cf8a2d3208c88820363/roles/30bb1e97257f4ca5b90c88545777317b => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:33:20.265930 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcecafe-783c-4f11-a4de-65593f8a66ae admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:20.367104 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f3d6e8-e3ad-46ea-866f-1f5441ae001f admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:20.404420 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcecafe-783c-4f11-a4de-65593f8a66ae admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:20.418899 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805002ca-d9ab-4341-8da7-d1f67b4ef831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:20.419539 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805002ca-d9ab-4341-8da7-d1f67b4ef831 admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:20.419818 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805002ca-d9ab-4341-8da7-d1f67b4ef831 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:20.420085 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805002ca-d9ab-4341-8da7-d1f67b4ef831 admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:20.420743 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805002ca-d9ab-4341-8da7-d1f67b4ef831 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:20.422399 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805002ca-d9ab-4341-8da7-d1f67b4ef831 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:20.436680 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a58b5b-309a-42db-a866-2014159da660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:20.437375 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a58b5b-309a-42db-a866-2014159da660 admin admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:20.437638 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a58b5b-309a-42db-a866-2014159da660 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:20.437911 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a58b5b-309a-42db-a866-2014159da660 admin admin] PATH_INFO: `/v3/projects/c03be5c0a3594487958c76761dc700eb/users/344549152f52484a9fcce9ca9ef7f70b/roles/30bb1e97257f4ca5b90c88545777317b` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:20.456297 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 813/1633] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:33:20 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:33:20.457146 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a58b5b-309a-42db-a866-2014159da660 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c03be5c0a3594487958c76761dc700eb, user_id=344549152f52484a9fcce9ca9ef7f70b, role_id=30bb1e97257f4ca5b90c88545777317b)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:20.457349 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805002ca-d9ab-4341-8da7-d1f67b4ef831 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:20.460171 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a58b5b-309a-42db-a866-2014159da660 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:20.469760 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805002ca-d9ab-4341-8da7-d1f67b4ef831 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:20.476876 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1690f4b7-4172-4809-88d5-35c8083a708a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:20.477541 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1690f4b7-4172-4809-88d5-35c8083a708a admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:20.477869 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1690f4b7-4172-4809-88d5-35c8083a708a admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:20.478147 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1690f4b7-4172-4809-88d5-35c8083a708a admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:20.479352 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1690f4b7-4172-4809-88d5-35c8083a708a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:20.481149 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1690f4b7-4172-4809-88d5-35c8083a708a admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:20.488282 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 821/1634] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 11:33:20 2022] PUT /identity/v3/projects/c03be5c0a3594487958c76761dc700eb/users/344549152f52484a9fcce9ca9ef7f70b/roles/30bb1e97257f4ca5b90c88545777317b => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:33:20.492074 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a58b5b-309a-42db-a866-2014159da660 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:20.498094 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 814/1635] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:33:20 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:33:20.499808 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1690f4b7-4172-4809-88d5-35c8083a708a admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:20.521315 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1690f4b7-4172-4809-88d5-35c8083a708a admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:20.568682 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a58b5b-309a-42db-a866-2014159da660 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:20.574787 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe43af6-2ede-4c20-a72f-105e12b2aee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:20.575949 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe43af6-2ede-4c20-a72f-105e12b2aee7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:20.576579 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe43af6-2ede-4c20-a72f-105e12b2aee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:20.576939 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe43af6-2ede-4c20-a72f-105e12b2aee7 admin admin] PATH_INFO: `/v3/projects/ff439b1dfe9b44309ecc95cebfdc4dcc/users/4454c7fd2b554d7285f0f8cdacea6c51/roles/30bb1e97257f4ca5b90c88545777317b` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:20.579480 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe43af6-2ede-4c20-a72f-105e12b2aee7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff439b1dfe9b44309ecc95cebfdc4dcc, user_id=4454c7fd2b554d7285f0f8cdacea6c51, role_id=30bb1e97257f4ca5b90c88545777317b)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:20.582982 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe43af6-2ede-4c20-a72f-105e12b2aee7 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:20.587657 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:20.608230 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 822/1636] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 11:33:20 2022] PUT /identity/v3/projects/ff439b1dfe9b44309ecc95cebfdc4dcc/users/4454c7fd2b554d7285f0f8cdacea6c51/roles/30bb1e97257f4ca5b90c88545777317b => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:33:20.610627 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe43af6-2ede-4c20-a72f-105e12b2aee7 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:20.673953 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08b2272-062e-43ea-93cc-6cd8d572baf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:20.674922 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08b2272-062e-43ea-93cc-6cd8d572baf8 admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:20.675452 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08b2272-062e-43ea-93cc-6cd8d572baf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:20.675980 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08b2272-062e-43ea-93cc-6cd8d572baf8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:20.677051 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08b2272-062e-43ea-93cc-6cd8d572baf8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:20.681453 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08b2272-062e-43ea-93cc-6cd8d572baf8 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:20.707354 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 815/1637] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:33:20 2022] GET /identity/v3/roles => generated 1420 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:33:20.709158 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9598e708-6949-4a61-906a-35d87cca2b51 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:20.717850 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9598e708-6949-4a61-906a-35d87cca2b51 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:20.718437 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9598e708-6949-4a61-906a-35d87cca2b51 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:20.725213 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 816/1638] 10.222.0.27 () {54 vars in 962 bytes} [Wed Aug 24 11:33:20 2022] GET /identity => generated 270 bytes in 17 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:33:20.726821 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221413b9-955d-4bae-9ce8-6167cef9d9e5 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:20.727417 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221413b9-955d-4bae-9ce8-6167cef9d9e5 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:20.727842 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221413b9-955d-4bae-9ce8-6167cef9d9e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:20.729234 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe43af6-2ede-4c20-a72f-105e12b2aee7 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:20.734949 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46e868d-0cb8-4659-991e-a55221883dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:20.735632 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46e868d-0cb8-4659-991e-a55221883dce admin admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:20.735914 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46e868d-0cb8-4659-991e-a55221883dce admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:20.736189 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46e868d-0cb8-4659-991e-a55221883dce admin admin] PATH_INFO: `/v3/projects/a2565f3708484592a910dbe078c69765/users/927fd2118ec04cf8a2d3208c88820363/roles/30bb1e97257f4ca5b90c88545777317b` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:20.738686 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46e868d-0cb8-4659-991e-a55221883dce admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2565f3708484592a910dbe078c69765, user_id=927fd2118ec04cf8a2d3208c88820363, role_id=30bb1e97257f4ca5b90c88545777317b)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:20.741830 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46e868d-0cb8-4659-991e-a55221883dce admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:20.769025 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 823/1639] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 11:33:20 2022] PUT /identity/v3/projects/a2565f3708484592a910dbe078c69765/users/927fd2118ec04cf8a2d3208c88820363/roles/30bb1e97257f4ca5b90c88545777317b => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:33:20.770622 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46e868d-0cb8-4659-991e-a55221883dce admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:20.810037 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-221413b9-955d-4bae-9ce8-6167cef9d9e5 None None] MFA Rules not processed for user `4454c7fd2b554d7285f0f8cdacea6c51`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:33:20.811432 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-221413b9-955d-4bae-9ce8-6167cef9d9e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:20.853915 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46e868d-0cb8-4659-991e-a55221883dce admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:20.860530 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98b4ced-a798-42a7-9009-e540af39d107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:20.861240 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98b4ced-a798-42a7-9009-e540af39d107 admin admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:20.861517 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98b4ced-a798-42a7-9009-e540af39d107 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:20.861835 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98b4ced-a798-42a7-9009-e540af39d107 admin admin] PATH_INFO: `/v3/projects/c03be5c0a3594487958c76761dc700eb/users/344549152f52484a9fcce9ca9ef7f70b/roles/30bb1e97257f4ca5b90c88545777317b` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:20.864005 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98b4ced-a798-42a7-9009-e540af39d107 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c03be5c0a3594487958c76761dc700eb, user_id=344549152f52484a9fcce9ca9ef7f70b, role_id=30bb1e97257f4ca5b90c88545777317b)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:20.867053 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98b4ced-a798-42a7-9009-e540af39d107 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:20.882553 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 824/1640] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 11:33:20 2022] PUT /identity/v3/projects/c03be5c0a3594487958c76761dc700eb/users/344549152f52484a9fcce9ca9ef7f70b/roles/30bb1e97257f4ca5b90c88545777317b => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:33:20.896986 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7a7c82-1d0c-4f0b-9fd3-145ddd5d57ac None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:20.897300 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7a7c82-1d0c-4f0b-9fd3-145ddd5d57ac None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:20.897675 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7a7c82-1d0c-4f0b-9fd3-145ddd5d57ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:20.925956 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-1d7a7c82-1d0c-4f0b-9fd3-145ddd5d57ac None None] MFA Rules not processed for user `282ec32864d046b2bea170f6a3845cc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:33:20.927488 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-1d7a7c82-1d0c-4f0b-9fd3-145ddd5d57ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:20.945669 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:20.985532 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 817/1641] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:33:20 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:33:20.986842 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce8abcd-0e95-4d91-8ffe-ea0c3d6013f5 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:20.987140 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce8abcd-0e95-4d91-8ffe-ea0c3d6013f5 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:20.987389 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce8abcd-0e95-4d91-8ffe-ea0c3d6013f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:21.032619 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 825/1642] 10.222.0.27 () {58 vars in 1059 bytes} [Wed Aug 24 11:33:20 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:33:21.034197 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9752f0d2-5f10-43b5-a337-9e98afbabc1c None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:21.034515 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9752f0d2-5f10-43b5-a337-9e98afbabc1c None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:21.035345 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9752f0d2-5f10-43b5-a337-9e98afbabc1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:21.057212 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-5ce8abcd-0e95-4d91-8ffe-ea0c3d6013f5 None None] MFA Rules not processed for user `927fd2118ec04cf8a2d3208c88820363`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:33:21.058100 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-5ce8abcd-0e95-4d91-8ffe-ea0c3d6013f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:21.070170 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-9752f0d2-5f10-43b5-a337-9e98afbabc1c None None] MFA Rules not processed for user `344549152f52484a9fcce9ca9ef7f70b`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:33:21.071379 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-9752f0d2-5f10-43b5-a337-9e98afbabc1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:21.077385 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:21.198281 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 826/1643] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:33:21 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:33:21.199787 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9752f0d2-5f10-43b5-a337-9e98afbabc1c None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:21.242072 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 818/1644] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:33:20 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:33:21.242072 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b50083-8a86-4a02-8af4-be59e70a042e None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:21.242072 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b50083-8a86-4a02-8af4-be59e70a042e None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:21.242072 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b50083-8a86-4a02-8af4-be59e70a042e None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:21.242072 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 819/1645] 10.222.0.27 () {54 vars in 912 bytes} [Wed Aug 24 11:33:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:33:21.244001 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b50083-8a86-4a02-8af4-be59e70a042e None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:21.307445 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9752f0d2-5f10-43b5-a337-9e98afbabc1c None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:21.313194 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade7f533-c9c0-418a-b9d4-24ce39d9f9ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92862b76ba3b4513b5dc5b5c962faac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:21.314083 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade7f533-c9c0-418a-b9d4-24ce39d9f9ee service cinder] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:21.315135 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade7f533-c9c0-418a-b9d4-24ce39d9f9ee service cinder] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:21.315624 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade7f533-c9c0-418a-b9d4-24ce39d9f9ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:21.320126 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b50083-8a86-4a02-8af4-be59e70a042e None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:21.325475 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b0e3b6-54cc-4662-95da-354906cda7aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92862b76ba3b4513b5dc5b5c962faac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:21.326328 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b0e3b6-54cc-4662-95da-354906cda7aa service cinder] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:21.327465 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b0e3b6-54cc-4662-95da-354906cda7aa service cinder] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:21.327857 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b0e3b6-54cc-4662-95da-354906cda7aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:21.343578 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b0e3b6-54cc-4662-95da-354906cda7aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:21.346939 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b0e3b6-54cc-4662-95da-354906cda7aa service cinder] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:21.374152 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 820/1646] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:33:21 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:33:21.377145 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a31f44-0ca2-435c-a460-fcfd932faf3a None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:21.377630 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a31f44-0ca2-435c-a460-fcfd932faf3a None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:21.378064 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a31f44-0ca2-435c-a460-fcfd932faf3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:21.424149 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-31a31f44-0ca2-435c-a460-fcfd932faf3a None None] MFA Rules not processed for user `282ec32864d046b2bea170f6a3845cc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:33:21.427479 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-31a31f44-0ca2-435c-a460-fcfd932faf3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:21.430441 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade7f533-c9c0-418a-b9d4-24ce39d9f9ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:21.432253 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade7f533-c9c0-418a-b9d4-24ce39d9f9ee service cinder] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:21.439930 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 821/1647] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Aug 24 11:33:21 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:33:21.445740 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 827/1648] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:33:21 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:33:21.469025 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a31f44-0ca2-435c-a460-fcfd932faf3a None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:21.479999 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a31f44-0ca2-435c-a460-fcfd932faf3a None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:21.487621 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c04ae83-e5ac-4817-ab98-463ffd50dcda service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92862b76ba3b4513b5dc5b5c962faac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:21.488460 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c04ae83-e5ac-4817-ab98-463ffd50dcda service cinder] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:21.488804 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c04ae83-e5ac-4817-ab98-463ffd50dcda service cinder] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:21.489553 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c04ae83-e5ac-4817-ab98-463ffd50dcda service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:21.518471 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c04ae83-e5ac-4817-ab98-463ffd50dcda service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:21.520460 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c04ae83-e5ac-4817-ab98-463ffd50dcda service cinder] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:21.548020 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 822/1649] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:33:21 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:33:21.556629 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade7f533-c9c0-418a-b9d4-24ce39d9f9ee service cinder] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:21.572672 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade7f533-c9c0-418a-b9d4-24ce39d9f9ee service cinder] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:21.586057 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61f74a2-9ae4-4b48-bee9-141ec75d9363 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92862b76ba3b4513b5dc5b5c962faac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:21.587191 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61f74a2-9ae4-4b48-bee9-141ec75d9363 service cinder] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:21.587737 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61f74a2-9ae4-4b48-bee9-141ec75d9363 service cinder] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:21.588036 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61f74a2-9ae4-4b48-bee9-141ec75d9363 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:21.613405 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61f74a2-9ae4-4b48-bee9-141ec75d9363 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:21.615225 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61f74a2-9ae4-4b48-bee9-141ec75d9363 service cinder] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:21.640974 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 828/1650] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:33:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:33:21.657088 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c04ae83-e5ac-4817-ab98-463ffd50dcda service cinder] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:21.786508 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:21.798161 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c04ae83-e5ac-4817-ab98-463ffd50dcda service cinder] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:21.811802 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bdc007-16ba-4769-a35f-e45c8d127d81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:21.812827 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bdc007-16ba-4769-a35f-e45c8d127d81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:21.813257 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bdc007-16ba-4769-a35f-e45c8d127d81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:21.814233 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bdc007-16ba-4769-a35f-e45c8d127d81 admin admin] PATH_INFO: `/v3/users/26f311db8fa840c8a81809651b4415a9` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:21.816694 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bdc007-16ba-4769-a35f-e45c8d127d81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=26f311db8fa840c8a81809651b4415a9)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:21.819449 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bdc007-16ba-4769-a35f-e45c8d127d81 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:21.853175 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61f74a2-9ae4-4b48-bee9-141ec75d9363 service cinder] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:21.866171 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61f74a2-9ae4-4b48-bee9-141ec75d9363 service cinder] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:21.875295 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b50eec9-ac25-4c1b-8a27-b54929b84130 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92862b76ba3b4513b5dc5b5c962faac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:21.876381 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b50eec9-ac25-4c1b-8a27-b54929b84130 service cinder] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:21.876824 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b50eec9-ac25-4c1b-8a27-b54929b84130 service cinder] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:21.877095 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b50eec9-ac25-4c1b-8a27-b54929b84130 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:21.948546 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-13bdc007-16ba-4769-a35f-e45c8d127d81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26f311db8fa840c8a81809651b4415a9'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:33:21.949252 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-13bdc007-16ba-4769-a35f-e45c8d127d81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26f311db8fa840c8a81809651b4415a9'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:33:21.955504 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-13bdc007-16ba-4769-a35f-e45c8d127d81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26f311db8fa840c8a81809651b4415a9'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:33:21.975483 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-13bdc007-16ba-4769-a35f-e45c8d127d81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26f311db8fa840c8a81809651b4415a9'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:33:21.991155 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-13bdc007-16ba-4769-a35f-e45c8d127d81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26f311db8fa840c8a81809651b4415a9'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:33:22.025462 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:22.059163 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 823/1651] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 11:33:21 2022] DELETE /identity/v3/users/26f311db8fa840c8a81809651b4415a9 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:33:22.068056 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed575b0f-a0b7-47f6-8bda-c79496d7a76e None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:22.069036 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed575b0f-a0b7-47f6-8bda-c79496d7a76e None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:22.069411 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed575b0f-a0b7-47f6-8bda-c79496d7a76e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:22.073091 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b50eec9-ac25-4c1b-8a27-b54929b84130 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:22.074731 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b50eec9-ac25-4c1b-8a27-b54929b84130 service cinder] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:22.096338 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 829/1652] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:33:21 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:33:22.109324 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-ed575b0f-a0b7-47f6-8bda-c79496d7a76e None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:33:22.123222 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-ed575b0f-a0b7-47f6-8bda-c79496d7a76e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:22.290076 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 824/1653] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:33:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:33:22.308793 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b50eec9-ac25-4c1b-8a27-b54929b84130 service cinder] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:22.498052 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b50eec9-ac25-4c1b-8a27-b54929b84130 service cinder] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:22.637109 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12f09db-dcee-4883-9d7c-88acbd3a0727 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2d061d25d83443c9232218c90792d51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:22.638017 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12f09db-dcee-4883-9d7c-88acbd3a0727 service neutron] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:22.638522 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12f09db-dcee-4883-9d7c-88acbd3a0727 service neutron] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:22.638981 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12f09db-dcee-4883-9d7c-88acbd3a0727 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:22.653302 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12f09db-dcee-4883-9d7c-88acbd3a0727 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:22.655436 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12f09db-dcee-4883-9d7c-88acbd3a0727 service neutron] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:22.674822 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 830/1654] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:33:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:33:23.256076 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed575b0f-a0b7-47f6-8bda-c79496d7a76e None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:23.257919 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-ed575b0f-a0b7-47f6-8bda-c79496d7a76e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:23.285437 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed575b0f-a0b7-47f6-8bda-c79496d7a76e None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:23.310662 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae0da0f-5633-48f7-b945-07f5da12169e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:23.314739 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae0da0f-5633-48f7-b945-07f5da12169e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:23.316146 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae0da0f-5633-48f7-b945-07f5da12169e admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:23.316714 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae0da0f-5633-48f7-b945-07f5da12169e admin admin] PATH_INFO: `/v3/users/2a85e44153f546f68cfd5f4c97dda313` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:23.318661 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae0da0f-5633-48f7-b945-07f5da12169e admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a85e44153f546f68cfd5f4c97dda313)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:23.329520 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae0da0f-5633-48f7-b945-07f5da12169e admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:23.449845 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-3ae0da0f-5633-48f7-b945-07f5da12169e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a85e44153f546f68cfd5f4c97dda313'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:33:23.450736 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-3ae0da0f-5633-48f7-b945-07f5da12169e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a85e44153f546f68cfd5f4c97dda313'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:33:23.452076 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-3ae0da0f-5633-48f7-b945-07f5da12169e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a85e44153f546f68cfd5f4c97dda313'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:33:23.464836 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-3ae0da0f-5633-48f7-b945-07f5da12169e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a85e44153f546f68cfd5f4c97dda313'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:33:23.477217 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-3ae0da0f-5633-48f7-b945-07f5da12169e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a85e44153f546f68cfd5f4c97dda313'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:33:23.517097 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:23.533578 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 825/1655] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 11:33:23 2022] DELETE /identity/v3/users/2a85e44153f546f68cfd5f4c97dda313 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:33:23.540082 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3018bb46-5e25-4d64-9ce6-d728c682eb60 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:23.541563 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3018bb46-5e25-4d64-9ce6-d728c682eb60 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:23.542671 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3018bb46-5e25-4d64-9ce6-d728c682eb60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:23.592419 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-3018bb46-5e25-4d64-9ce6-d728c682eb60 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:33:23.593763 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-3018bb46-5e25-4d64-9ce6-d728c682eb60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:23.718239 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 831/1656] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:33:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:33:23.828349 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae0da0f-5633-48f7-b945-07f5da12169e admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:23.832148 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-3ae0da0f-5633-48f7-b945-07f5da12169e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:23.951664 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae0da0f-5633-48f7-b945-07f5da12169e admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:23.955916 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f671e73-e8f6-48ac-9950-8fe0bb5735c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2d061d25d83443c9232218c90792d51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:23.956633 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f671e73-e8f6-48ac-9950-8fe0bb5735c1 service neutron] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:23.956908 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f671e73-e8f6-48ac-9950-8fe0bb5735c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:23.957180 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f671e73-e8f6-48ac-9950-8fe0bb5735c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:23.968687 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f671e73-e8f6-48ac-9950-8fe0bb5735c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:23.970968 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f671e73-e8f6-48ac-9950-8fe0bb5735c1 service neutron] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:23.984863 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 826/1657] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:33:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:33:25.187485 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3018bb46-5e25-4d64-9ce6-d728c682eb60 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:25.201584 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-3018bb46-5e25-4d64-9ce6-d728c682eb60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:25.220051 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3018bb46-5e25-4d64-9ce6-d728c682eb60 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:25.237494 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613e1e54-2f3c-4ba5-adb4-8754937ee1a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:25.238823 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613e1e54-2f3c-4ba5-adb4-8754937ee1a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:25.239711 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613e1e54-2f3c-4ba5-adb4-8754937ee1a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:25.240779 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613e1e54-2f3c-4ba5-adb4-8754937ee1a8 admin admin] PATH_INFO: `/v3/projects/2427a28bd95c4f6aa13eb363e972da84` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:25.243834 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613e1e54-2f3c-4ba5-adb4-8754937ee1a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2427a28bd95c4f6aa13eb363e972da84)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:25.248822 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613e1e54-2f3c-4ba5-adb4-8754937ee1a8 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:25.314993 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:25.349821 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-613e1e54-2f3c-4ba5-adb4-8754937ee1a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2427a28bd95c4f6aa13eb363e972da84', 'request_id': 'req-613e1e54-2f3c-4ba5-adb4-8754937ee1a8'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:33:25.356513 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-613e1e54-2f3c-4ba5-adb4-8754937ee1a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2427a28bd95c4f6aa13eb363e972da84', 'request_id': 'req-613e1e54-2f3c-4ba5-adb4-8754937ee1a8'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:33:25.364541 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-613e1e54-2f3c-4ba5-adb4-8754937ee1a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2427a28bd95c4f6aa13eb363e972da84', 'request_id': 'req-613e1e54-2f3c-4ba5-adb4-8754937ee1a8'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:33:25.388563 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-613e1e54-2f3c-4ba5-adb4-8754937ee1a8 admin admin] The token cache is being invalidate because project 2427a28bd95c4f6aa13eb363e972da84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:33:25.389445 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-613e1e54-2f3c-4ba5-adb4-8754937ee1a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:33:25.390617 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-613e1e54-2f3c-4ba5-adb4-8754937ee1a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:33:25.393906 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 832/1658] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 11:33:25 2022] DELETE /identity/v3/projects/2427a28bd95c4f6aa13eb363e972da84 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:33:25.397786 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f671e73-e8f6-48ac-9950-8fe0bb5735c1 service neutron] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:25.411150 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f671e73-e8f6-48ac-9950-8fe0bb5735c1 service neutron] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:25.498860 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65080f89-7ed3-45d8-94a1-a12c5f7e5102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:25.500026 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65080f89-7ed3-45d8-94a1-a12c5f7e5102 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:25.500412 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65080f89-7ed3-45d8-94a1-a12c5f7e5102 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:25.500775 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65080f89-7ed3-45d8-94a1-a12c5f7e5102 admin admin] PATH_INFO: `/v3/users/344549152f52484a9fcce9ca9ef7f70b` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:25.502055 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65080f89-7ed3-45d8-94a1-a12c5f7e5102 admin admin] RBAC: Authorizing `identity:delete_user(user_id=344549152f52484a9fcce9ca9ef7f70b)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:25.504436 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65080f89-7ed3-45d8-94a1-a12c5f7e5102 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:25.594210 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-65080f89-7ed3-45d8-94a1-a12c5f7e5102 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '344549152f52484a9fcce9ca9ef7f70b'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:33:25.594821 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-65080f89-7ed3-45d8-94a1-a12c5f7e5102 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '344549152f52484a9fcce9ca9ef7f70b'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:33:25.595580 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-65080f89-7ed3-45d8-94a1-a12c5f7e5102 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '344549152f52484a9fcce9ca9ef7f70b'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:33:25.614921 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-65080f89-7ed3-45d8-94a1-a12c5f7e5102 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '344549152f52484a9fcce9ca9ef7f70b'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:33:25.645523 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-65080f89-7ed3-45d8-94a1-a12c5f7e5102 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '344549152f52484a9fcce9ca9ef7f70b'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:33:25.718386 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 827/1659] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 11:33:25 2022] DELETE /identity/v3/users/344549152f52484a9fcce9ca9ef7f70b => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:33:25.749805 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613e1e54-2f3c-4ba5-adb4-8754937ee1a8 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:25.752329 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-613e1e54-2f3c-4ba5-adb4-8754937ee1a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:25.775998 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613e1e54-2f3c-4ba5-adb4-8754937ee1a8 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:25.931650 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0804ce34-3d44-4a9c-8322-72a85345dba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:25.932457 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0804ce34-3d44-4a9c-8322-72a85345dba9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:25.932742 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0804ce34-3d44-4a9c-8322-72a85345dba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:25.933010 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0804ce34-3d44-4a9c-8322-72a85345dba9 admin admin] PATH_INFO: `/v3/users/73625201f6e14ccd8d756a6631f3f80e` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:25.936110 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0804ce34-3d44-4a9c-8322-72a85345dba9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=73625201f6e14ccd8d756a6631f3f80e)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:25.937166 dv-cinder-848899-3-smb devstack@keystone.service[81502]: WARNING py.warnings [None req-0804ce34-3d44-4a9c-8322-72a85345dba9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 11:33:25.937166 dv-cinder-848899-3-smb devstack@keystone.service[81502]: warnings.warn(msg) Aug 24 11:33:25.937166 dv-cinder-848899-3-smb devstack@keystone.service[81502]: Aug 24 11:33:25.939985 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0804ce34-3d44-4a9c-8322-72a85345dba9 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:26.216980 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-0804ce34-3d44-4a9c-8322-72a85345dba9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73625201f6e14ccd8d756a6631f3f80e'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:33:26.224938 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-0804ce34-3d44-4a9c-8322-72a85345dba9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73625201f6e14ccd8d756a6631f3f80e'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:33:26.277473 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-0804ce34-3d44-4a9c-8322-72a85345dba9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73625201f6e14ccd8d756a6631f3f80e'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:33:26.379278 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-0804ce34-3d44-4a9c-8322-72a85345dba9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73625201f6e14ccd8d756a6631f3f80e'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:33:26.383089 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-0804ce34-3d44-4a9c-8322-72a85345dba9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73625201f6e14ccd8d756a6631f3f80e'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:33:26.492800 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 833/1660] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 11:33:25 2022] DELETE /identity/v3/users/73625201f6e14ccd8d756a6631f3f80e => generated 0 bytes in 740 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:33:26.494307 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd332ab-3e8a-4d83-bcdf-a55ebea0ac6e None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:26.495439 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd332ab-3e8a-4d83-bcdf-a55ebea0ac6e None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:26.496414 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd332ab-3e8a-4d83-bcdf-a55ebea0ac6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:26.570901 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-5bd332ab-3e8a-4d83-bcdf-a55ebea0ac6e None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:33:26.572771 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-5bd332ab-3e8a-4d83-bcdf-a55ebea0ac6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:26.594085 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:26.884044 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 828/1661] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:33:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 391 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 11:33:26.912729 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0804ce34-3d44-4a9c-8322-72a85345dba9 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:26.915105 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-0804ce34-3d44-4a9c-8322-72a85345dba9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:27.072886 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:27.123782 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0804ce34-3d44-4a9c-8322-72a85345dba9 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:27.128068 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b892ab67-4932-4a15-afb5-77fa15e5ec34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2d061d25d83443c9232218c90792d51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:27.128941 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b892ab67-4932-4a15-afb5-77fa15e5ec34 service neutron] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:27.129358 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b892ab67-4932-4a15-afb5-77fa15e5ec34 service neutron] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:27.129766 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b892ab67-4932-4a15-afb5-77fa15e5ec34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:27.145731 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b892ab67-4932-4a15-afb5-77fa15e5ec34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:27.148791 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b892ab67-4932-4a15-afb5-77fa15e5ec34 service neutron] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:27.165168 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 834/1662] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:33:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:33:27.383966 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd332ab-3e8a-4d83-bcdf-a55ebea0ac6e None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:27.386008 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-5bd332ab-3e8a-4d83-bcdf-a55ebea0ac6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:27.407412 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd332ab-3e8a-4d83-bcdf-a55ebea0ac6e None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:27.418346 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c1fd08-f2bf-4e59-bc18-2d0f96782627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:27.420625 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c1fd08-f2bf-4e59-bc18-2d0f96782627 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:27.428528 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c1fd08-f2bf-4e59-bc18-2d0f96782627 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:27.429543 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c1fd08-f2bf-4e59-bc18-2d0f96782627 admin admin] PATH_INFO: `/v3/projects/ff9f64d5dd4840a4b4221f4f23b6e99b` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:27.434506 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c1fd08-f2bf-4e59-bc18-2d0f96782627 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff9f64d5dd4840a4b4221f4f23b6e99b)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:27.437084 dv-cinder-848899-3-smb devstack@keystone.service[81501]: WARNING py.warnings [None req-51c1fd08-f2bf-4e59-bc18-2d0f96782627 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 11:33:27.437084 dv-cinder-848899-3-smb devstack@keystone.service[81501]: warnings.warn(msg) Aug 24 11:33:27.437084 dv-cinder-848899-3-smb devstack@keystone.service[81501]: Aug 24 11:33:27.439524 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c1fd08-f2bf-4e59-bc18-2d0f96782627 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:27.572616 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-51c1fd08-f2bf-4e59-bc18-2d0f96782627 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff9f64d5dd4840a4b4221f4f23b6e99b', 'request_id': 'req-51c1fd08-f2bf-4e59-bc18-2d0f96782627'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:33:27.607959 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-51c1fd08-f2bf-4e59-bc18-2d0f96782627 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff9f64d5dd4840a4b4221f4f23b6e99b', 'request_id': 'req-51c1fd08-f2bf-4e59-bc18-2d0f96782627'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:33:27.624763 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-51c1fd08-f2bf-4e59-bc18-2d0f96782627 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff9f64d5dd4840a4b4221f4f23b6e99b', 'request_id': 'req-51c1fd08-f2bf-4e59-bc18-2d0f96782627'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:33:27.649297 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-51c1fd08-f2bf-4e59-bc18-2d0f96782627 admin admin] The token cache is being invalidate because project ff9f64d5dd4840a4b4221f4f23b6e99b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81501) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:33:27.649597 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-51c1fd08-f2bf-4e59-bc18-2d0f96782627 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:33:27.650340 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-51c1fd08-f2bf-4e59-bc18-2d0f96782627 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:33:27.652376 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 829/1663] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 11:33:27 2022] DELETE /identity/v3/projects/ff9f64d5dd4840a4b4221f4f23b6e99b => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:33:27.656730 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b892ab67-4932-4a15-afb5-77fa15e5ec34 service neutron] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:27.671739 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b892ab67-4932-4a15-afb5-77fa15e5ec34 service neutron] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:27.822874 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ce86ed-559a-4b51-a63e-8224e173603f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:27.824039 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ce86ed-559a-4b51-a63e-8224e173603f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:27.824462 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ce86ed-559a-4b51-a63e-8224e173603f admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:27.824869 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ce86ed-559a-4b51-a63e-8224e173603f admin admin] PATH_INFO: `/v3/users/4454c7fd2b554d7285f0f8cdacea6c51` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:27.826272 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ce86ed-559a-4b51-a63e-8224e173603f admin admin] RBAC: Authorizing `identity:delete_user(user_id=4454c7fd2b554d7285f0f8cdacea6c51)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:27.830385 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ce86ed-559a-4b51-a63e-8224e173603f admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:27.981855 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-b5ce86ed-559a-4b51-a63e-8224e173603f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4454c7fd2b554d7285f0f8cdacea6c51'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:33:27.982744 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-b5ce86ed-559a-4b51-a63e-8224e173603f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4454c7fd2b554d7285f0f8cdacea6c51'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:33:28.005565 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-b5ce86ed-559a-4b51-a63e-8224e173603f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4454c7fd2b554d7285f0f8cdacea6c51'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:33:28.018600 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-b5ce86ed-559a-4b51-a63e-8224e173603f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4454c7fd2b554d7285f0f8cdacea6c51'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:33:28.019636 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-b5ce86ed-559a-4b51-a63e-8224e173603f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4454c7fd2b554d7285f0f8cdacea6c51'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:33:28.071312 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 835/1664] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 11:33:27 2022] DELETE /identity/v3/users/4454c7fd2b554d7285f0f8cdacea6c51 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:33:28.209182 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c1fd08-f2bf-4e59-bc18-2d0f96782627 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:28.214505 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-51c1fd08-f2bf-4e59-bc18-2d0f96782627 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:28.236104 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c1fd08-f2bf-4e59-bc18-2d0f96782627 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:28.306163 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d0c7d0-59ff-4690-8f93-64b3775bd7f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:28.306981 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d0c7d0-59ff-4690-8f93-64b3775bd7f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:28.307403 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d0c7d0-59ff-4690-8f93-64b3775bd7f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:28.307727 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d0c7d0-59ff-4690-8f93-64b3775bd7f4 admin admin] PATH_INFO: `/v3/projects/55a65acab6e644b3a5505a17f2ee6071` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:28.309466 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d0c7d0-59ff-4690-8f93-64b3775bd7f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=55a65acab6e644b3a5505a17f2ee6071)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:28.311697 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d0c7d0-59ff-4690-8f93-64b3775bd7f4 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:28.370975 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:28.387722 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-12d0c7d0-59ff-4690-8f93-64b3775bd7f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55a65acab6e644b3a5505a17f2ee6071', 'request_id': 'req-12d0c7d0-59ff-4690-8f93-64b3775bd7f4'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:33:28.400368 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-12d0c7d0-59ff-4690-8f93-64b3775bd7f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55a65acab6e644b3a5505a17f2ee6071', 'request_id': 'req-12d0c7d0-59ff-4690-8f93-64b3775bd7f4'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:33:28.410874 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-12d0c7d0-59ff-4690-8f93-64b3775bd7f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55a65acab6e644b3a5505a17f2ee6071', 'request_id': 'req-12d0c7d0-59ff-4690-8f93-64b3775bd7f4'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:33:28.431964 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-12d0c7d0-59ff-4690-8f93-64b3775bd7f4 admin admin] The token cache is being invalidate because project 55a65acab6e644b3a5505a17f2ee6071 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81501) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:33:28.432196 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-12d0c7d0-59ff-4690-8f93-64b3775bd7f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:33:28.434101 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-12d0c7d0-59ff-4690-8f93-64b3775bd7f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:33:28.436250 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 830/1665] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 11:33:28 2022] DELETE /identity/v3/projects/55a65acab6e644b3a5505a17f2ee6071 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:33:28.441078 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd0e0d7-ecd3-47cb-a429-7477fa5fd46a None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:28.441369 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd0e0d7-ecd3-47cb-a429-7477fa5fd46a None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:28.441935 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd0e0d7-ecd3-47cb-a429-7477fa5fd46a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:28.466839 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-2cd0e0d7-ecd3-47cb-a429-7477fa5fd46a None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:33:28.469838 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-2cd0e0d7-ecd3-47cb-a429-7477fa5fd46a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:28.472844 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d0c7d0-59ff-4690-8f93-64b3775bd7f4 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:28.477025 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-12d0c7d0-59ff-4690-8f93-64b3775bd7f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:28.551611 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:28.578965 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 836/1666] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:33:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:33:28.582106 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e522dec4-92f1-45a7-baed-0f872a85fc52 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:28.583978 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e522dec4-92f1-45a7-baed-0f872a85fc52 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:28.584206 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e522dec4-92f1-45a7-baed-0f872a85fc52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:28.633013 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-e522dec4-92f1-45a7-baed-0f872a85fc52 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:33:28.644916 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-e522dec4-92f1-45a7-baed-0f872a85fc52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:28.668664 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 837/1667] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:33:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:33:28.669628 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e522dec4-92f1-45a7-baed-0f872a85fc52 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:28.674726 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d0c7d0-59ff-4690-8f93-64b3775bd7f4 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:28.683003 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1524b7b6-b9a4-4078-9ce2-76b2d2979a5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:28.684148 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1524b7b6-b9a4-4078-9ce2-76b2d2979a5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:28.685551 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1524b7b6-b9a4-4078-9ce2-76b2d2979a5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:28.686005 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1524b7b6-b9a4-4078-9ce2-76b2d2979a5a admin admin] PATH_INFO: `/v3/projects/c03be5c0a3594487958c76761dc700eb` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:28.691373 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1524b7b6-b9a4-4078-9ce2-76b2d2979a5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c03be5c0a3594487958c76761dc700eb)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:28.695778 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e522dec4-92f1-45a7-baed-0f872a85fc52 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:28.696138 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1524b7b6-b9a4-4078-9ce2-76b2d2979a5a admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:28.705819 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554d69ea-ff7a-4f96-a636-e00569fa6ce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:28.707516 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554d69ea-ff7a-4f96-a636-e00569fa6ce7 admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:28.707801 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554d69ea-ff7a-4f96-a636-e00569fa6ce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:28.715634 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554d69ea-ff7a-4f96-a636-e00569fa6ce7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:28.716428 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554d69ea-ff7a-4f96-a636-e00569fa6ce7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:28.718604 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554d69ea-ff7a-4f96-a636-e00569fa6ce7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:28.724109 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554d69ea-ff7a-4f96-a636-e00569fa6ce7 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:28.755986 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 838/1668] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 24 11:33:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:33:28.763632 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554d69ea-ff7a-4f96-a636-e00569fa6ce7 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:28.787058 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554d69ea-ff7a-4f96-a636-e00569fa6ce7 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:28.825618 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-1524b7b6-b9a4-4078-9ce2-76b2d2979a5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c03be5c0a3594487958c76761dc700eb', 'request_id': 'req-1524b7b6-b9a4-4078-9ce2-76b2d2979a5a'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:33:28.837902 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-1524b7b6-b9a4-4078-9ce2-76b2d2979a5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c03be5c0a3594487958c76761dc700eb', 'request_id': 'req-1524b7b6-b9a4-4078-9ce2-76b2d2979a5a'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:33:28.856449 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-1524b7b6-b9a4-4078-9ce2-76b2d2979a5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c03be5c0a3594487958c76761dc700eb', 'request_id': 'req-1524b7b6-b9a4-4078-9ce2-76b2d2979a5a'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:33:28.880762 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-1524b7b6-b9a4-4078-9ce2-76b2d2979a5a admin admin] The token cache is being invalidate because project c03be5c0a3594487958c76761dc700eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81501) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:33:28.881420 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-1524b7b6-b9a4-4078-9ce2-76b2d2979a5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:33:28.882118 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-1524b7b6-b9a4-4078-9ce2-76b2d2979a5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:33:28.884070 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 831/1669] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 11:33:28 2022] DELETE /identity/v3/projects/c03be5c0a3594487958c76761dc700eb => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:33:28.889247 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98c364c-9d21-4347-963a-efd2ea864437 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:28.889525 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98c364c-9d21-4347-963a-efd2ea864437 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:28.889789 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98c364c-9d21-4347-963a-efd2ea864437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:28.955938 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b12a51-3a77-495f-8a1a-ecf6dfc4873a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:28.957130 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b12a51-3a77-495f-8a1a-ecf6dfc4873a admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:28.957605 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b12a51-3a77-495f-8a1a-ecf6dfc4873a admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:28.958057 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b12a51-3a77-495f-8a1a-ecf6dfc4873a admin admin] PATH_INFO: `/v3/projects` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:28.959171 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b12a51-3a77-495f-8a1a-ecf6dfc4873a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:28.959781 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-e98c364c-9d21-4347-963a-efd2ea864437 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:33:28.961306 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-e98c364c-9d21-4347-963a-efd2ea864437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:28.964086 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b12a51-3a77-495f-8a1a-ecf6dfc4873a admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:28.996308 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 832/1670] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:33:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 11:33:29.004585 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82e8305-a80d-4a6b-b580-ac6f6d6f55fa None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:29.004988 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82e8305-a80d-4a6b-b580-ac6f6d6f55fa None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:29.005427 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82e8305-a80d-4a6b-b580-ac6f6d6f55fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:29.039346 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 839/1671] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 11:33:28 2022] POST /identity/v3/projects => generated 373 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:33:29.046033 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b12a51-3a77-495f-8a1a-ecf6dfc4873a admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:29.051017 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-43b12a51-3a77-495f-8a1a-ecf6dfc4873a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:29.080271 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-d82e8305-a80d-4a6b-b580-ac6f6d6f55fa None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:33:29.081891 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-d82e8305-a80d-4a6b-b580-ac6f6d6f55fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:29.196869 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b12a51-3a77-495f-8a1a-ecf6dfc4873a admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:29.212755 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aeec0a-ec49-40f1-b6c4-811bf111986f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:29.213633 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aeec0a-ec49-40f1-b6c4-811bf111986f admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:29.215488 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aeec0a-ec49-40f1-b6c4-811bf111986f admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:29.216178 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aeec0a-ec49-40f1-b6c4-811bf111986f admin admin] PATH_INFO: `/v3/users` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:29.218239 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81aeec0a-ec49-40f1-b6c4-811bf111986f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:29.222307 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:29.229785 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81aeec0a-ec49-40f1-b6c4-811bf111986f admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:29.271632 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 833/1672] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:33:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 11:33:29.273208 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82e8305-a80d-4a6b-b580-ac6f6d6f55fa None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:29.295375 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 840/1673] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 11:33:29 2022] POST /identity/v3/users => generated 287 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:33:29.296747 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aeec0a-ec49-40f1-b6c4-811bf111986f admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:29.327019 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82e8305-a80d-4a6b-b580-ac6f6d6f55fa None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:29.353557 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd12667-29bb-43a1-a7c6-39e72bcd456a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:29.354425 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd12667-29bb-43a1-a7c6-39e72bcd456a admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:29.354706 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd12667-29bb-43a1-a7c6-39e72bcd456a admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:29.354973 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd12667-29bb-43a1-a7c6-39e72bcd456a admin admin] PATH_INFO: `/v3/domains` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:29.356712 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aeec0a-ec49-40f1-b6c4-811bf111986f admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:29.362659 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd12667-29bb-43a1-a7c6-39e72bcd456a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:29.364602 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd12667-29bb-43a1-a7c6-39e72bcd456a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:29.367461 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd12667-29bb-43a1-a7c6-39e72bcd456a admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:29.372946 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb25eceb-b8de-4109-b7f3-fe8b29919e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:29.373583 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb25eceb-b8de-4109-b7f3-fe8b29919e23 admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:29.373851 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb25eceb-b8de-4109-b7f3-fe8b29919e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:29.374117 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb25eceb-b8de-4109-b7f3-fe8b29919e23 admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:29.380142 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb25eceb-b8de-4109-b7f3-fe8b29919e23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:29.386818 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb25eceb-b8de-4109-b7f3-fe8b29919e23 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:29.420731 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 834/1674] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 24 11:33:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:33:29.425814 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 841/1675] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:33:29 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:33:29.425971 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd12667-29bb-43a1-a7c6-39e72bcd456a admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:29.427048 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb25eceb-b8de-4109-b7f3-fe8b29919e23 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:29.458727 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd12667-29bb-43a1-a7c6-39e72bcd456a admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:29.460119 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb25eceb-b8de-4109-b7f3-fe8b29919e23 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:29.474514 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9e3c5e-2b32-4ef2-8f2a-fc51a1d5733b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:29.476729 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab29be0-791a-493a-bbeb-3fe277fdcd3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:29.477376 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9e3c5e-2b32-4ef2-8f2a-fc51a1d5733b admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:29.477651 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9e3c5e-2b32-4ef2-8f2a-fc51a1d5733b admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:29.477919 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9e3c5e-2b32-4ef2-8f2a-fc51a1d5733b admin admin] PATH_INFO: `/v3/projects` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:29.478657 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab29be0-791a-493a-bbeb-3fe277fdcd3c admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:29.478928 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab29be0-791a-493a-bbeb-3fe277fdcd3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:29.479187 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab29be0-791a-493a-bbeb-3fe277fdcd3c admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:29.482162 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9e3c5e-2b32-4ef2-8f2a-fc51a1d5733b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:29.484185 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab29be0-791a-493a-bbeb-3fe277fdcd3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:29.487724 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9e3c5e-2b32-4ef2-8f2a-fc51a1d5733b admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:29.489104 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab29be0-791a-493a-bbeb-3fe277fdcd3c admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:29.528863 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 842/1676] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:33:29 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:33:29.533996 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab29be0-791a-493a-bbeb-3fe277fdcd3c admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:29.572842 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab29be0-791a-493a-bbeb-3fe277fdcd3c admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:29.589643 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 835/1677] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 11:33:29 2022] POST /identity/v3/projects => generated 391 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:33:29.594492 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9e3c5e-2b32-4ef2-8f2a-fc51a1d5733b admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:29.594954 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8ea3c1-6a8a-4a6b-879f-69d34b1ded92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:29.598063 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8ea3c1-6a8a-4a6b-879f-69d34b1ded92 admin admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:29.598395 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8ea3c1-6a8a-4a6b-879f-69d34b1ded92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:29.598668 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8ea3c1-6a8a-4a6b-879f-69d34b1ded92 admin admin] PATH_INFO: `/v3/projects/09a1daa819d94efd9004eace3c81e814/users/6d5ade053a0b4c77b0cf9e079998e16c/roles/27e3e65e24df4b86b0d3d18d3212101d` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:29.658306 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8ea3c1-6a8a-4a6b-879f-69d34b1ded92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09a1daa819d94efd9004eace3c81e814, user_id=6d5ade053a0b4c77b0cf9e079998e16c, role_id=27e3e65e24df4b86b0d3d18d3212101d)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:29.689349 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8ea3c1-6a8a-4a6b-879f-69d34b1ded92 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:29.735193 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 843/1678] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 11:33:29 2022] PUT /identity/v3/projects/09a1daa819d94efd9004eace3c81e814/users/6d5ade053a0b4c77b0cf9e079998e16c/roles/27e3e65e24df4b86b0d3d18d3212101d => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:33:29.744292 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18daece2-c48d-4887-b5c6-e9614a11aed3 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:29.744681 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18daece2-c48d-4887-b5c6-e9614a11aed3 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:29.745097 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18daece2-c48d-4887-b5c6-e9614a11aed3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:29.825879 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:29.856499 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-18daece2-c48d-4887-b5c6-e9614a11aed3 None None] MFA Rules not processed for user `6d5ade053a0b4c77b0cf9e079998e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:33:29.861310 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-18daece2-c48d-4887-b5c6-e9614a11aed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:29.881731 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9e3c5e-2b32-4ef2-8f2a-fc51a1d5733b admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:30.076743 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6e8cb2-17be-4a77-847a-5094aff9e7b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:30.082436 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 844/1679] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:33:29 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:33:30.082601 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6e8cb2-17be-4a77-847a-5094aff9e7b2 admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:30.082601 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6e8cb2-17be-4a77-847a-5094aff9e7b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:30.082601 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6e8cb2-17be-4a77-847a-5094aff9e7b2 admin admin] PATH_INFO: `/v3/users` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:30.082818 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18daece2-c48d-4887-b5c6-e9614a11aed3 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:30.082892 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6e8cb2-17be-4a77-847a-5094aff9e7b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:30.082956 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-18daece2-c48d-4887-b5c6-e9614a11aed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:30.088906 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6e8cb2-17be-4a77-847a-5094aff9e7b2 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:30.103984 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18daece2-c48d-4887-b5c6-e9614a11aed3 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:30.105972 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b7c8a5-112c-4ec0-be94-5bb9d18f7b54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:30.107254 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b7c8a5-112c-4ec0-be94-5bb9d18f7b54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:30.107426 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b7c8a5-112c-4ec0-be94-5bb9d18f7b54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:30.109587 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b7c8a5-112c-4ec0-be94-5bb9d18f7b54 admin admin] PATH_INFO: `/v3/projects/ff439b1dfe9b44309ecc95cebfdc4dcc` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:30.111975 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b7c8a5-112c-4ec0-be94-5bb9d18f7b54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff439b1dfe9b44309ecc95cebfdc4dcc)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:30.115519 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b7c8a5-112c-4ec0-be94-5bb9d18f7b54 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:30.128064 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 836/1680] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 11:33:29 2022] POST /identity/v3/users => generated 296 bytes in 534 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:33:30.129484 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6e8cb2-17be-4a77-847a-5094aff9e7b2 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:30.132360 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-2d6e8cb2-17be-4a77-847a-5094aff9e7b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:30.236324 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-b5b7c8a5-112c-4ec0-be94-5bb9d18f7b54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff439b1dfe9b44309ecc95cebfdc4dcc', 'request_id': 'req-b5b7c8a5-112c-4ec0-be94-5bb9d18f7b54'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:33:30.241390 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:30.252235 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-b5b7c8a5-112c-4ec0-be94-5bb9d18f7b54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff439b1dfe9b44309ecc95cebfdc4dcc', 'request_id': 'req-b5b7c8a5-112c-4ec0-be94-5bb9d18f7b54'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:33:30.269949 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-b5b7c8a5-112c-4ec0-be94-5bb9d18f7b54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff439b1dfe9b44309ecc95cebfdc4dcc', 'request_id': 'req-b5b7c8a5-112c-4ec0-be94-5bb9d18f7b54'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:33:30.292738 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6e8cb2-17be-4a77-847a-5094aff9e7b2 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:30.324498 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-b5b7c8a5-112c-4ec0-be94-5bb9d18f7b54 admin admin] The token cache is being invalidate because project ff439b1dfe9b44309ecc95cebfdc4dcc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:33:30.324939 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-b5b7c8a5-112c-4ec0-be94-5bb9d18f7b54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:33:30.325957 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-b5b7c8a5-112c-4ec0-be94-5bb9d18f7b54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:33:30.328010 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 845/1681] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 11:33:30 2022] DELETE /identity/v3/projects/ff439b1dfe9b44309ecc95cebfdc4dcc => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:33:30.331563 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b7c8a5-112c-4ec0-be94-5bb9d18f7b54 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:30.337324 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-b5b7c8a5-112c-4ec0-be94-5bb9d18f7b54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:30.470801 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1bbebb-d817-413c-bfbc-443d1ad8ac6b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '282ec32864d046b2bea170f6a3845cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:30.473458 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1bbebb-d817-413c-bfbc-443d1ad8ac6b service nova] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:30.474171 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1bbebb-d817-413c-bfbc-443d1ad8ac6b service nova] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:30.474525 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1bbebb-d817-413c-bfbc-443d1ad8ac6b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:30.479146 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-ce1bbebb-d817-413c-bfbc-443d1ad8ac6b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:30.487731 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b7c8a5-112c-4ec0-be94-5bb9d18f7b54 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:30.507943 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87846f85-8235-4cab-9def-6a4540b1a2c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:30.508694 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87846f85-8235-4cab-9def-6a4540b1a2c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:30.509235 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87846f85-8235-4cab-9def-6a4540b1a2c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:30.509611 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87846f85-8235-4cab-9def-6a4540b1a2c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:30.510515 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87846f85-8235-4cab-9def-6a4540b1a2c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:30.512264 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87846f85-8235-4cab-9def-6a4540b1a2c4 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:30.551545 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 846/1682] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:33:30 2022] GET /identity/v3/roles => generated 1420 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:33:30.552168 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7624b5a-b5ae-45ba-aca0-feca0ceda06a None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:30.559485 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7624b5a-b5ae-45ba-aca0-feca0ceda06a None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:30.559935 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7624b5a-b5ae-45ba-aca0-feca0ceda06a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:30.565490 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1bbebb-d817-413c-bfbc-443d1ad8ac6b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:30.567908 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1bbebb-d817-413c-bfbc-443d1ad8ac6b service nova] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:30.580080 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 837/1683] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:33:30 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:33:30.581640 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1bbebb-d817-413c-bfbc-443d1ad8ac6b service nova] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:30.596872 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1bbebb-d817-413c-bfbc-443d1ad8ac6b service nova] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:30.607035 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2f8370-933a-4b09-8684-2206c0bc6f7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:30.608041 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2f8370-933a-4b09-8684-2206c0bc6f7c admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:30.615736 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2f8370-933a-4b09-8684-2206c0bc6f7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:30.616329 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2f8370-933a-4b09-8684-2206c0bc6f7c admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:30.617470 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2f8370-933a-4b09-8684-2206c0bc6f7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:30.619659 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2f8370-933a-4b09-8684-2206c0bc6f7c admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:30.620746 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-f7624b5a-b5ae-45ba-aca0-feca0ceda06a None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:33:30.623741 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-f7624b5a-b5ae-45ba-aca0-feca0ceda06a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:30.634468 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 838/1684] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:33:30 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:33:30.638338 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2f8370-933a-4b09-8684-2206c0bc6f7c admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:30.650708 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2f8370-933a-4b09-8684-2206c0bc6f7c admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:30.656298 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10eb5f81-4e81-410b-ac13-b5addda8a53e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:30.657298 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eb5f81-4e81-410b-ac13-b5addda8a53e admin admin] REQUEST_METHOD: `PUT` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:30.657822 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eb5f81-4e81-410b-ac13-b5addda8a53e admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:30.658199 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eb5f81-4e81-410b-ac13-b5addda8a53e admin admin] PATH_INFO: `/v3/projects/26be5280d9cb47668315783bb3921387/users/01dc93d2ae854521b433e46b71a37974/roles/27e3e65e24df4b86b0d3d18d3212101d` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:30.667647 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 847/1685] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:33:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:33:30.669188 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c8e96d-e54b-4041-affe-100b6d275da3 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:30.669478 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c8e96d-e54b-4041-affe-100b6d275da3 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:30.669766 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c8e96d-e54b-4041-affe-100b6d275da3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:30.687713 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10eb5f81-4e81-410b-ac13-b5addda8a53e admin admin] RBAC: Authorizing `identity:create_grant(project_id=26be5280d9cb47668315783bb3921387, user_id=01dc93d2ae854521b433e46b71a37974, role_id=27e3e65e24df4b86b0d3d18d3212101d)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:30.694836 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10eb5f81-4e81-410b-ac13-b5addda8a53e admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:30.735616 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-88c8e96d-e54b-4041-affe-100b6d275da3 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:33:30.736914 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-88c8e96d-e54b-4041-affe-100b6d275da3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:30.739040 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 839/1686] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 11:33:30 2022] PUT /identity/v3/projects/26be5280d9cb47668315783bb3921387/users/01dc93d2ae854521b433e46b71a37974/roles/27e3e65e24df4b86b0d3d18d3212101d => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:33:30.750076 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb392d5b-dacb-406a-9873-a101ffae211e None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:30.750629 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb392d5b-dacb-406a-9873-a101ffae211e None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:30.751009 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb392d5b-dacb-406a-9873-a101ffae211e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:30.762194 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:30.852497 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-eb392d5b-dacb-406a-9873-a101ffae211e None None] MFA Rules not processed for user `01dc93d2ae854521b433e46b71a37974`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:33:30.861110 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-eb392d5b-dacb-406a-9873-a101ffae211e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:30.943590 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 848/1687] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:33:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:33:30.947730 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c8e96d-e54b-4041-affe-100b6d275da3 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:30.975879 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c8e96d-e54b-4041-affe-100b6d275da3 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:30.987224 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0381556-e9da-4998-bce3-d85c2ed3f001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:30.988140 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0381556-e9da-4998-bce3-d85c2ed3f001 admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:30.988465 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0381556-e9da-4998-bce3-d85c2ed3f001 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:30.989321 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0381556-e9da-4998-bce3-d85c2ed3f001 admin admin] PATH_INFO: `/v3/domains` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:30.990058 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0381556-e9da-4998-bce3-d85c2ed3f001 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:30.990483 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0381556-e9da-4998-bce3-d85c2ed3f001 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:31.002262 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0381556-e9da-4998-bce3-d85c2ed3f001 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:31.053097 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 849/1688] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 24 11:33:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:33:31.057394 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0381556-e9da-4998-bce3-d85c2ed3f001 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:31.058304 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:31.087420 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0381556-e9da-4998-bce3-d85c2ed3f001 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:31.102931 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236aa022-2a50-4ad0-8dab-5c3d4f2a3f71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:31.102931 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236aa022-2a50-4ad0-8dab-5c3d4f2a3f71 admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:31.105745 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236aa022-2a50-4ad0-8dab-5c3d4f2a3f71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:31.106045 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236aa022-2a50-4ad0-8dab-5c3d4f2a3f71 admin admin] PATH_INFO: `/v3/projects` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:31.111518 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236aa022-2a50-4ad0-8dab-5c3d4f2a3f71 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:31.115847 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236aa022-2a50-4ad0-8dab-5c3d4f2a3f71 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:31.151673 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 840/1689] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:33:30 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 400 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 11:33:31.154745 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb392d5b-dacb-406a-9873-a101ffae211e None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:31.157671 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-eb392d5b-dacb-406a-9873-a101ffae211e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:31.198850 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb392d5b-dacb-406a-9873-a101ffae211e None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:31.207780 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1518f70-44b7-46a9-a50c-a5ef7957b3ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:31.212056 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 850/1690] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 11:33:31 2022] POST /identity/v3/projects => generated 363 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:33:31.212198 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1518f70-44b7-46a9-a50c-a5ef7957b3ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:31.212198 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1518f70-44b7-46a9-a50c-a5ef7957b3ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:31.212198 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1518f70-44b7-46a9-a50c-a5ef7957b3ae admin admin] PATH_INFO: `/v3/users/1d5487075cb542bc844ddf3efe1e9659` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:31.212424 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236aa022-2a50-4ad0-8dab-5c3d4f2a3f71 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:31.213113 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1518f70-44b7-46a9-a50c-a5ef7957b3ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d5487075cb542bc844ddf3efe1e9659)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:31.216098 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1518f70-44b7-46a9-a50c-a5ef7957b3ae admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:31.356205 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-a1518f70-44b7-46a9-a50c-a5ef7957b3ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d5487075cb542bc844ddf3efe1e9659'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:33:31.357070 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-a1518f70-44b7-46a9-a50c-a5ef7957b3ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d5487075cb542bc844ddf3efe1e9659'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:33:31.359263 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-a1518f70-44b7-46a9-a50c-a5ef7957b3ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d5487075cb542bc844ddf3efe1e9659'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:33:31.373791 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-a1518f70-44b7-46a9-a50c-a5ef7957b3ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d5487075cb542bc844ddf3efe1e9659'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:33:31.395621 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236aa022-2a50-4ad0-8dab-5c3d4f2a3f71 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:31.406671 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef77c02c-d0e6-4ac0-ac61-6eb58a7045a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:31.407339 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-a1518f70-44b7-46a9-a50c-a5ef7957b3ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d5487075cb542bc844ddf3efe1e9659'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:33:31.408138 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef77c02c-d0e6-4ac0-ac61-6eb58a7045a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:31.410063 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef77c02c-d0e6-4ac0-ac61-6eb58a7045a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:31.410510 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef77c02c-d0e6-4ac0-ac61-6eb58a7045a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:31.414121 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef77c02c-d0e6-4ac0-ac61-6eb58a7045a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:31.426837 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef77c02c-d0e6-4ac0-ac61-6eb58a7045a6 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:31.474225 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 841/1691] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 11:33:31 2022] DELETE /identity/v3/users/1d5487075cb542bc844ddf3efe1e9659 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:33:31.476525 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1518f70-44b7-46a9-a50c-a5ef7957b3ae admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:31.479644 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-a1518f70-44b7-46a9-a50c-a5ef7957b3ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:31.545078 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 851/1692] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 11:33:31 2022] POST /identity/v3/projects => generated 391 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:33:31.547228 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ae799c-fed3-4507-a3e2-11dc344ce6a8 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:31.551098 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ae799c-fed3-4507-a3e2-11dc344ce6a8 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:31.552481 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ae799c-fed3-4507-a3e2-11dc344ce6a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:31.600953 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-07ae799c-fed3-4507-a3e2-11dc344ce6a8 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:33:31.603350 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-07ae799c-fed3-4507-a3e2-11dc344ce6a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:31.649865 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1518f70-44b7-46a9-a50c-a5ef7957b3ae admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:31.723866 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 852/1693] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:33:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:33:31.724916 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ae799c-fed3-4507-a3e2-11dc344ce6a8 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:31.726341 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-07ae799c-fed3-4507-a3e2-11dc344ce6a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:31.736244 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:31.745345 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ae799c-fed3-4507-a3e2-11dc344ce6a8 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:31.751688 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfc2f19-2787-4fd9-8980-a0919728122c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:31.753083 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfc2f19-2787-4fd9-8980-a0919728122c admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:31.753561 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfc2f19-2787-4fd9-8980-a0919728122c admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:31.753952 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfc2f19-2787-4fd9-8980-a0919728122c admin admin] PATH_INFO: `/v3/users` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:31.754644 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfc2f19-2787-4fd9-8980-a0919728122c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:31.757106 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfc2f19-2787-4fd9-8980-a0919728122c admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:31.788006 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 853/1694] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 11:33:31 2022] POST /identity/v3/users => generated 302 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:33:31.789518 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfc2f19-2787-4fd9-8980-a0919728122c admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:31.793355 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-2dfc2f19-2787-4fd9-8980-a0919728122c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:31.803483 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76907d98-e7f9-46ae-835c-fd1377d860b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:31.804385 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76907d98-e7f9-46ae-835c-fd1377d860b0 admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:31.804910 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76907d98-e7f9-46ae-835c-fd1377d860b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:31.806049 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76907d98-e7f9-46ae-835c-fd1377d860b0 admin admin] PATH_INFO: `/v3/users` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:31.806898 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76907d98-e7f9-46ae-835c-fd1377d860b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:31.815397 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76907d98-e7f9-46ae-835c-fd1377d860b0 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:31.837686 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:31.866470 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 842/1695] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 11:33:31 2022] POST /identity/v3/users => generated 282 bytes in 390 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:33:31.868615 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76907d98-e7f9-46ae-835c-fd1377d860b0 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:31.913868 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76907d98-e7f9-46ae-835c-fd1377d860b0 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:31.919556 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d63510-3046-4ef5-a229-c7129fe76906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:31.921694 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d63510-3046-4ef5-a229-c7129fe76906 admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:31.922216 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d63510-3046-4ef5-a229-c7129fe76906 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:31.922740 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d63510-3046-4ef5-a229-c7129fe76906 admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:31.924052 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d63510-3046-4ef5-a229-c7129fe76906 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:31.927179 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d63510-3046-4ef5-a229-c7129fe76906 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:31.947197 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 843/1696] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:33:31 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:33:31.948107 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d63510-3046-4ef5-a229-c7129fe76906 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:31.960981 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d63510-3046-4ef5-a229-c7129fe76906 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:31.965875 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69992cdf-dfd1-490e-b7b9-0eb97de00789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:31.966538 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69992cdf-dfd1-490e-b7b9-0eb97de00789 admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:31.966819 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69992cdf-dfd1-490e-b7b9-0eb97de00789 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:31.967089 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69992cdf-dfd1-490e-b7b9-0eb97de00789 admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:31.967750 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69992cdf-dfd1-490e-b7b9-0eb97de00789 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:31.969095 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfc2f19-2787-4fd9-8980-a0919728122c admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:31.969381 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69992cdf-dfd1-490e-b7b9-0eb97de00789 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:31.976624 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a9f749-38a4-4d90-ad55-d0150b6affb9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2d061d25d83443c9232218c90792d51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:31.985106 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 844/1697] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:33:31 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:33:31.985106 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69992cdf-dfd1-490e-b7b9-0eb97de00789 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:31.987841 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a9f749-38a4-4d90-ad55-d0150b6affb9 service neutron] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:31.988597 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a9f749-38a4-4d90-ad55-d0150b6affb9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:31.989489 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a9f749-38a4-4d90-ad55-d0150b6affb9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:32.003518 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a9f749-38a4-4d90-ad55-d0150b6affb9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:32.004746 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69992cdf-dfd1-490e-b7b9-0eb97de00789 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:32.005645 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a9f749-38a4-4d90-ad55-d0150b6affb9 service neutron] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:32.017629 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5a60fb-c331-4a7e-82ec-3c8c90711da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:32.018561 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5a60fb-c331-4a7e-82ec-3c8c90711da7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:32.018895 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5a60fb-c331-4a7e-82ec-3c8c90711da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:32.019176 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5a60fb-c331-4a7e-82ec-3c8c90711da7 admin admin] PATH_INFO: `/v3/projects/856ac9cb11524921b8a2c0574a594ad0/users/2d0f6e47678f44008c7a03cb3946c3a9/roles/30bb1e97257f4ca5b90c88545777317b` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:32.021342 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 854/1698] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:33:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:33:32.022549 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a9f749-38a4-4d90-ad55-d0150b6affb9 service neutron] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:32.034057 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a9f749-38a4-4d90-ad55-d0150b6affb9 service neutron] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:32.040453 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d1fbdc-4907-4332-99b4-dc9d2b7d2fc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:32.042035 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d1fbdc-4907-4332-99b4-dc9d2b7d2fc8 admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:32.042615 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d1fbdc-4907-4332-99b4-dc9d2b7d2fc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:32.043097 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5a60fb-c331-4a7e-82ec-3c8c90711da7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=856ac9cb11524921b8a2c0574a594ad0, user_id=2d0f6e47678f44008c7a03cb3946c3a9, role_id=30bb1e97257f4ca5b90c88545777317b)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:32.043343 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d1fbdc-4907-4332-99b4-dc9d2b7d2fc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:32.044594 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d1fbdc-4907-4332-99b4-dc9d2b7d2fc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:32.045818 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5a60fb-c331-4a7e-82ec-3c8c90711da7 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:32.046914 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d1fbdc-4907-4332-99b4-dc9d2b7d2fc8 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:32.063942 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 855/1699] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:33:32 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:33:32.069404 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d1fbdc-4907-4332-99b4-dc9d2b7d2fc8 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:32.090737 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 845/1700] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 11:33:31 2022] PUT /identity/v3/projects/856ac9cb11524921b8a2c0574a594ad0/users/2d0f6e47678f44008c7a03cb3946c3a9/roles/30bb1e97257f4ca5b90c88545777317b => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:33:32.094845 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5a60fb-c331-4a7e-82ec-3c8c90711da7 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:32.119967 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d1fbdc-4907-4332-99b4-dc9d2b7d2fc8 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:32.241669 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5a60fb-c331-4a7e-82ec-3c8c90711da7 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:32.253762 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c26b757-c994-41db-88ca-b65066bd5919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:32.254419 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c26b757-c994-41db-88ca-b65066bd5919 admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:32.254705 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c26b757-c994-41db-88ca-b65066bd5919 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:32.254995 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c26b757-c994-41db-88ca-b65066bd5919 admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:32.255646 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c26b757-c994-41db-88ca-b65066bd5919 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:32.264941 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c26b757-c994-41db-88ca-b65066bd5919 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:32.278821 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a8d112-affc-4069-8aed-9fb7ecf94155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:32.279540 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a8d112-affc-4069-8aed-9fb7ecf94155 admin admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:32.279804 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a8d112-affc-4069-8aed-9fb7ecf94155 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:32.281250 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a8d112-affc-4069-8aed-9fb7ecf94155 admin admin] PATH_INFO: `/v3/projects/fea200eb709a465ebcdf92a4200b629b/users/c66b4ea230ae458db8636ab8b41d185e/roles/27e3e65e24df4b86b0d3d18d3212101d` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:32.289683 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 846/1701] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:33:32 2022] GET /identity/v3/roles => generated 1420 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 11:33:32.294109 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c26b757-c994-41db-88ca-b65066bd5919 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:32.318754 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a8d112-affc-4069-8aed-9fb7ecf94155 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fea200eb709a465ebcdf92a4200b629b, user_id=c66b4ea230ae458db8636ab8b41d185e, role_id=27e3e65e24df4b86b0d3d18d3212101d)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:32.319820 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c26b757-c994-41db-88ca-b65066bd5919 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:32.322161 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a8d112-affc-4069-8aed-9fb7ecf94155 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:32.329442 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0bc86f-4118-4feb-8432-540f2a905fb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:32.330238 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0bc86f-4118-4feb-8432-540f2a905fb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:32.331351 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0bc86f-4118-4feb-8432-540f2a905fb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:32.331700 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0bc86f-4118-4feb-8432-540f2a905fb9 admin admin] PATH_INFO: `/v3/projects/856ac9cb11524921b8a2c0574a594ad0/users/2d0f6e47678f44008c7a03cb3946c3a9/roles/30bb1e97257f4ca5b90c88545777317b` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:32.337216 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0bc86f-4118-4feb-8432-540f2a905fb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=856ac9cb11524921b8a2c0574a594ad0, user_id=2d0f6e47678f44008c7a03cb3946c3a9, role_id=30bb1e97257f4ca5b90c88545777317b)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:32.340766 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0bc86f-4118-4feb-8432-540f2a905fb9 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:32.351529 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 856/1702] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 11:33:32 2022] PUT /identity/v3/projects/fea200eb709a465ebcdf92a4200b629b/users/c66b4ea230ae458db8636ab8b41d185e/roles/27e3e65e24df4b86b0d3d18d3212101d => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:33:32.362610 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a047e818-2453-4d3a-8cd4-1c67ae0fe944 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:32.362734 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a047e818-2453-4d3a-8cd4-1c67ae0fe944 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:32.362948 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a047e818-2453-4d3a-8cd4-1c67ae0fe944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:32.386406 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 847/1703] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 11:33:32 2022] PUT /identity/v3/projects/856ac9cb11524921b8a2c0574a594ad0/users/2d0f6e47678f44008c7a03cb3946c3a9/roles/30bb1e97257f4ca5b90c88545777317b => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:33:32.397546 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497f1d91-3eac-4c9f-8cb7-d3161fe1d686 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:32.398006 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497f1d91-3eac-4c9f-8cb7-d3161fe1d686 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:32.398342 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497f1d91-3eac-4c9f-8cb7-d3161fe1d686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:32.461823 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-a047e818-2453-4d3a-8cd4-1c67ae0fe944 None None] MFA Rules not processed for user `c66b4ea230ae458db8636ab8b41d185e`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:33:32.463458 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-a047e818-2453-4d3a-8cd4-1c67ae0fe944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:32.491190 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-497f1d91-3eac-4c9f-8cb7-d3161fe1d686 None None] MFA Rules not processed for user `2d0f6e47678f44008c7a03cb3946c3a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:33:32.492979 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-497f1d91-3eac-4c9f-8cb7-d3161fe1d686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:32.688552 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:32.794350 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 848/1704] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:33:32 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 398 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:33:32.798335 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 857/1705] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:33:32 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 437 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 11:33:32.803046 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497f1d91-3eac-4c9f-8cb7-d3161fe1d686 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:32.805931 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a047e818-2453-4d3a-8cd4-1c67ae0fe944 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:32.809993 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-a047e818-2453-4d3a-8cd4-1c67ae0fe944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:32.891504 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:32.984363 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a047e818-2453-4d3a-8cd4-1c67ae0fe944 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:32.996631 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2adce30-b54b-44dc-b6d3-d382bfe9e7a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92862b76ba3b4513b5dc5b5c962faac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:32.997422 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2adce30-b54b-44dc-b6d3-d382bfe9e7a2 service cinder] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:32.997780 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2adce30-b54b-44dc-b6d3-d382bfe9e7a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:32.998106 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2adce30-b54b-44dc-b6d3-d382bfe9e7a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:33.039523 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2adce30-b54b-44dc-b6d3-d382bfe9e7a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:33.042056 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2adce30-b54b-44dc-b6d3-d382bfe9e7a2 service cinder] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:33.068207 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 858/1706] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:33:32 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:33:33.090325 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497f1d91-3eac-4c9f-8cb7-d3161fe1d686 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:33.111090 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef4e538-3669-48fa-b07f-6aaaa35f9439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:33.113277 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef4e538-3669-48fa-b07f-6aaaa35f9439 admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:33.115339 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef4e538-3669-48fa-b07f-6aaaa35f9439 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:33.115703 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef4e538-3669-48fa-b07f-6aaaa35f9439 admin admin] PATH_INFO: `/v3/projects` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:33.117235 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef4e538-3669-48fa-b07f-6aaaa35f9439 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:33.121058 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef4e538-3669-48fa-b07f-6aaaa35f9439 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:33.203659 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b626a7-8231-4cb9-ba40-561d783e5709 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:33.204133 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b626a7-8231-4cb9-ba40-561d783e5709 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:33.204890 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b626a7-8231-4cb9-ba40-561d783e5709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:33.235872 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 849/1707] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 11:33:32 2022] POST /identity/v3/projects => generated 365 bytes in 433 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:33:33.237009 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef4e538-3669-48fa-b07f-6aaaa35f9439 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:33.279055 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-51b626a7-8231-4cb9-ba40-561d783e5709 None None] MFA Rules not processed for user `6b08455fa85c4b60af58e9f213a00a4d`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:33:33.280549 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-51b626a7-8231-4cb9-ba40-561d783e5709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:33.361689 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef4e538-3669-48fa-b07f-6aaaa35f9439 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:33.371288 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053f68ce-7f6c-4e71-b2fa-e4cc642b5c37 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92862b76ba3b4513b5dc5b5c962faac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:33.372306 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053f68ce-7f6c-4e71-b2fa-e4cc642b5c37 service cinder] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:33.373622 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053f68ce-7f6c-4e71-b2fa-e4cc642b5c37 service cinder] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:33.374096 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053f68ce-7f6c-4e71-b2fa-e4cc642b5c37 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:33.376856 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-053f68ce-7f6c-4e71-b2fa-e4cc642b5c37 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:33.467384 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053f68ce-7f6c-4e71-b2fa-e4cc642b5c37 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:33.469387 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053f68ce-7f6c-4e71-b2fa-e4cc642b5c37 service cinder] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:33.476439 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 859/1708] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:33:33 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:33:33.477904 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b626a7-8231-4cb9-ba40-561d783e5709 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:33.497394 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 850/1709] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:33:33 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:33:33.499519 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053f68ce-7f6c-4e71-b2fa-e4cc642b5c37 service cinder] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:33.503280 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-053f68ce-7f6c-4e71-b2fa-e4cc642b5c37 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:33.602826 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b626a7-8231-4cb9-ba40-561d783e5709 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:33.604973 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:33.615501 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fcd83b-313d-4d9a-a4f3-482d29fc1023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:33.616646 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fcd83b-313d-4d9a-a4f3-482d29fc1023 admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:33.616646 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fcd83b-313d-4d9a-a4f3-482d29fc1023 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:33.616827 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fcd83b-313d-4d9a-a4f3-482d29fc1023 admin admin] PATH_INFO: `/v3/users` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:33.617492 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fcd83b-313d-4d9a-a4f3-482d29fc1023 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:33.620518 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fcd83b-313d-4d9a-a4f3-482d29fc1023 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:33.633290 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053f68ce-7f6c-4e71-b2fa-e4cc642b5c37 service cinder] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:33.640709 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acba63b2-e716-4f87-ba81-9a9ef55d61f4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '282ec32864d046b2bea170f6a3845cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:33.642283 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acba63b2-e716-4f87-ba81-9a9ef55d61f4 service nova] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:33.642689 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acba63b2-e716-4f87-ba81-9a9ef55d61f4 service nova] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:33.643065 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acba63b2-e716-4f87-ba81-9a9ef55d61f4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:33.656774 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acba63b2-e716-4f87-ba81-9a9ef55d61f4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:33.657836 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 860/1710] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 11:33:33 2022] POST /identity/v3/users => generated 289 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:33:33.663674 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acba63b2-e716-4f87-ba81-9a9ef55d61f4 service nova] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:33.663891 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fcd83b-313d-4d9a-a4f3-482d29fc1023 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:33.673433 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 851/1711] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:33:33 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:33:33.688415 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fcd83b-313d-4d9a-a4f3-482d29fc1023 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:33.699183 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f1a635-5201-4233-8cc2-063c37c13066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:33.700334 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f1a635-5201-4233-8cc2-063c37c13066 admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:33.701050 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f1a635-5201-4233-8cc2-063c37c13066 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:33.701569 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f1a635-5201-4233-8cc2-063c37c13066 admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:33.702737 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f1a635-5201-4233-8cc2-063c37c13066 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:33.706136 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f1a635-5201-4233-8cc2-063c37c13066 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:33.722154 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:33.745915 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 861/1712] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:33:33 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:33:33.749923 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acba63b2-e716-4f87-ba81-9a9ef55d61f4 service nova] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:33.764988 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acba63b2-e716-4f87-ba81-9a9ef55d61f4 service nova] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:33.803801 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f150a28e-7974-4080-9996-d8351a8b7ea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:33.804708 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f150a28e-7974-4080-9996-d8351a8b7ea9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:33.805160 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f150a28e-7974-4080-9996-d8351a8b7ea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:33.805605 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f150a28e-7974-4080-9996-d8351a8b7ea9 admin admin] PATH_INFO: `/v3/projects/b592ca4a2036405a865033c97cf8bd83/users/810ccd94bfd9411cb2a2b2dbbe81eabb/roles/30bb1e97257f4ca5b90c88545777317b` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:33.965850 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f150a28e-7974-4080-9996-d8351a8b7ea9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b592ca4a2036405a865033c97cf8bd83, user_id=810ccd94bfd9411cb2a2b2dbbe81eabb, role_id=30bb1e97257f4ca5b90c88545777317b)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:33.985683 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f150a28e-7974-4080-9996-d8351a8b7ea9 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:34.108222 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 852/1713] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 11:33:33 2022] PUT /identity/v3/projects/b592ca4a2036405a865033c97cf8bd83/users/810ccd94bfd9411cb2a2b2dbbe81eabb/roles/30bb1e97257f4ca5b90c88545777317b => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 11:33:34.114426 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f1a635-5201-4233-8cc2-063c37c13066 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:34.139828 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f1a635-5201-4233-8cc2-063c37c13066 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:34.367574 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f150a28e-7974-4080-9996-d8351a8b7ea9 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:34.368824 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-f150a28e-7974-4080-9996-d8351a8b7ea9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:34.411370 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a025021c-3314-4f8f-9665-f2497d20d638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:34.411911 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a025021c-3314-4f8f-9665-f2497d20d638 admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:34.414826 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a025021c-3314-4f8f-9665-f2497d20d638 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:34.415109 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a025021c-3314-4f8f-9665-f2497d20d638 admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:34.416580 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a025021c-3314-4f8f-9665-f2497d20d638 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:34.419914 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a025021c-3314-4f8f-9665-f2497d20d638 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:34.459139 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 862/1714] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:33:34 2022] GET /identity/v3/roles => generated 1420 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 11:33:34.460374 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a025021c-3314-4f8f-9665-f2497d20d638 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:34.482615 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a025021c-3314-4f8f-9665-f2497d20d638 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:34.493810 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31b8b3b-38fa-470d-a2aa-392a4f87c780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:34.494878 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31b8b3b-38fa-470d-a2aa-392a4f87c780 admin admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:34.495227 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31b8b3b-38fa-470d-a2aa-392a4f87c780 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:34.495484 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31b8b3b-38fa-470d-a2aa-392a4f87c780 admin admin] PATH_INFO: `/v3/projects/b592ca4a2036405a865033c97cf8bd83/users/810ccd94bfd9411cb2a2b2dbbe81eabb/roles/30bb1e97257f4ca5b90c88545777317b` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:34.500030 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31b8b3b-38fa-470d-a2aa-392a4f87c780 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b592ca4a2036405a865033c97cf8bd83, user_id=810ccd94bfd9411cb2a2b2dbbe81eabb, role_id=30bb1e97257f4ca5b90c88545777317b)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:34.504179 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31b8b3b-38fa-470d-a2aa-392a4f87c780 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:34.532037 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f150a28e-7974-4080-9996-d8351a8b7ea9 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:34.535151 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 863/1715] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 11:33:34 2022] PUT /identity/v3/projects/b592ca4a2036405a865033c97cf8bd83/users/810ccd94bfd9411cb2a2b2dbbe81eabb/roles/30bb1e97257f4ca5b90c88545777317b => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:33:34.550559 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba95fb76-e235-44b3-8fa5-28d92ea63417 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:34.550860 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba95fb76-e235-44b3-8fa5-28d92ea63417 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:34.551121 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba95fb76-e235-44b3-8fa5-28d92ea63417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:34.624735 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-ba95fb76-e235-44b3-8fa5-28d92ea63417 None None] MFA Rules not processed for user `810ccd94bfd9411cb2a2b2dbbe81eabb`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:33:34.625987 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-ba95fb76-e235-44b3-8fa5-28d92ea63417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:34.698952 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed9c70e-3695-496e-a5ea-db57868cb103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:34.699973 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed9c70e-3695-496e-a5ea-db57868cb103 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:34.700395 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed9c70e-3695-496e-a5ea-db57868cb103 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:34.700678 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed9c70e-3695-496e-a5ea-db57868cb103 admin admin] PATH_INFO: `/v3/users/6d5ade053a0b4c77b0cf9e079998e16c` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:34.703013 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed9c70e-3695-496e-a5ea-db57868cb103 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d5ade053a0b4c77b0cf9e079998e16c)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:34.705160 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed9c70e-3695-496e-a5ea-db57868cb103 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:34.773401 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 864/1716] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:33:34 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:33:34.774764 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba95fb76-e235-44b3-8fa5-28d92ea63417 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:34.780944 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-ba95fb76-e235-44b3-8fa5-28d92ea63417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:34.839255 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-0ed9c70e-3695-496e-a5ea-db57868cb103 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d5ade053a0b4c77b0cf9e079998e16c'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:33:34.841166 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-0ed9c70e-3695-496e-a5ea-db57868cb103 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d5ade053a0b4c77b0cf9e079998e16c'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:33:34.842005 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-0ed9c70e-3695-496e-a5ea-db57868cb103 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d5ade053a0b4c77b0cf9e079998e16c'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:33:34.866234 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-0ed9c70e-3695-496e-a5ea-db57868cb103 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d5ade053a0b4c77b0cf9e079998e16c'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:33:34.872273 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba95fb76-e235-44b3-8fa5-28d92ea63417 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:34.875159 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:34.878556 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0f6a5c-11a7-467d-87c1-9cf52662aff6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92862b76ba3b4513b5dc5b5c962faac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:34.879621 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0f6a5c-11a7-467d-87c1-9cf52662aff6 service cinder] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:34.880100 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0f6a5c-11a7-467d-87c1-9cf52662aff6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:34.880575 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0f6a5c-11a7-467d-87c1-9cf52662aff6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:34.883003 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-0ed9c70e-3695-496e-a5ea-db57868cb103 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d5ade053a0b4c77b0cf9e079998e16c'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:33:34.883766 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-fd0f6a5c-11a7-467d-87c1-9cf52662aff6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:34.903523 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0f6a5c-11a7-467d-87c1-9cf52662aff6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:34.905788 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0f6a5c-11a7-467d-87c1-9cf52662aff6 service cinder] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:34.922165 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 865/1717] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:33:34 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:33:34.936771 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 853/1718] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 11:33:34 2022] DELETE /identity/v3/users/6d5ade053a0b4c77b0cf9e079998e16c => generated 0 bytes in 570 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:33:34.937418 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed9c70e-3695-496e-a5ea-db57868cb103 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:34.943535 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad326e46-bd96-419c-ab77-0643231adbb7 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:34.944094 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad326e46-bd96-419c-ab77-0643231adbb7 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:34.944564 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad326e46-bd96-419c-ab77-0643231adbb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:34.946305 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-0ed9c70e-3695-496e-a5ea-db57868cb103 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:35.012282 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-ad326e46-bd96-419c-ab77-0643231adbb7 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:33:35.013981 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-ad326e46-bd96-419c-ab77-0643231adbb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:35.037725 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:35.144776 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed9c70e-3695-496e-a5ea-db57868cb103 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:35.151686 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d499f8de-871f-4674-a089-0bbfa97ad205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:35.152449 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d499f8de-871f-4674-a089-0bbfa97ad205 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:35.152733 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d499f8de-871f-4674-a089-0bbfa97ad205 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:35.153011 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d499f8de-871f-4674-a089-0bbfa97ad205 admin admin] PATH_INFO: `/v3/projects/427d950fbd984c44a0834e30e6e6f6ad` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:35.154343 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d499f8de-871f-4674-a089-0bbfa97ad205 admin admin] RBAC: Authorizing `identity:delete_project(project_id=427d950fbd984c44a0834e30e6e6f6ad)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:35.156653 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d499f8de-871f-4674-a089-0bbfa97ad205 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:35.242214 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 866/1719] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:33:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:33:35.243212 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad326e46-bd96-419c-ab77-0643231adbb7 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:35.248738 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-ad326e46-bd96-419c-ab77-0643231adbb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:35.282388 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-d499f8de-871f-4674-a089-0bbfa97ad205 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '427d950fbd984c44a0834e30e6e6f6ad', 'request_id': 'req-d499f8de-871f-4674-a089-0bbfa97ad205'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:33:35.300624 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-d499f8de-871f-4674-a089-0bbfa97ad205 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '427d950fbd984c44a0834e30e6e6f6ad', 'request_id': 'req-d499f8de-871f-4674-a089-0bbfa97ad205'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:33:35.317335 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-d499f8de-871f-4674-a089-0bbfa97ad205 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '427d950fbd984c44a0834e30e6e6f6ad', 'request_id': 'req-d499f8de-871f-4674-a089-0bbfa97ad205'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:33:35.376698 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-d499f8de-871f-4674-a089-0bbfa97ad205 admin admin] The token cache is being invalidate because project 427d950fbd984c44a0834e30e6e6f6ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81501) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:33:35.379687 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-d499f8de-871f-4674-a089-0bbfa97ad205 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:33:35.386043 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-d499f8de-871f-4674-a089-0bbfa97ad205 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:33:35.398682 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 854/1720] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 11:33:34 2022] DELETE /identity/v3/projects/427d950fbd984c44a0834e30e6e6f6ad => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:33:35.402236 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d499f8de-871f-4674-a089-0bbfa97ad205 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:35.408358 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-d499f8de-871f-4674-a089-0bbfa97ad205 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:35.433518 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad326e46-bd96-419c-ab77-0643231adbb7 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:35.540225 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21beb664-f561-4069-9903-79110a237682 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92862b76ba3b4513b5dc5b5c962faac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:35.540861 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21beb664-f561-4069-9903-79110a237682 service cinder] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:35.541139 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21beb664-f561-4069-9903-79110a237682 service cinder] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:35.541409 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21beb664-f561-4069-9903-79110a237682 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:35.545046 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-21beb664-f561-4069-9903-79110a237682 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:35.636739 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21beb664-f561-4069-9903-79110a237682 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:35.642965 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21beb664-f561-4069-9903-79110a237682 service cinder] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:35.663295 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 867/1721] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:33:35 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:33:35.668980 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21beb664-f561-4069-9903-79110a237682 service cinder] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:35.672969 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-21beb664-f561-4069-9903-79110a237682 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:35.693366 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d499f8de-871f-4674-a089-0bbfa97ad205 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:35.713863 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb0b5fb-7ba3-4176-b917-a2f62f192fc6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2d061d25d83443c9232218c90792d51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:35.717390 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb0b5fb-7ba3-4176-b917-a2f62f192fc6 service neutron] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:35.717873 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb0b5fb-7ba3-4176-b917-a2f62f192fc6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:35.718389 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb0b5fb-7ba3-4176-b917-a2f62f192fc6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:35.724688 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-1eb0b5fb-7ba3-4176-b917-a2f62f192fc6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:35.728461 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:35.809252 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21beb664-f561-4069-9903-79110a237682 service cinder] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:35.815295 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d61568-375c-4c37-8c30-13b03f644cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:35.816378 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d61568-375c-4c37-8c30-13b03f644cfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:35.816661 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d61568-375c-4c37-8c30-13b03f644cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:35.816939 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d61568-375c-4c37-8c30-13b03f644cfe admin admin] PATH_INFO: `/v3/users/927fd2118ec04cf8a2d3208c88820363` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:35.818399 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d61568-375c-4c37-8c30-13b03f644cfe admin admin] RBAC: Authorizing `identity:delete_user(user_id=927fd2118ec04cf8a2d3208c88820363)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:35.820307 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d61568-375c-4c37-8c30-13b03f644cfe admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:35.863278 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:35.894330 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-f2d61568-375c-4c37-8c30-13b03f644cfe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '927fd2118ec04cf8a2d3208c88820363'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:33:35.895330 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-f2d61568-375c-4c37-8c30-13b03f644cfe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '927fd2118ec04cf8a2d3208c88820363'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:33:35.915846 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-f2d61568-375c-4c37-8c30-13b03f644cfe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '927fd2118ec04cf8a2d3208c88820363'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:33:35.937711 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-f2d61568-375c-4c37-8c30-13b03f644cfe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '927fd2118ec04cf8a2d3208c88820363'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:33:35.946295 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-f2d61568-375c-4c37-8c30-13b03f644cfe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '927fd2118ec04cf8a2d3208c88820363'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:33:36.002198 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 868/1722] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 11:33:35 2022] DELETE /identity/v3/users/927fd2118ec04cf8a2d3208c88820363 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:33:36.103161 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb0b5fb-7ba3-4176-b917-a2f62f192fc6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:36.104369 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb0b5fb-7ba3-4176-b917-a2f62f192fc6 service neutron] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:36.189985 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 855/1723] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:33:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 790 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:33:36.793594 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7dac76-83bb-4f09-8fd9-006273f14242 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:36.794514 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7dac76-83bb-4f09-8fd9-006273f14242 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:36.794933 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7dac76-83bb-4f09-8fd9-006273f14242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:36.895101 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-fd7dac76-83bb-4f09-8fd9-006273f14242 None None] MFA Rules not processed for user `83a80b36a7d64f1c95cc7e772acf38e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:33:36.899135 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-fd7dac76-83bb-4f09-8fd9-006273f14242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:36.962385 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef530b21-886f-432f-ab53-33d8b9305cd5 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:36.962919 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef530b21-886f-432f-ab53-33d8b9305cd5 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:36.963110 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef530b21-886f-432f-ab53-33d8b9305cd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:37.027668 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-ef530b21-886f-432f-ab53-33d8b9305cd5 None None] MFA Rules not processed for user `c53eb370dc294248b3be2248570d1b04`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:33:37.028779 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-ef530b21-886f-432f-ab53-33d8b9305cd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:37.159195 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 869/1724] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:33:36 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 367 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:33:37.168951 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48525458-10df-4ad0-90ed-5161d3588b6a None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:37.169913 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48525458-10df-4ad0-90ed-5161d3588b6a None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:37.170446 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48525458-10df-4ad0-90ed-5161d3588b6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:37.203931 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 856/1725] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:33:36 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:33:37.219610 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef530b21-886f-432f-ab53-33d8b9305cd5 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:37.221795 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-ef530b21-886f-432f-ab53-33d8b9305cd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:37.254644 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-48525458-10df-4ad0-90ed-5161d3588b6a None None] MFA Rules not processed for user `83a80b36a7d64f1c95cc7e772acf38e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:33:37.264168 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-48525458-10df-4ad0-90ed-5161d3588b6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:37.293692 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 870/1726] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:33:37 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:33:37.307771 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48525458-10df-4ad0-90ed-5161d3588b6a None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:37.309694 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-48525458-10df-4ad0-90ed-5161d3588b6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:37.376788 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:37.401345 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef530b21-886f-432f-ab53-33d8b9305cd5 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:37.414566 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed488b4-a2ed-412f-ac22-a4d0c5f91017 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '282ec32864d046b2bea170f6a3845cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:37.416389 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed488b4-a2ed-412f-ac22-a4d0c5f91017 service nova] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:37.417744 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed488b4-a2ed-412f-ac22-a4d0c5f91017 service nova] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:37.429552 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed488b4-a2ed-412f-ac22-a4d0c5f91017 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:37.453263 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed488b4-a2ed-412f-ac22-a4d0c5f91017 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:37.460393 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed488b4-a2ed-412f-ac22-a4d0c5f91017 service nova] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:37.493424 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 857/1727] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:33:37 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 11:33:37.526849 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48525458-10df-4ad0-90ed-5161d3588b6a None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:37.536852 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38190bd-c300-4d83-8b22-fbc2f39165c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '282ec32864d046b2bea170f6a3845cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:37.538287 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38190bd-c300-4d83-8b22-fbc2f39165c2 service nova] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:37.538983 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38190bd-c300-4d83-8b22-fbc2f39165c2 service nova] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:37.539597 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38190bd-c300-4d83-8b22-fbc2f39165c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:37.556002 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38190bd-c300-4d83-8b22-fbc2f39165c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:37.560910 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38190bd-c300-4d83-8b22-fbc2f39165c2 service nova] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:37.565159 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed488b4-a2ed-412f-ac22-a4d0c5f91017 service nova] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:37.566754 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-4ed488b4-a2ed-412f-ac22-a4d0c5f91017 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:37.610299 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 871/1728] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:33:37 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 11:33:37.688336 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:37.781878 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed488b4-a2ed-412f-ac22-a4d0c5f91017 service nova] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:37.792844 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fa1f1f-8f6e-419b-9c3e-1e931a809abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:37.793666 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fa1f1f-8f6e-419b-9c3e-1e931a809abb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:37.793959 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fa1f1f-8f6e-419b-9c3e-1e931a809abb admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:37.794222 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fa1f1f-8f6e-419b-9c3e-1e931a809abb admin admin] PATH_INFO: `/v3/projects/a2565f3708484592a910dbe078c69765` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:37.795680 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fa1f1f-8f6e-419b-9c3e-1e931a809abb admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2565f3708484592a910dbe078c69765)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:37.797693 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fa1f1f-8f6e-419b-9c3e-1e931a809abb admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:37.837848 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38190bd-c300-4d83-8b22-fbc2f39165c2 service nova] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:37.841282 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-b38190bd-c300-4d83-8b22-fbc2f39165c2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:37.867121 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38190bd-c300-4d83-8b22-fbc2f39165c2 service nova] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:37.886659 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9cb95b-11de-4021-a127-1b9d410c1e18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:37.887653 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9cb95b-11de-4021-a127-1b9d410c1e18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:37.888154 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9cb95b-11de-4021-a127-1b9d410c1e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:37.888644 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9cb95b-11de-4021-a127-1b9d410c1e18 admin admin] PATH_INFO: `/v3/projects/09a1daa819d94efd9004eace3c81e814` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:37.890091 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9cb95b-11de-4021-a127-1b9d410c1e18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=09a1daa819d94efd9004eace3c81e814)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:37.892564 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9cb95b-11de-4021-a127-1b9d410c1e18 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:37.927590 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-90fa1f1f-8f6e-419b-9c3e-1e931a809abb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2565f3708484592a910dbe078c69765', 'request_id': 'req-90fa1f1f-8f6e-419b-9c3e-1e931a809abb'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:33:37.938648 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-90fa1f1f-8f6e-419b-9c3e-1e931a809abb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2565f3708484592a910dbe078c69765', 'request_id': 'req-90fa1f1f-8f6e-419b-9c3e-1e931a809abb'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:33:37.948593 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-90fa1f1f-8f6e-419b-9c3e-1e931a809abb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2565f3708484592a910dbe078c69765', 'request_id': 'req-90fa1f1f-8f6e-419b-9c3e-1e931a809abb'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:33:37.974838 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-90fa1f1f-8f6e-419b-9c3e-1e931a809abb admin admin] The token cache is being invalidate because project a2565f3708484592a910dbe078c69765 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81501) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:33:37.975816 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-90fa1f1f-8f6e-419b-9c3e-1e931a809abb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:33:37.977135 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-90fa1f1f-8f6e-419b-9c3e-1e931a809abb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:33:37.980025 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 858/1729] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 11:33:37 2022] DELETE /identity/v3/projects/a2565f3708484592a910dbe078c69765 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 11:33:37.985840 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9760cc0e-0fa5-4e16-b0a4-23af860f5c52 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:37.988609 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9760cc0e-0fa5-4e16-b0a4-23af860f5c52 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:37.989237 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9760cc0e-0fa5-4e16-b0a4-23af860f5c52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:37.990237 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-ff9cb95b-11de-4021-a127-1b9d410c1e18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09a1daa819d94efd9004eace3c81e814', 'request_id': 'req-ff9cb95b-11de-4021-a127-1b9d410c1e18'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:33:38.003557 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-ff9cb95b-11de-4021-a127-1b9d410c1e18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09a1daa819d94efd9004eace3c81e814', 'request_id': 'req-ff9cb95b-11de-4021-a127-1b9d410c1e18'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:33:38.016758 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-9760cc0e-0fa5-4e16-b0a4-23af860f5c52 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:33:38.019381 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-9760cc0e-0fa5-4e16-b0a4-23af860f5c52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:38.020077 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-ff9cb95b-11de-4021-a127-1b9d410c1e18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09a1daa819d94efd9004eace3c81e814', 'request_id': 'req-ff9cb95b-11de-4021-a127-1b9d410c1e18'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:33:38.055244 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-ff9cb95b-11de-4021-a127-1b9d410c1e18 admin admin] The token cache is being invalidate because project 09a1daa819d94efd9004eace3c81e814 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:33:38.055761 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-ff9cb95b-11de-4021-a127-1b9d410c1e18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:33:38.057396 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-ff9cb95b-11de-4021-a127-1b9d410c1e18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:33:38.063872 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 872/1730] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 11:33:37 2022] DELETE /identity/v3/projects/09a1daa819d94efd9004eace3c81e814 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:33:38.070690 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ed5555-0e60-46a9-938b-d19a86cc60b3 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:38.071203 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ed5555-0e60-46a9-938b-d19a86cc60b3 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:38.071677 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ed5555-0e60-46a9-938b-d19a86cc60b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:38.140876 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-68ed5555-0e60-46a9-938b-d19a86cc60b3 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:33:38.144133 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-68ed5555-0e60-46a9-938b-d19a86cc60b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:38.205782 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 859/1731] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:33:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:33:38.222290 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2a66c2-e464-45ac-81a4-a87387fba879 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:38.222858 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2a66c2-e464-45ac-81a4-a87387fba879 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:38.223276 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2a66c2-e464-45ac-81a4-a87387fba879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:38.271045 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-2b2a66c2-e464-45ac-81a4-a87387fba879 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:33:38.280893 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-2b2a66c2-e464-45ac-81a4-a87387fba879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:38.297405 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 873/1732] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:33:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 11:33:38.305737 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6183dad4-5a90-4f8a-9b4b-4e2bdce47dde None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:38.306213 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 860/1733] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:33:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:33:38.306483 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6183dad4-5a90-4f8a-9b4b-4e2bdce47dde None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:38.306861 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6183dad4-5a90-4f8a-9b4b-4e2bdce47dde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:38.310925 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2a66c2-e464-45ac-81a4-a87387fba879 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:38.347170 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2a66c2-e464-45ac-81a4-a87387fba879 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:38.348555 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-6183dad4-5a90-4f8a-9b4b-4e2bdce47dde None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:33:38.358963 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-6183dad4-5a90-4f8a-9b4b-4e2bdce47dde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:38.378086 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66245de1-fde1-449b-921d-79dab674bcba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:38.382573 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 874/1734] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:33:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:33:38.385189 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66245de1-fde1-449b-921d-79dab674bcba admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:38.385629 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66245de1-fde1-449b-921d-79dab674bcba admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:38.386673 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6183dad4-5a90-4f8a-9b4b-4e2bdce47dde None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:38.387115 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66245de1-fde1-449b-921d-79dab674bcba admin admin] PATH_INFO: `/v3/domains` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:38.387952 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66245de1-fde1-449b-921d-79dab674bcba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:38.388614 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66245de1-fde1-449b-921d-79dab674bcba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:38.390677 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66245de1-fde1-449b-921d-79dab674bcba admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:38.404650 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6183dad4-5a90-4f8a-9b4b-4e2bdce47dde None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:38.416276 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc119185-2fb9-477b-8231-aac078f60817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:38.417095 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc119185-2fb9-477b-8231-aac078f60817 admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:38.417484 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc119185-2fb9-477b-8231-aac078f60817 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:38.417863 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc119185-2fb9-477b-8231-aac078f60817 admin admin] PATH_INFO: `/v3/domains` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:38.418673 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc119185-2fb9-477b-8231-aac078f60817 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:38.422713 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc119185-2fb9-477b-8231-aac078f60817 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:38.430936 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc119185-2fb9-477b-8231-aac078f60817 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:38.442602 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 861/1735] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 24 11:33:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:33:38.445365 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66245de1-fde1-449b-921d-79dab674bcba admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:38.469176 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 875/1736] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 24 11:33:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:33:38.470382 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc119185-2fb9-477b-8231-aac078f60817 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:38.470515 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66245de1-fde1-449b-921d-79dab674bcba admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:38.494515 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba50061-aca6-4ed9-8aef-52f9c98e615f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:38.495918 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc119185-2fb9-477b-8231-aac078f60817 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:38.496129 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba50061-aca6-4ed9-8aef-52f9c98e615f admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:38.496586 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba50061-aca6-4ed9-8aef-52f9c98e615f admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:38.497221 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba50061-aca6-4ed9-8aef-52f9c98e615f admin admin] PATH_INFO: `/v3/projects` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:38.498058 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba50061-aca6-4ed9-8aef-52f9c98e615f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:38.500414 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba50061-aca6-4ed9-8aef-52f9c98e615f admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:38.509850 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a97d058-eec4-4f23-9ac3-c348bd750703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:38.512786 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a97d058-eec4-4f23-9ac3-c348bd750703 admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:38.513314 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a97d058-eec4-4f23-9ac3-c348bd750703 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:38.514662 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a97d058-eec4-4f23-9ac3-c348bd750703 admin admin] PATH_INFO: `/v3/projects` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:38.516126 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a97d058-eec4-4f23-9ac3-c348bd750703 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:38.519488 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a97d058-eec4-4f23-9ac3-c348bd750703 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:38.551317 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:38.556317 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 862/1737] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 11:33:38 2022] POST /identity/v3/projects => generated 355 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:33:38.563120 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba50061-aca6-4ed9-8aef-52f9c98e615f admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:38.587945 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 876/1738] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 11:33:38 2022] POST /identity/v3/projects => generated 375 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:33:38.588986 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a97d058-eec4-4f23-9ac3-c348bd750703 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:38.655648 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:38.734109 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a97d058-eec4-4f23-9ac3-c348bd750703 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:38.746428 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e5251a-8ba8-41c2-91e2-89810eae33e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:38.747197 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e5251a-8ba8-41c2-91e2-89810eae33e1 admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:38.747860 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e5251a-8ba8-41c2-91e2-89810eae33e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:38.748155 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e5251a-8ba8-41c2-91e2-89810eae33e1 admin admin] PATH_INFO: `/v3/users` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:38.748933 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e5251a-8ba8-41c2-91e2-89810eae33e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:38.755184 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba50061-aca6-4ed9-8aef-52f9c98e615f admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:38.757174 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e5251a-8ba8-41c2-91e2-89810eae33e1 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:38.767128 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7a54f0-f845-40fb-8050-3fe0e109a617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:38.769128 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7a54f0-f845-40fb-8050-3fe0e109a617 admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:38.769501 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7a54f0-f845-40fb-8050-3fe0e109a617 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:38.770047 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7a54f0-f845-40fb-8050-3fe0e109a617 admin admin] PATH_INFO: `/v3/users` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:38.771266 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7a54f0-f845-40fb-8050-3fe0e109a617 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:38.776352 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7a54f0-f845-40fb-8050-3fe0e109a617 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:38.813182 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 877/1739] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 11:33:38 2022] POST /identity/v3/users => generated 288 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:33:38.813182 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e5251a-8ba8-41c2-91e2-89810eae33e1 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:38.814221 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-a9e5251a-8ba8-41c2-91e2-89810eae33e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:38.831391 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 863/1740] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 11:33:38 2022] POST /identity/v3/users => generated 278 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:33:38.831391 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7a54f0-f845-40fb-8050-3fe0e109a617 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:38.839204 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e5251a-8ba8-41c2-91e2-89810eae33e1 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:38.850611 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7a54f0-f845-40fb-8050-3fe0e109a617 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:38.851104 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339de9c6-504f-4776-9380-bee022e92c3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:38.851787 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339de9c6-504f-4776-9380-bee022e92c3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:38.852091 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339de9c6-504f-4776-9380-bee022e92c3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:38.852364 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339de9c6-504f-4776-9380-bee022e92c3f admin admin] PATH_INFO: `/v3/users/01dc93d2ae854521b433e46b71a37974` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:38.856313 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339de9c6-504f-4776-9380-bee022e92c3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=01dc93d2ae854521b433e46b71a37974)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:38.858416 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339de9c6-504f-4776-9380-bee022e92c3f admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:38.872334 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59144fe-fd18-4457-9ee9-b8b7bd0a46b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:38.873211 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59144fe-fd18-4457-9ee9-b8b7bd0a46b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:38.873599 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59144fe-fd18-4457-9ee9-b8b7bd0a46b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:38.873974 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59144fe-fd18-4457-9ee9-b8b7bd0a46b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:38.874807 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59144fe-fd18-4457-9ee9-b8b7bd0a46b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:38.876601 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59144fe-fd18-4457-9ee9-b8b7bd0a46b3 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:38.897613 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 864/1741] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:33:38 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:33:38.898206 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59144fe-fd18-4457-9ee9-b8b7bd0a46b3 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:38.923652 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59144fe-fd18-4457-9ee9-b8b7bd0a46b3 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:38.935245 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc81206-a100-4fef-84ee-17506c39d9a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:38.936693 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc81206-a100-4fef-84ee-17506c39d9a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:38.937364 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc81206-a100-4fef-84ee-17506c39d9a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:38.937781 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc81206-a100-4fef-84ee-17506c39d9a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:38.940591 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc81206-a100-4fef-84ee-17506c39d9a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:38.944839 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc81206-a100-4fef-84ee-17506c39d9a0 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:38.962811 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-339de9c6-504f-4776-9380-bee022e92c3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01dc93d2ae854521b433e46b71a37974'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:33:38.963715 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-339de9c6-504f-4776-9380-bee022e92c3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01dc93d2ae854521b433e46b71a37974'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:33:38.977798 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-339de9c6-504f-4776-9380-bee022e92c3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01dc93d2ae854521b433e46b71a37974'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:33:38.985019 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 865/1742] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:33:38 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:33:38.988233 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc81206-a100-4fef-84ee-17506c39d9a0 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:38.991037 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-339de9c6-504f-4776-9380-bee022e92c3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01dc93d2ae854521b433e46b71a37974'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:33:38.992446 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-4cc81206-a100-4fef-84ee-17506c39d9a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:38.992931 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-339de9c6-504f-4776-9380-bee022e92c3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01dc93d2ae854521b433e46b71a37974'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:33:39.026792 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc81206-a100-4fef-84ee-17506c39d9a0 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:39.037953 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 878/1743] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 11:33:38 2022] DELETE /identity/v3/users/01dc93d2ae854521b433e46b71a37974 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:33:39.039003 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339de9c6-504f-4776-9380-bee022e92c3f admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:39.039735 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f336c0b-f2c2-4c79-9e8e-5f2461f0edde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:39.041806 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f336c0b-f2c2-4c79-9e8e-5f2461f0edde admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:39.043139 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f336c0b-f2c2-4c79-9e8e-5f2461f0edde admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:39.043468 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f336c0b-f2c2-4c79-9e8e-5f2461f0edde admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:39.045720 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-339de9c6-504f-4776-9380-bee022e92c3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:39.045815 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f336c0b-f2c2-4c79-9e8e-5f2461f0edde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:39.050170 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f336c0b-f2c2-4c79-9e8e-5f2461f0edde admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:39.085185 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 866/1744] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:33:38 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:33:39.088978 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a77c23-a586-4d91-9b7a-93f1ce13cdbd None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:39.090501 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a77c23-a586-4d91-9b7a-93f1ce13cdbd None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:39.090873 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a77c23-a586-4d91-9b7a-93f1ce13cdbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:39.153080 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-f0a77c23-a586-4d91-9b7a-93f1ce13cdbd None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:33:39.154916 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-f0a77c23-a586-4d91-9b7a-93f1ce13cdbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:39.176056 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:39.205416 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339de9c6-504f-4776-9380-bee022e92c3f admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:39.216179 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82510e53-a880-4e5d-bd91-75d1158e913d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:39.217165 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82510e53-a880-4e5d-bd91-75d1158e913d admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:39.217708 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82510e53-a880-4e5d-bd91-75d1158e913d admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:39.218237 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82510e53-a880-4e5d-bd91-75d1158e913d admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:39.219118 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82510e53-a880-4e5d-bd91-75d1158e913d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:39.220959 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82510e53-a880-4e5d-bd91-75d1158e913d admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:39.246314 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 879/1745] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:33:39 2022] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:33:39.250441 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486172da-190c-48b4-94fe-110249237706 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:39.250884 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486172da-190c-48b4-94fe-110249237706 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:39.252252 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486172da-190c-48b4-94fe-110249237706 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:39.305743 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-486172da-190c-48b4-94fe-110249237706 None None] MFA Rules not processed for user `6b08455fa85c4b60af58e9f213a00a4d`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:33:39.307399 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-486172da-190c-48b4-94fe-110249237706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:39.361899 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 867/1746] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:33:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:33:39.364799 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a77c23-a586-4d91-9b7a-93f1ce13cdbd None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:39.385462 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a77c23-a586-4d91-9b7a-93f1ce13cdbd None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:39.397255 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f95b17-6acd-4822-8fc6-d5d18da7babc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:39.399675 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f95b17-6acd-4822-8fc6-d5d18da7babc admin admin] REQUEST_METHOD: `PUT` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:39.401186 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f95b17-6acd-4822-8fc6-d5d18da7babc admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:39.402124 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f95b17-6acd-4822-8fc6-d5d18da7babc admin admin] PATH_INFO: `/v3/projects/82eba1107f964639b656be3d52e9c216/users/978361e6dbbb40cb81416441dd732e31/roles/27e3e65e24df4b86b0d3d18d3212101d` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:39.437829 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f95b17-6acd-4822-8fc6-d5d18da7babc admin admin] RBAC: Authorizing `identity:create_grant(project_id=82eba1107f964639b656be3d52e9c216, user_id=978361e6dbbb40cb81416441dd732e31, role_id=27e3e65e24df4b86b0d3d18d3212101d)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:39.441292 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f95b17-6acd-4822-8fc6-d5d18da7babc admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:39.453172 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 880/1747] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:33:39 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:33:39.454265 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486172da-190c-48b4-94fe-110249237706 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:39.474803 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 868/1748] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 11:33:39 2022] PUT /identity/v3/projects/82eba1107f964639b656be3d52e9c216/users/978361e6dbbb40cb81416441dd732e31/roles/27e3e65e24df4b86b0d3d18d3212101d => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:33:39.476080 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f95b17-6acd-4822-8fc6-d5d18da7babc admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:39.479350 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486172da-190c-48b4-94fe-110249237706 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:39.481810 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-c6f95b17-6acd-4822-8fc6-d5d18da7babc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:39.610299 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:39.616236 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f95b17-6acd-4822-8fc6-d5d18da7babc admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:39.622171 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7961f85e-a2a5-4363-b69f-8b23ef9625ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:39.623192 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7961f85e-a2a5-4363-b69f-8b23ef9625ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:39.623954 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7961f85e-a2a5-4363-b69f-8b23ef9625ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:39.624567 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7961f85e-a2a5-4363-b69f-8b23ef9625ee admin admin] PATH_INFO: `/v3/users/c66b4ea230ae458db8636ab8b41d185e` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:39.626081 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7961f85e-a2a5-4363-b69f-8b23ef9625ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=c66b4ea230ae458db8636ab8b41d185e)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:39.629675 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7961f85e-a2a5-4363-b69f-8b23ef9625ee admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:39.646800 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea82807f-8fdf-47ad-a8e8-f07b40962faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:39.649793 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea82807f-8fdf-47ad-a8e8-f07b40962faa admin admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:39.650074 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea82807f-8fdf-47ad-a8e8-f07b40962faa admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:39.650341 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea82807f-8fdf-47ad-a8e8-f07b40962faa admin admin] PATH_INFO: `/v3/projects/a48e3eafe65d42e29331f8170cc7b133/users/db180cf75f684ff78ca1c7cecdf595ab/roles/27e3e65e24df4b86b0d3d18d3212101d` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:39.720396 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea82807f-8fdf-47ad-a8e8-f07b40962faa admin admin] RBAC: Authorizing `identity:create_grant(project_id=a48e3eafe65d42e29331f8170cc7b133, user_id=db180cf75f684ff78ca1c7cecdf595ab, role_id=27e3e65e24df4b86b0d3d18d3212101d)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:39.728589 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-7961f85e-a2a5-4363-b69f-8b23ef9625ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c66b4ea230ae458db8636ab8b41d185e'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:33:39.729516 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-7961f85e-a2a5-4363-b69f-8b23ef9625ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c66b4ea230ae458db8636ab8b41d185e'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:33:39.731614 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea82807f-8fdf-47ad-a8e8-f07b40962faa admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:39.734709 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-7961f85e-a2a5-4363-b69f-8b23ef9625ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c66b4ea230ae458db8636ab8b41d185e'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:33:39.745900 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-7961f85e-a2a5-4363-b69f-8b23ef9625ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c66b4ea230ae458db8636ab8b41d185e'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:33:39.756708 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-7961f85e-a2a5-4363-b69f-8b23ef9625ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c66b4ea230ae458db8636ab8b41d185e'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:33:39.770724 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 881/1749] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 11:33:39 2022] PUT /identity/v3/projects/a48e3eafe65d42e29331f8170cc7b133/users/db180cf75f684ff78ca1c7cecdf595ab/roles/27e3e65e24df4b86b0d3d18d3212101d => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:33:39.771693 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea82807f-8fdf-47ad-a8e8-f07b40962faa admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:39.779629 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-ea82807f-8fdf-47ad-a8e8-f07b40962faa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:39.797368 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 869/1750] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 11:33:39 2022] DELETE /identity/v3/users/c66b4ea230ae458db8636ab8b41d185e => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:33:39.803363 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220e6037-9351-4c0a-9a80-71273a2ca0ab None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:39.803970 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220e6037-9351-4c0a-9a80-71273a2ca0ab None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:39.804469 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220e6037-9351-4c0a-9a80-71273a2ca0ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:39.849561 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-220e6037-9351-4c0a-9a80-71273a2ca0ab None None] MFA Rules not processed for user `978361e6dbbb40cb81416441dd732e31`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:33:39.851107 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-220e6037-9351-4c0a-9a80-71273a2ca0ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:39.934489 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea82807f-8fdf-47ad-a8e8-f07b40962faa admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:39.940146 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 870/1751] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:33:39 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:33:39.942509 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a5ba38-b0bd-44ac-92a5-1c5f516b975f None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:39.942920 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a5ba38-b0bd-44ac-92a5-1c5f516b975f None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:39.943301 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a5ba38-b0bd-44ac-92a5-1c5f516b975f None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:39.946823 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 871/1752] 10.222.0.27 () {54 vars in 912 bytes} [Wed Aug 24 11:33:39 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:33:39.948814 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4002b083-465f-4c74-bd3b-7c7c46fcd7be None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:39.949208 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4002b083-465f-4c74-bd3b-7c7c46fcd7be None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:39.949584 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4002b083-465f-4c74-bd3b-7c7c46fcd7be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:40.000454 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-4002b083-465f-4c74-bd3b-7c7c46fcd7be None None] MFA Rules not processed for user `db180cf75f684ff78ca1c7cecdf595ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:33:40.002018 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-4002b083-465f-4c74-bd3b-7c7c46fcd7be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:40.009329 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:40.052151 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc6e174-38bd-41b0-89aa-8ac476788b49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2d061d25d83443c9232218c90792d51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:40.052785 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc6e174-38bd-41b0-89aa-8ac476788b49 service neutron] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:40.053058 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc6e174-38bd-41b0-89aa-8ac476788b49 service neutron] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:40.053320 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc6e174-38bd-41b0-89aa-8ac476788b49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:40.056155 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-efc6e174-38bd-41b0-89aa-8ac476788b49 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:40.112944 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:40.139987 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 872/1753] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:33:39 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:33:40.147114 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e13e2b-b815-4e7c-b1db-c590659b3e1a None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:40.147447 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e13e2b-b815-4e7c-b1db-c590659b3e1a None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:40.147661 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e13e2b-b815-4e7c-b1db-c590659b3e1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:40.172885 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc6e174-38bd-41b0-89aa-8ac476788b49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:40.176692 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc6e174-38bd-41b0-89aa-8ac476788b49 service neutron] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:40.183645 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-d0e13e2b-b815-4e7c-b1db-c590659b3e1a None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:33:40.187612 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-d0e13e2b-b815-4e7c-b1db-c590659b3e1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:40.195785 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 882/1754] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:33:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:33:40.198275 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086f6029-16ce-44cc-b0b9-cf3545a46891 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:40.199441 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086f6029-16ce-44cc-b0b9-cf3545a46891 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:40.200118 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086f6029-16ce-44cc-b0b9-cf3545a46891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:40.211946 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 873/1755] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:33:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:33:40.212848 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e13e2b-b815-4e7c-b1db-c590659b3e1a None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:40.216676 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-d0e13e2b-b815-4e7c-b1db-c590659b3e1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:40.244572 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e13e2b-b815-4e7c-b1db-c590659b3e1a None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:40.260750 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e12c8d8-430c-4aec-bf42-6fafcccee1be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:40.261963 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e12c8d8-430c-4aec-bf42-6fafcccee1be admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:40.262812 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e12c8d8-430c-4aec-bf42-6fafcccee1be admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:40.263311 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e12c8d8-430c-4aec-bf42-6fafcccee1be admin admin] PATH_INFO: `/v3/projects` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:40.264161 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e12c8d8-430c-4aec-bf42-6fafcccee1be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:40.264545 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-086f6029-16ce-44cc-b0b9-cf3545a46891 None None] MFA Rules not processed for user `5bfd72d5fe714437be00c7c5533115b4`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:33:40.269146 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-086f6029-16ce-44cc-b0b9-cf3545a46891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:40.272062 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e12c8d8-430c-4aec-bf42-6fafcccee1be admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:40.344308 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 874/1756] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 11:33:40 2022] POST /identity/v3/projects => generated 379 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:33:40.345192 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f30ee70-0b9b-4b2f-b3e5-4b32d776e04c None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:40.345618 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f30ee70-0b9b-4b2f-b3e5-4b32d776e04c None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:40.345993 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f30ee70-0b9b-4b2f-b3e5-4b32d776e04c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:40.433156 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 883/1757] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:33:40 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:33:40.434395 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086f6029-16ce-44cc-b0b9-cf3545a46891 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:40.440500 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-086f6029-16ce-44cc-b0b9-cf3545a46891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:40.448758 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-9f30ee70-0b9b-4b2f-b3e5-4b32d776e04c None None] MFA Rules not processed for user `e2d061d25d83443c9232218c90792d51`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:33:40.451218 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-9f30ee70-0b9b-4b2f-b3e5-4b32d776e04c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:40.471563 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086f6029-16ce-44cc-b0b9-cf3545a46891 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:40.597682 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 875/1758] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Aug 24 11:33:40 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:33:40.601247 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f30ee70-0b9b-4b2f-b3e5-4b32d776e04c None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:40.610929 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaaa69b-cacb-47b5-94d5-1aa6fd482286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:40.612535 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaaa69b-cacb-47b5-94d5-1aa6fd482286 admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:40.613057 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaaa69b-cacb-47b5-94d5-1aa6fd482286 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:40.613264 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaaa69b-cacb-47b5-94d5-1aa6fd482286 admin admin] PATH_INFO: `/v3/projects` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:40.618981 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaaa69b-cacb-47b5-94d5-1aa6fd482286 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:40.621222 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaaa69b-cacb-47b5-94d5-1aa6fd482286 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:40.651059 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f30ee70-0b9b-4b2f-b3e5-4b32d776e04c None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:40.678662 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:40.680926 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f11860a-47fc-45c0-812a-c33c25e4ba64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2d061d25d83443c9232218c90792d51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:40.684149 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f11860a-47fc-45c0-812a-c33c25e4ba64 service neutron] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:40.690984 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f11860a-47fc-45c0-812a-c33c25e4ba64 service neutron] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:40.691970 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 884/1759] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 11:33:40 2022] POST /identity/v3/projects => generated 355 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:33:40.692885 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaaa69b-cacb-47b5-94d5-1aa6fd482286 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:40.699023 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f11860a-47fc-45c0-812a-c33c25e4ba64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:40.720351 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f11860a-47fc-45c0-812a-c33c25e4ba64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:40.724054 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f11860a-47fc-45c0-812a-c33c25e4ba64 service neutron] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:40.780812 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 876/1760] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:33:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:33:40.783411 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186abdb0-da5b-46a4-a639-7316d1bcdea0 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:40.783905 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186abdb0-da5b-46a4-a639-7316d1bcdea0 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:40.788724 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186abdb0-da5b-46a4-a639-7316d1bcdea0 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:40.797655 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 877/1761] 10.222.0.27 () {54 vars in 912 bytes} [Wed Aug 24 11:33:40 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:33:40.799776 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3576d3a0-f34a-4b4c-bc51-7d69d46109c1 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:40.801969 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3576d3a0-f34a-4b4c-bc51-7d69d46109c1 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:40.803149 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3576d3a0-f34a-4b4c-bc51-7d69d46109c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:40.841101 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaaa69b-cacb-47b5-94d5-1aa6fd482286 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:40.855201 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f283c690-ae4b-4d23-b27b-f92ee370a614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:40.855849 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f283c690-ae4b-4d23-b27b-f92ee370a614 admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:40.856121 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f283c690-ae4b-4d23-b27b-f92ee370a614 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:40.856387 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f283c690-ae4b-4d23-b27b-f92ee370a614 admin admin] PATH_INFO: `/v3/users` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:40.857040 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f283c690-ae4b-4d23-b27b-f92ee370a614 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:40.860679 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-3576d3a0-f34a-4b4c-bc51-7d69d46109c1 None None] MFA Rules not processed for user `5bfd72d5fe714437be00c7c5533115b4`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:33:40.861849 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f283c690-ae4b-4d23-b27b-f92ee370a614 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:40.862743 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-3576d3a0-f34a-4b4c-bc51-7d69d46109c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:40.913796 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 885/1762] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 11:33:40 2022] POST /identity/v3/users => generated 296 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:33:40.914743 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f283c690-ae4b-4d23-b27b-f92ee370a614 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:40.920752 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-f283c690-ae4b-4d23-b27b-f92ee370a614 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:41.010153 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 878/1763] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:33:40 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:33:41.011964 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3576d3a0-f34a-4b4c-bc51-7d69d46109c1 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:41.045478 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3576d3a0-f34a-4b4c-bc51-7d69d46109c1 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:41.060105 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1669b6-9309-4c09-b79f-4f4771187607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:41.061652 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1669b6-9309-4c09-b79f-4f4771187607 admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:41.062029 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1669b6-9309-4c09-b79f-4f4771187607 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:41.062945 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1669b6-9309-4c09-b79f-4f4771187607 admin admin] PATH_INFO: `/v3/users` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:41.063869 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1669b6-9309-4c09-b79f-4f4771187607 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:41.068173 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1669b6-9309-4c09-b79f-4f4771187607 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:41.086623 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f283c690-ae4b-4d23-b27b-f92ee370a614 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:41.095610 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4575f2-cbc9-4364-abae-442bf2fa0711 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2d061d25d83443c9232218c90792d51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:41.096257 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4575f2-cbc9-4364-abae-442bf2fa0711 service neutron] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:41.096675 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4575f2-cbc9-4364-abae-442bf2fa0711 service neutron] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:41.096987 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4575f2-cbc9-4364-abae-442bf2fa0711 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:41.124037 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4575f2-cbc9-4364-abae-442bf2fa0711 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:41.126345 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4575f2-cbc9-4364-abae-442bf2fa0711 service neutron] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:41.137606 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 879/1764] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 11:33:41 2022] POST /identity/v3/users => generated 284 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:33:41.139148 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04a8d76-d82e-4a6e-9e43-647115ba07be None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:41.139431 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04a8d76-d82e-4a6e-9e43-647115ba07be None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:41.139700 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04a8d76-d82e-4a6e-9e43-647115ba07be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:41.153030 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 886/1765] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:33:40 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:33:41.155418 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4575f2-cbc9-4364-abae-442bf2fa0711 service neutron] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:41.162001 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-6b4575f2-cbc9-4364-abae-442bf2fa0711 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:41.191592 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-e04a8d76-d82e-4a6e-9e43-647115ba07be None None] MFA Rules not processed for user `e2d061d25d83443c9232218c90792d51`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:33:41.192868 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-e04a8d76-d82e-4a6e-9e43-647115ba07be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:41.204217 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4575f2-cbc9-4364-abae-442bf2fa0711 service neutron] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:41.216306 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 880/1766] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Aug 24 11:33:41 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:33:41.217196 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04a8d76-d82e-4a6e-9e43-647115ba07be None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:41.217619 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55935adb-df61-4675-b00d-6b57e66b6194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:41.219581 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55935adb-df61-4675-b00d-6b57e66b6194 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:41.220108 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55935adb-df61-4675-b00d-6b57e66b6194 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:41.222393 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55935adb-df61-4675-b00d-6b57e66b6194 admin admin] PATH_INFO: `/v3/projects/26be5280d9cb47668315783bb3921387` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:41.225829 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55935adb-df61-4675-b00d-6b57e66b6194 admin admin] RBAC: Authorizing `identity:delete_project(project_id=26be5280d9cb47668315783bb3921387)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:41.247307 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04a8d76-d82e-4a6e-9e43-647115ba07be None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:41.259252 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55935adb-df61-4675-b00d-6b57e66b6194 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:41.261741 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f4de18-744e-4c1b-a47b-d0ae8560436a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:41.262407 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f4de18-744e-4c1b-a47b-d0ae8560436a admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:41.263485 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f4de18-744e-4c1b-a47b-d0ae8560436a admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:41.263774 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f4de18-744e-4c1b-a47b-d0ae8560436a admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:41.264422 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f4de18-744e-4c1b-a47b-d0ae8560436a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:41.266072 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f4de18-744e-4c1b-a47b-d0ae8560436a admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:41.293574 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 881/1767] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:33:41 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:33:41.294323 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f4de18-744e-4c1b-a47b-d0ae8560436a admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:41.328156 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f4de18-744e-4c1b-a47b-d0ae8560436a admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:41.338329 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d391d7ad-16e0-4e8f-ae47-f576dc67bb33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:41.339104 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d391d7ad-16e0-4e8f-ae47-f576dc67bb33 admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:41.339382 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d391d7ad-16e0-4e8f-ae47-f576dc67bb33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:41.339683 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d391d7ad-16e0-4e8f-ae47-f576dc67bb33 admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:41.340417 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d391d7ad-16e0-4e8f-ae47-f576dc67bb33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:41.346256 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d391d7ad-16e0-4e8f-ae47-f576dc67bb33 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:41.373478 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-55935adb-df61-4675-b00d-6b57e66b6194 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26be5280d9cb47668315783bb3921387', 'request_id': 'req-55935adb-df61-4675-b00d-6b57e66b6194'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:33:41.380503 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 882/1768] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:33:41 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:33:41.381743 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d391d7ad-16e0-4e8f-ae47-f576dc67bb33 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:41.383970 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-55935adb-df61-4675-b00d-6b57e66b6194 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26be5280d9cb47668315783bb3921387', 'request_id': 'req-55935adb-df61-4675-b00d-6b57e66b6194'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:33:41.402761 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-55935adb-df61-4675-b00d-6b57e66b6194 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26be5280d9cb47668315783bb3921387', 'request_id': 'req-55935adb-df61-4675-b00d-6b57e66b6194'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:33:41.422416 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d391d7ad-16e0-4e8f-ae47-f576dc67bb33 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:41.432207 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:41.437871 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-55935adb-df61-4675-b00d-6b57e66b6194 admin admin] The token cache is being invalidate because project 26be5280d9cb47668315783bb3921387 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:33:41.438156 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-55935adb-df61-4675-b00d-6b57e66b6194 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:33:41.438803 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-55935adb-df61-4675-b00d-6b57e66b6194 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:33:41.443970 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 887/1769] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 11:33:41 2022] DELETE /identity/v3/projects/26be5280d9cb47668315783bb3921387 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:33:41.444958 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55935adb-df61-4675-b00d-6b57e66b6194 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:41.451634 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-55935adb-df61-4675-b00d-6b57e66b6194 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:41.504136 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:41.562844 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1628d6-da67-4c98-b745-f59273d7dc05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:41.564075 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1628d6-da67-4c98-b745-f59273d7dc05 admin admin] REQUEST_METHOD: `PUT` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:41.564533 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1628d6-da67-4c98-b745-f59273d7dc05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:41.564975 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1628d6-da67-4c98-b745-f59273d7dc05 admin admin] PATH_INFO: `/v3/projects/00b1f14e2fb745868f640058649dd427/users/6379980eb1e84a36959d73ecd1b2f09f/roles/30bb1e97257f4ca5b90c88545777317b` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:41.618314 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1628d6-da67-4c98-b745-f59273d7dc05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00b1f14e2fb745868f640058649dd427, user_id=6379980eb1e84a36959d73ecd1b2f09f, role_id=30bb1e97257f4ca5b90c88545777317b)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:41.623107 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1628d6-da67-4c98-b745-f59273d7dc05 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:41.628318 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55935adb-df61-4675-b00d-6b57e66b6194 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:41.637140 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ac350e-50c9-4419-adf6-aca65d8b19ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2d061d25d83443c9232218c90792d51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:41.638033 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ac350e-50c9-4419-adf6-aca65d8b19ec service neutron] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:41.638853 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ac350e-50c9-4419-adf6-aca65d8b19ec service neutron] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:41.638853 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ac350e-50c9-4419-adf6-aca65d8b19ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:41.644288 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-40ac350e-50c9-4419-adf6-aca65d8b19ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:41.651595 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 883/1770] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 11:33:41 2022] PUT /identity/v3/projects/00b1f14e2fb745868f640058649dd427/users/6379980eb1e84a36959d73ecd1b2f09f/roles/30bb1e97257f4ca5b90c88545777317b => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:33:41.652941 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1628d6-da67-4c98-b745-f59273d7dc05 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:41.659380 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-1f1628d6-da67-4c98-b745-f59273d7dc05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:41.669349 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ac350e-50c9-4419-adf6-aca65d8b19ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:41.670872 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ac350e-50c9-4419-adf6-aca65d8b19ec service neutron] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:41.696469 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 888/1771] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:33:41 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:33:41.697768 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ac350e-50c9-4419-adf6-aca65d8b19ec service neutron] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:41.701852 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-40ac350e-50c9-4419-adf6-aca65d8b19ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:41.747001 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ac350e-50c9-4419-adf6-aca65d8b19ec service neutron] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:41.862609 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1628d6-da67-4c98-b745-f59273d7dc05 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:41.873455 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed96645f-0554-41e8-bb47-9a6c7e1da7a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:41.874293 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed96645f-0554-41e8-bb47-9a6c7e1da7a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:41.874737 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed96645f-0554-41e8-bb47-9a6c7e1da7a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:41.874874 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed96645f-0554-41e8-bb47-9a6c7e1da7a7 admin admin] PATH_INFO: `/v3/projects/19c4dff6edd64961a8896e0e51fa852b/users/779d269ee26249e19c54d9b90c10a2a6/roles/30bb1e97257f4ca5b90c88545777317b` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:41.915512 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed96645f-0554-41e8-bb47-9a6c7e1da7a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19c4dff6edd64961a8896e0e51fa852b, user_id=779d269ee26249e19c54d9b90c10a2a6, role_id=30bb1e97257f4ca5b90c88545777317b)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:41.920720 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed96645f-0554-41e8-bb47-9a6c7e1da7a7 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:41.921173 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb57a89b-f5ad-453b-8abe-9821b928ded9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:41.921859 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb57a89b-f5ad-453b-8abe-9821b928ded9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:41.922131 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb57a89b-f5ad-453b-8abe-9821b928ded9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:41.922501 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb57a89b-f5ad-453b-8abe-9821b928ded9 admin admin] PATH_INFO: `/v3/users/2d0f6e47678f44008c7a03cb3946c3a9` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:41.923798 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb57a89b-f5ad-453b-8abe-9821b928ded9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d0f6e47678f44008c7a03cb3946c3a9)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:41.925987 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb57a89b-f5ad-453b-8abe-9821b928ded9 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:41.957121 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 884/1772] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 11:33:41 2022] PUT /identity/v3/projects/19c4dff6edd64961a8896e0e51fa852b/users/779d269ee26249e19c54d9b90c10a2a6/roles/30bb1e97257f4ca5b90c88545777317b => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:33:41.958001 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed96645f-0554-41e8-bb47-9a6c7e1da7a7 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:41.961672 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-ed96645f-0554-41e8-bb47-9a6c7e1da7a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:42.017883 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-bb57a89b-f5ad-453b-8abe-9821b928ded9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d0f6e47678f44008c7a03cb3946c3a9'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:33:42.018680 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-bb57a89b-f5ad-453b-8abe-9821b928ded9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d0f6e47678f44008c7a03cb3946c3a9'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:33:42.032458 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-bb57a89b-f5ad-453b-8abe-9821b928ded9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d0f6e47678f44008c7a03cb3946c3a9'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:33:42.041801 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-bb57a89b-f5ad-453b-8abe-9821b928ded9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d0f6e47678f44008c7a03cb3946c3a9'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:33:42.042612 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-bb57a89b-f5ad-453b-8abe-9821b928ded9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d0f6e47678f44008c7a03cb3946c3a9'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:33:42.065311 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 889/1773] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 11:33:41 2022] DELETE /identity/v3/users/2d0f6e47678f44008c7a03cb3946c3a9 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:33:42.065311 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb57a89b-f5ad-453b-8abe-9821b928ded9 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:42.065311 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-bb57a89b-f5ad-453b-8abe-9821b928ded9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:42.150175 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed96645f-0554-41e8-bb47-9a6c7e1da7a7 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:42.173125 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:42.219504 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb57a89b-f5ad-453b-8abe-9821b928ded9 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:42.220959 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:42.227615 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b2277b-d611-430c-b862-2c4c5d35d06c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:42.229443 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b2277b-d611-430c-b862-2c4c5d35d06c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:42.229977 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b2277b-d611-430c-b862-2c4c5d35d06c admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:42.230469 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b2277b-d611-430c-b862-2c4c5d35d06c admin admin] PATH_INFO: `/v3/projects/fea200eb709a465ebcdf92a4200b629b` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:42.232315 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b2277b-d611-430c-b862-2c4c5d35d06c admin admin] RBAC: Authorizing `identity:delete_project(project_id=fea200eb709a465ebcdf92a4200b629b)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:42.235726 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b2277b-d611-430c-b862-2c4c5d35d06c admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:42.313164 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-85b2277b-d611-430c-b862-2c4c5d35d06c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fea200eb709a465ebcdf92a4200b629b', 'request_id': 'req-85b2277b-d611-430c-b862-2c4c5d35d06c'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:33:42.325123 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-85b2277b-d611-430c-b862-2c4c5d35d06c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fea200eb709a465ebcdf92a4200b629b', 'request_id': 'req-85b2277b-d611-430c-b862-2c4c5d35d06c'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:33:42.332767 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-85b2277b-d611-430c-b862-2c4c5d35d06c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fea200eb709a465ebcdf92a4200b629b', 'request_id': 'req-85b2277b-d611-430c-b862-2c4c5d35d06c'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:33:42.368748 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-85b2277b-d611-430c-b862-2c4c5d35d06c admin admin] The token cache is being invalidate because project fea200eb709a465ebcdf92a4200b629b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:33:42.369379 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-85b2277b-d611-430c-b862-2c4c5d35d06c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:33:42.371942 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-85b2277b-d611-430c-b862-2c4c5d35d06c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:33:42.375966 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 890/1774] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 11:33:42 2022] DELETE /identity/v3/projects/fea200eb709a465ebcdf92a4200b629b => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:33:42.377685 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b2277b-d611-430c-b862-2c4c5d35d06c admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:42.379394 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-85b2277b-d611-430c-b862-2c4c5d35d06c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:42.379690 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5620ab-0e69-4501-a40f-2930821ce168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:42.380337 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5620ab-0e69-4501-a40f-2930821ce168 admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:42.380942 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5620ab-0e69-4501-a40f-2930821ce168 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:42.381220 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5620ab-0e69-4501-a40f-2930821ce168 admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:42.384216 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5620ab-0e69-4501-a40f-2930821ce168 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:42.388039 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5620ab-0e69-4501-a40f-2930821ce168 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:42.411671 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 885/1775] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:33:41 2022] GET /identity/v3/roles => generated 1420 bytes in 454 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:33:42.412798 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5620ab-0e69-4501-a40f-2930821ce168 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:42.418865 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-4f5620ab-0e69-4501-a40f-2930821ce168 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:42.443470 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5620ab-0e69-4501-a40f-2930821ce168 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:42.561314 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db190ac6-cca1-4c63-a7cf-5ff27e4105b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:42.562780 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db190ac6-cca1-4c63-a7cf-5ff27e4105b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:42.563599 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db190ac6-cca1-4c63-a7cf-5ff27e4105b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:42.564157 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db190ac6-cca1-4c63-a7cf-5ff27e4105b5 admin admin] PATH_INFO: `/v3/users/810ccd94bfd9411cb2a2b2dbbe81eabb` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:42.566266 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db190ac6-cca1-4c63-a7cf-5ff27e4105b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=810ccd94bfd9411cb2a2b2dbbe81eabb)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:42.568869 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db190ac6-cca1-4c63-a7cf-5ff27e4105b5 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:42.585453 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b2277b-d611-430c-b862-2c4c5d35d06c admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:42.594501 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc371805-34d3-486f-8518-8d1b2b50f54f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:42.595140 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc371805-34d3-486f-8518-8d1b2b50f54f admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:42.595415 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc371805-34d3-486f-8518-8d1b2b50f54f admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:42.595684 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc371805-34d3-486f-8518-8d1b2b50f54f admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:42.596433 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc371805-34d3-486f-8518-8d1b2b50f54f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:42.598120 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc371805-34d3-486f-8518-8d1b2b50f54f admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:42.633129 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 891/1776] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:33:42 2022] GET /identity/v3/roles => generated 1420 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:33:42.633129 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc371805-34d3-486f-8518-8d1b2b50f54f admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:42.634347 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-cc371805-34d3-486f-8518-8d1b2b50f54f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:42.723283 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc371805-34d3-486f-8518-8d1b2b50f54f admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:42.745852 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ef0f12-b809-47e6-9229-bd742aae99c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:42.746688 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ef0f12-b809-47e6-9229-bd742aae99c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:42.747093 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ef0f12-b809-47e6-9229-bd742aae99c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:42.748135 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ef0f12-b809-47e6-9229-bd742aae99c8 admin admin] PATH_INFO: `/v3/projects/00b1f14e2fb745868f640058649dd427/users/6379980eb1e84a36959d73ecd1b2f09f/roles/30bb1e97257f4ca5b90c88545777317b` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:42.753621 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ef0f12-b809-47e6-9229-bd742aae99c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00b1f14e2fb745868f640058649dd427, user_id=6379980eb1e84a36959d73ecd1b2f09f, role_id=30bb1e97257f4ca5b90c88545777317b)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:42.761773 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ef0f12-b809-47e6-9229-bd742aae99c8 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:42.799125 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 892/1777] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 11:33:42 2022] PUT /identity/v3/projects/00b1f14e2fb745868f640058649dd427/users/6379980eb1e84a36959d73ecd1b2f09f/roles/30bb1e97257f4ca5b90c88545777317b => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:33:42.799125 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ef0f12-b809-47e6-9229-bd742aae99c8 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:42.799125 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-26ef0f12-b809-47e6-9229-bd742aae99c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:42.807237 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-db190ac6-cca1-4c63-a7cf-5ff27e4105b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '810ccd94bfd9411cb2a2b2dbbe81eabb'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:33:42.808159 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-db190ac6-cca1-4c63-a7cf-5ff27e4105b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '810ccd94bfd9411cb2a2b2dbbe81eabb'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:33:42.809875 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-db190ac6-cca1-4c63-a7cf-5ff27e4105b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '810ccd94bfd9411cb2a2b2dbbe81eabb'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:33:42.827543 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-db190ac6-cca1-4c63-a7cf-5ff27e4105b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '810ccd94bfd9411cb2a2b2dbbe81eabb'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:33:42.838164 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-db190ac6-cca1-4c63-a7cf-5ff27e4105b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '810ccd94bfd9411cb2a2b2dbbe81eabb'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:33:42.872469 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 886/1778] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 11:33:42 2022] DELETE /identity/v3/users/810ccd94bfd9411cb2a2b2dbbe81eabb => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:33:42.876293 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db190ac6-cca1-4c63-a7cf-5ff27e4105b5 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:42.878597 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-db190ac6-cca1-4c63-a7cf-5ff27e4105b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:42.974200 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:42.979877 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:43.052525 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ef0f12-b809-47e6-9229-bd742aae99c8 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:43.064497 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db190ac6-cca1-4c63-a7cf-5ff27e4105b5 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:43.075527 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a557ee-6f5d-4900-92c6-c0a00c97f3cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:43.076242 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a557ee-6f5d-4900-92c6-c0a00c97f3cd admin admin] REQUEST_METHOD: `PUT` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:43.077355 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a557ee-6f5d-4900-92c6-c0a00c97f3cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:43.077694 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a557ee-6f5d-4900-92c6-c0a00c97f3cd admin admin] PATH_INFO: `/v3/projects/19c4dff6edd64961a8896e0e51fa852b/users/779d269ee26249e19c54d9b90c10a2a6/roles/30bb1e97257f4ca5b90c88545777317b` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:43.082041 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a557ee-6f5d-4900-92c6-c0a00c97f3cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=19c4dff6edd64961a8896e0e51fa852b, user_id=779d269ee26249e19c54d9b90c10a2a6, role_id=30bb1e97257f4ca5b90c88545777317b)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:43.084807 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a557ee-6f5d-4900-92c6-c0a00c97f3cd admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:43.126895 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 887/1779] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 11:33:42 2022] PUT /identity/v3/projects/19c4dff6edd64961a8896e0e51fa852b/users/779d269ee26249e19c54d9b90c10a2a6/roles/30bb1e97257f4ca5b90c88545777317b => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:33:43.128258 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fb20f8-0825-435f-99a9-8ded1e9e5081 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:43.128542 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fb20f8-0825-435f-99a9-8ded1e9e5081 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:43.128815 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fb20f8-0825-435f-99a9-8ded1e9e5081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:43.181997 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-d6fb20f8-0825-435f-99a9-8ded1e9e5081 None None] MFA Rules not processed for user `c53eb370dc294248b3be2248570d1b04`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:33:43.191553 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-d6fb20f8-0825-435f-99a9-8ded1e9e5081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:43.298664 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 888/1780] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:33:43 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:33:43.303340 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd15262-5afa-4616-8114-191dc9f3ebc1 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:43.306875 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd15262-5afa-4616-8114-191dc9f3ebc1 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:43.307359 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd15262-5afa-4616-8114-191dc9f3ebc1 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:43.316286 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 889/1781] 10.222.0.27 () {54 vars in 961 bytes} [Wed Aug 24 11:33:43 2022] GET /identity => generated 270 bytes in 17 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:33:43.317864 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33e5635-ff41-4b90-8a5e-6d6166bd0764 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:43.318209 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33e5635-ff41-4b90-8a5e-6d6166bd0764 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:43.318703 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33e5635-ff41-4b90-8a5e-6d6166bd0764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:43.319306 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c34cde-e1a7-47a3-bf10-440588b8255b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '282ec32864d046b2bea170f6a3845cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:43.322346 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c34cde-e1a7-47a3-bf10-440588b8255b service nova] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:43.324341 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c34cde-e1a7-47a3-bf10-440588b8255b service nova] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:43.324914 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c34cde-e1a7-47a3-bf10-440588b8255b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:43.334895 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-93c34cde-e1a7-47a3-bf10-440588b8255b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:43.388216 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-b33e5635-ff41-4b90-8a5e-6d6166bd0764 None None] MFA Rules not processed for user `6379980eb1e84a36959d73ecd1b2f09f`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:33:43.389508 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-b33e5635-ff41-4b90-8a5e-6d6166bd0764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:43.566490 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c34cde-e1a7-47a3-bf10-440588b8255b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:43.568413 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c34cde-e1a7-47a3-bf10-440588b8255b service nova] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:43.602926 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 890/1782] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:33:43 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:33:43.604670 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33e5635-ff41-4b90-8a5e-6d6166bd0764 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:43.606204 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-b33e5635-ff41-4b90-8a5e-6d6166bd0764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:43.636174 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 893/1783] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:33:42 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 846 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:33:43.638932 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec492b6-2bdc-49de-956b-5752287a6e4a None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:43.641806 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec492b6-2bdc-49de-956b-5752287a6e4a None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:43.642225 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec492b6-2bdc-49de-956b-5752287a6e4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:43.709061 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33e5635-ff41-4b90-8a5e-6d6166bd0764 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:43.715008 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9db6053-7271-45bb-bda7-53d55fab0c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:43.715843 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9db6053-7271-45bb-bda7-53d55fab0c44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:43.716220 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9db6053-7271-45bb-bda7-53d55fab0c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:43.716588 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9db6053-7271-45bb-bda7-53d55fab0c44 admin admin] PATH_INFO: `/v3/projects/856ac9cb11524921b8a2c0574a594ad0` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:43.718162 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9db6053-7271-45bb-bda7-53d55fab0c44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=856ac9cb11524921b8a2c0574a594ad0)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:43.720649 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9db6053-7271-45bb-bda7-53d55fab0c44 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:43.723970 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:43.750274 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-fec492b6-2bdc-49de-956b-5752287a6e4a None None] MFA Rules not processed for user `779d269ee26249e19c54d9b90c10a2a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:33:43.751688 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-fec492b6-2bdc-49de-956b-5752287a6e4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:43.797694 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-a9db6053-7271-45bb-bda7-53d55fab0c44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '856ac9cb11524921b8a2c0574a594ad0', 'request_id': 'req-a9db6053-7271-45bb-bda7-53d55fab0c44'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:33:43.806213 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-a9db6053-7271-45bb-bda7-53d55fab0c44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '856ac9cb11524921b8a2c0574a594ad0', 'request_id': 'req-a9db6053-7271-45bb-bda7-53d55fab0c44'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:33:43.814634 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-a9db6053-7271-45bb-bda7-53d55fab0c44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '856ac9cb11524921b8a2c0574a594ad0', 'request_id': 'req-a9db6053-7271-45bb-bda7-53d55fab0c44'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:33:43.835091 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-a9db6053-7271-45bb-bda7-53d55fab0c44 admin admin] The token cache is being invalidate because project 856ac9cb11524921b8a2c0574a594ad0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81501) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:33:43.835682 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-a9db6053-7271-45bb-bda7-53d55fab0c44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:33:43.837253 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-a9db6053-7271-45bb-bda7-53d55fab0c44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:33:43.843700 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 891/1784] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 11:33:43 2022] DELETE /identity/v3/projects/856ac9cb11524921b8a2c0574a594ad0 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:33:43.845691 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febcab7d-10f1-4f1d-956b-1921d1f799fa None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:43.846075 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febcab7d-10f1-4f1d-956b-1921d1f799fa None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:43.846514 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febcab7d-10f1-4f1d-956b-1921d1f799fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:43.874115 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-febcab7d-10f1-4f1d-956b-1921d1f799fa None None] MFA Rules not processed for user `ad45431e70ff48a9b90905a97d473d81`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:33:43.875739 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-febcab7d-10f1-4f1d-956b-1921d1f799fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:43.954424 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 894/1785] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:33:43 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:33:43.955429 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec492b6-2bdc-49de-956b-5752287a6e4a None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:43.959029 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-fec492b6-2bdc-49de-956b-5752287a6e4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:43.985314 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:43.995659 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 892/1786] 10.222.0.27 () {58 vars in 1058 bytes} [Wed Aug 24 11:33:43 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:33:43.996301 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febcab7d-10f1-4f1d-956b-1921d1f799fa None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:43.997645 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-febcab7d-10f1-4f1d-956b-1921d1f799fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:44.106506 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febcab7d-10f1-4f1d-956b-1921d1f799fa None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:44.119705 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d828ce-77cc-47a8-addc-a77e6d9c1b45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:44.120431 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d828ce-77cc-47a8-addc-a77e6d9c1b45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:44.120715 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d828ce-77cc-47a8-addc-a77e6d9c1b45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:44.120993 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d828ce-77cc-47a8-addc-a77e6d9c1b45 admin admin] PATH_INFO: `/v3/projects/b592ca4a2036405a865033c97cf8bd83` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:44.122729 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d828ce-77cc-47a8-addc-a77e6d9c1b45 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b592ca4a2036405a865033c97cf8bd83)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:44.127103 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d828ce-77cc-47a8-addc-a77e6d9c1b45 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:44.135153 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec492b6-2bdc-49de-956b-5752287a6e4a None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:44.150484 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d800b68b-d3e4-415c-a506-fba162a51a97 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad45431e70ff48a9b90905a97d473d81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:44.151296 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d800b68b-d3e4-415c-a506-fba162a51a97 service placement] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:44.151579 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d800b68b-d3e4-415c-a506-fba162a51a97 service placement] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:44.152466 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d800b68b-d3e4-415c-a506-fba162a51a97 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:44.154588 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-d800b68b-d3e4-415c-a506-fba162a51a97 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:44.172206 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:44.186568 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d800b68b-d3e4-415c-a506-fba162a51a97 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:44.188311 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d800b68b-d3e4-415c-a506-fba162a51a97 service placement] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:44.202751 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 895/1787] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:33:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:33:44.203490 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d800b68b-d3e4-415c-a506-fba162a51a97 service placement] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:44.205479 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-d800b68b-d3e4-415c-a506-fba162a51a97 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:44.237526 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-68d828ce-77cc-47a8-addc-a77e6d9c1b45 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b592ca4a2036405a865033c97cf8bd83', 'request_id': 'req-68d828ce-77cc-47a8-addc-a77e6d9c1b45'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:33:44.262764 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-68d828ce-77cc-47a8-addc-a77e6d9c1b45 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b592ca4a2036405a865033c97cf8bd83', 'request_id': 'req-68d828ce-77cc-47a8-addc-a77e6d9c1b45'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:33:44.285988 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-68d828ce-77cc-47a8-addc-a77e6d9c1b45 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b592ca4a2036405a865033c97cf8bd83', 'request_id': 'req-68d828ce-77cc-47a8-addc-a77e6d9c1b45'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:33:44.336730 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-68d828ce-77cc-47a8-addc-a77e6d9c1b45 admin admin] The token cache is being invalidate because project b592ca4a2036405a865033c97cf8bd83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81501) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:33:44.337358 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-68d828ce-77cc-47a8-addc-a77e6d9c1b45 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:33:44.338447 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-68d828ce-77cc-47a8-addc-a77e6d9c1b45 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:33:44.340526 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 893/1788] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 11:33:43 2022] DELETE /identity/v3/projects/b592ca4a2036405a865033c97cf8bd83 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:33:44.342013 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d800b68b-d3e4-415c-a506-fba162a51a97 service placement] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:44.347420 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f194f750-383c-4aa2-9c50-07e6e9d6c545 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:44.348074 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f194f750-383c-4aa2-9c50-07e6e9d6c545 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:44.348487 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f194f750-383c-4aa2-9c50-07e6e9d6c545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:44.396520 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-f194f750-383c-4aa2-9c50-07e6e9d6c545 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:33:44.397748 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-f194f750-383c-4aa2-9c50-07e6e9d6c545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:44.415793 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151ee493-14eb-41c1-b893-0d9281d46345 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92862b76ba3b4513b5dc5b5c962faac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:44.416358 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151ee493-14eb-41c1-b893-0d9281d46345 service cinder] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:44.416734 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151ee493-14eb-41c1-b893-0d9281d46345 service cinder] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:44.417098 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151ee493-14eb-41c1-b893-0d9281d46345 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:44.419264 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-151ee493-14eb-41c1-b893-0d9281d46345 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:44.550327 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 894/1789] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:33:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:33:44.551793 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f194f750-383c-4aa2-9c50-07e6e9d6c545 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:44.553316 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-f194f750-383c-4aa2-9c50-07e6e9d6c545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:44.577512 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f194f750-383c-4aa2-9c50-07e6e9d6c545 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:44.581772 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5180d3-bb64-4d50-980a-ce2f8801f792 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92862b76ba3b4513b5dc5b5c962faac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:44.582418 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5180d3-bb64-4d50-980a-ce2f8801f792 service cinder] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:44.582701 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5180d3-bb64-4d50-980a-ce2f8801f792 service cinder] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:44.582974 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5180d3-bb64-4d50-980a-ce2f8801f792 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:44.584804 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151ee493-14eb-41c1-b893-0d9281d46345 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:44.585921 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-5a5180d3-bb64-4d50-980a-ce2f8801f792 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:44.586786 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151ee493-14eb-41c1-b893-0d9281d46345 service cinder] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:44.614820 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 896/1790] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:33:44 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:33:44.615868 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151ee493-14eb-41c1-b893-0d9281d46345 service cinder] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:44.619121 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-151ee493-14eb-41c1-b893-0d9281d46345 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:44.640620 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:44.725929 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5180d3-bb64-4d50-980a-ce2f8801f792 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:44.730483 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5180d3-bb64-4d50-980a-ce2f8801f792 service cinder] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:44.733349 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151ee493-14eb-41c1-b893-0d9281d46345 service cinder] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:44.739103 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6013b6-28af-4750-90f7-86f9be7d4583 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad45431e70ff48a9b90905a97d473d81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:44.739746 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6013b6-28af-4750-90f7-86f9be7d4583 service placement] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:44.740025 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6013b6-28af-4750-90f7-86f9be7d4583 service placement] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:44.740296 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6013b6-28af-4750-90f7-86f9be7d4583 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:44.742561 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-ed6013b6-28af-4750-90f7-86f9be7d4583 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:44.743550 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 895/1791] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:33:44 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:33:44.745192 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bb3dac-107b-4588-8406-b21f62a6e278 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:44.745545 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bb3dac-107b-4588-8406-b21f62a6e278 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:44.745887 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bb3dac-107b-4588-8406-b21f62a6e278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:44.757948 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6013b6-28af-4750-90f7-86f9be7d4583 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:44.760691 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6013b6-28af-4750-90f7-86f9be7d4583 service placement] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:44.772662 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-04bb3dac-107b-4588-8406-b21f62a6e278 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:33:44.773348 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 897/1792] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:33:44 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:33:44.774195 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-04bb3dac-107b-4588-8406-b21f62a6e278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:44.774946 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8366e3c1-25d0-4867-a3a1-e0dde1de0229 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:44.775314 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8366e3c1-25d0-4867-a3a1-e0dde1de0229 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:44.775603 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8366e3c1-25d0-4867-a3a1-e0dde1de0229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:44.784232 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 896/1793] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:33:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:33:44.793804 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaa468e-b5bb-4a24-8733-c20b6bbb28ce None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:44.794385 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaa468e-b5bb-4a24-8733-c20b6bbb28ce None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:44.794772 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaa468e-b5bb-4a24-8733-c20b6bbb28ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:44.806668 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-8366e3c1-25d0-4867-a3a1-e0dde1de0229 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:33:44.807896 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-8366e3c1-25d0-4867-a3a1-e0dde1de0229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:44.822204 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 898/1794] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:33:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:33:44.823232 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8366e3c1-25d0-4867-a3a1-e0dde1de0229 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:44.842125 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8366e3c1-25d0-4867-a3a1-e0dde1de0229 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:44.848534 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac28866b-db15-413d-9f49-b3f1e4a5bdf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:44.850646 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac28866b-db15-413d-9f49-b3f1e4a5bdf4 admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:44.850938 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac28866b-db15-413d-9f49-b3f1e4a5bdf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:44.851211 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac28866b-db15-413d-9f49-b3f1e4a5bdf4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:44.851884 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac28866b-db15-413d-9f49-b3f1e4a5bdf4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:44.852189 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac28866b-db15-413d-9f49-b3f1e4a5bdf4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:44.853823 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac28866b-db15-413d-9f49-b3f1e4a5bdf4 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:44.862567 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-7aaa468e-b5bb-4a24-8733-c20b6bbb28ce None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:33:44.864383 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-7aaa468e-b5bb-4a24-8733-c20b6bbb28ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:44.885809 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 897/1795] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:33:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:33:44.890255 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaa468e-b5bb-4a24-8733-c20b6bbb28ce None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:44.901183 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 899/1796] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 24 11:33:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:33:44.902332 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac28866b-db15-413d-9f49-b3f1e4a5bdf4 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:44.920928 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaa468e-b5bb-4a24-8733-c20b6bbb28ce None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:44.930793 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf318e3-294a-4e2d-a59f-21279ce98999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:44.931588 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf318e3-294a-4e2d-a59f-21279ce98999 admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:44.932010 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf318e3-294a-4e2d-a59f-21279ce98999 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:44.932689 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf318e3-294a-4e2d-a59f-21279ce98999 admin admin] PATH_INFO: `/v3/domains` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:44.933211 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf318e3-294a-4e2d-a59f-21279ce98999 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:44.933769 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf318e3-294a-4e2d-a59f-21279ce98999 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:44.934245 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac28866b-db15-413d-9f49-b3f1e4a5bdf4 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:44.935693 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf318e3-294a-4e2d-a59f-21279ce98999 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:44.945641 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52b889d-6e24-4f23-925c-5bdc07705f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:44.948229 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52b889d-6e24-4f23-925c-5bdc07705f21 admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:44.948414 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52b889d-6e24-4f23-925c-5bdc07705f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:44.948664 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52b889d-6e24-4f23-925c-5bdc07705f21 admin admin] PATH_INFO: `/v3/projects` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:44.949317 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52b889d-6e24-4f23-925c-5bdc07705f21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:44.950708 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 898/1797] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 24 11:33:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:33:44.951605 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf318e3-294a-4e2d-a59f-21279ce98999 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:44.960132 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52b889d-6e24-4f23-925c-5bdc07705f21 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:44.966604 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf318e3-294a-4e2d-a59f-21279ce98999 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:44.970588 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f529d0d0-7e9b-492c-b889-aa72b2a03d1e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92862b76ba3b4513b5dc5b5c962faac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:44.971744 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f529d0d0-7e9b-492c-b889-aa72b2a03d1e service cinder] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:44.972219 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f529d0d0-7e9b-492c-b889-aa72b2a03d1e service cinder] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:44.972715 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f529d0d0-7e9b-492c-b889-aa72b2a03d1e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:44.977888 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-f529d0d0-7e9b-492c-b889-aa72b2a03d1e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:45.051665 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 900/1798] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 11:33:44 2022] POST /identity/v3/projects => generated 371 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:33:45.052864 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52b889d-6e24-4f23-925c-5bdc07705f21 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:45.072017 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:45.228345 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f529d0d0-7e9b-492c-b889-aa72b2a03d1e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:45.236267 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f529d0d0-7e9b-492c-b889-aa72b2a03d1e service cinder] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:45.252865 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52b889d-6e24-4f23-925c-5bdc07705f21 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:45.271390 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e4cbd7-f229-4db6-ba0f-4f8137040756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:45.272186 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e4cbd7-f229-4db6-ba0f-4f8137040756 admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:45.273714 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e4cbd7-f229-4db6-ba0f-4f8137040756 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:45.274103 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e4cbd7-f229-4db6-ba0f-4f8137040756 admin admin] PATH_INFO: `/v3/projects` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:45.274995 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e4cbd7-f229-4db6-ba0f-4f8137040756 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:45.276498 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 899/1799] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:33:44 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:33:45.278743 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f529d0d0-7e9b-492c-b889-aa72b2a03d1e service cinder] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:45.293719 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e4cbd7-f229-4db6-ba0f-4f8137040756 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:45.297873 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f529d0d0-7e9b-492c-b889-aa72b2a03d1e service cinder] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:45.305694 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ee6b85-a818-44d9-8cba-c0e964100645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:45.306450 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ee6b85-a818-44d9-8cba-c0e964100645 admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:45.306994 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ee6b85-a818-44d9-8cba-c0e964100645 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:45.307304 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ee6b85-a818-44d9-8cba-c0e964100645 admin admin] PATH_INFO: `/v3/users` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:45.308070 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ee6b85-a818-44d9-8cba-c0e964100645 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:45.310451 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ee6b85-a818-44d9-8cba-c0e964100645 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:45.373843 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 901/1800] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 11:33:45 2022] POST /identity/v3/projects => generated 387 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:33:45.374918 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e4cbd7-f229-4db6-ba0f-4f8137040756 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:45.387094 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 900/1801] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 11:33:45 2022] POST /identity/v3/users => generated 286 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:33:45.390260 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ee6b85-a818-44d9-8cba-c0e964100645 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:45.409913 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ee6b85-a818-44d9-8cba-c0e964100645 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:45.538697 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03179be6-15e0-412f-8d78-3f80bd7e6bb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:45.541167 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03179be6-15e0-412f-8d78-3f80bd7e6bb7 admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:45.542587 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03179be6-15e0-412f-8d78-3f80bd7e6bb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:45.542906 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03179be6-15e0-412f-8d78-3f80bd7e6bb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:45.557535 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03179be6-15e0-412f-8d78-3f80bd7e6bb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:45.562840 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03179be6-15e0-412f-8d78-3f80bd7e6bb7 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:45.573829 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:45.621665 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 901/1802] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:33:45 2022] GET /identity/v3/roles => generated 1420 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 11:33:45.623155 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03179be6-15e0-412f-8d78-3f80bd7e6bb7 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:45.644359 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03179be6-15e0-412f-8d78-3f80bd7e6bb7 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:45.654438 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e4cbd7-f229-4db6-ba0f-4f8137040756 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:45.664916 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ff22b8-9507-4036-a82b-093e4e907144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:45.665581 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ff22b8-9507-4036-a82b-093e4e907144 admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:45.665927 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ff22b8-9507-4036-a82b-093e4e907144 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:45.672733 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ff22b8-9507-4036-a82b-093e4e907144 admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:45.673556 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ff22b8-9507-4036-a82b-093e4e907144 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:45.697380 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ff22b8-9507-4036-a82b-093e4e907144 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:45.698720 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3f3424-5d78-48e3-8a95-c56ba216ac6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:45.699402 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3f3424-5d78-48e3-8a95-c56ba216ac6a admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:45.699682 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3f3424-5d78-48e3-8a95-c56ba216ac6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:45.708473 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3f3424-5d78-48e3-8a95-c56ba216ac6a admin admin] PATH_INFO: `/v3/users` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:45.712709 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3f3424-5d78-48e3-8a95-c56ba216ac6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:45.719756 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3f3424-5d78-48e3-8a95-c56ba216ac6a admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:45.759582 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 902/1803] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:33:45 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:33:45.761029 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ff22b8-9507-4036-a82b-093e4e907144 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:45.805505 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ff22b8-9507-4036-a82b-093e4e907144 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:45.811351 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 902/1804] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 11:33:45 2022] POST /identity/v3/users => generated 294 bytes in 437 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:33:45.812534 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3f3424-5d78-48e3-8a95-c56ba216ac6a admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:45.829262 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f30321e-59dd-4da5-80be-b099f41374e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:45.829955 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f30321e-59dd-4da5-80be-b099f41374e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:45.830236 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f30321e-59dd-4da5-80be-b099f41374e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:45.830553 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f30321e-59dd-4da5-80be-b099f41374e3 admin admin] PATH_INFO: `/v3/projects/2e0359e63f6743f0864b1b54489579f5/users/aaf2b888c0604550a2baac76c5ca93d7/roles/27e3e65e24df4b86b0d3d18d3212101d` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:45.852778 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3f3424-5d78-48e3-8a95-c56ba216ac6a admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:45.868094 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b2386c-eede-4d27-8f6f-aa6628ead747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:45.869692 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b2386c-eede-4d27-8f6f-aa6628ead747 admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:45.871652 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b2386c-eede-4d27-8f6f-aa6628ead747 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:45.872208 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b2386c-eede-4d27-8f6f-aa6628ead747 admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:45.873563 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b2386c-eede-4d27-8f6f-aa6628ead747 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:45.879176 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b2386c-eede-4d27-8f6f-aa6628ead747 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:45.886090 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f30321e-59dd-4da5-80be-b099f41374e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e0359e63f6743f0864b1b54489579f5, user_id=aaf2b888c0604550a2baac76c5ca93d7, role_id=27e3e65e24df4b86b0d3d18d3212101d)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:45.895766 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f30321e-59dd-4da5-80be-b099f41374e3 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:45.914205 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 903/1805] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:33:45 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:33:45.919323 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b2386c-eede-4d27-8f6f-aa6628ead747 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:45.929539 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 903/1806] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 11:33:45 2022] PUT /identity/v3/projects/2e0359e63f6743f0864b1b54489579f5/users/aaf2b888c0604550a2baac76c5ca93d7/roles/27e3e65e24df4b86b0d3d18d3212101d => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:33:45.938266 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055bb90b-457f-41d0-8d84-6e27cfe10d5a None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:45.940615 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055bb90b-457f-41d0-8d84-6e27cfe10d5a None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:45.940976 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055bb90b-457f-41d0-8d84-6e27cfe10d5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:45.948227 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b2386c-eede-4d27-8f6f-aa6628ead747 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:46.042803 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-055bb90b-457f-41d0-8d84-6e27cfe10d5a None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:33:46.044783 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-055bb90b-457f-41d0-8d84-6e27cfe10d5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:46.108031 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cdadfd-9e27-4e70-ad7f-7f325eb214a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:46.108676 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cdadfd-9e27-4e70-ad7f-7f325eb214a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:46.108963 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cdadfd-9e27-4e70-ad7f-7f325eb214a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:46.109395 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cdadfd-9e27-4e70-ad7f-7f325eb214a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:46.110068 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cdadfd-9e27-4e70-ad7f-7f325eb214a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:46.124740 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cdadfd-9e27-4e70-ad7f-7f325eb214a3 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:46.152152 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 904/1807] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:33:45 2022] GET /identity/v3/roles => generated 1420 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:33:46.153194 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cdadfd-9e27-4e70-ad7f-7f325eb214a3 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:46.172392 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cdadfd-9e27-4e70-ad7f-7f325eb214a3 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:46.192542 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edc3060-79e2-4b44-8be7-3e75503aedf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:46.192542 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edc3060-79e2-4b44-8be7-3e75503aedf7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:46.192831 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edc3060-79e2-4b44-8be7-3e75503aedf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:46.192965 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edc3060-79e2-4b44-8be7-3e75503aedf7 admin admin] PATH_INFO: `/v3/projects/e400d1b2448741ba8d7b9ef9b5e5a309/users/aa739259e84e495e9cb60a7a1e1ed777/roles/27e3e65e24df4b86b0d3d18d3212101d` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:46.238523 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 904/1808] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:33:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:33:46.241687 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e91ce43-9dc0-4caa-9b64-6c1d1380c076 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:46.242323 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e91ce43-9dc0-4caa-9b64-6c1d1380c076 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:46.242831 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e91ce43-9dc0-4caa-9b64-6c1d1380c076 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:46.244838 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edc3060-79e2-4b44-8be7-3e75503aedf7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e400d1b2448741ba8d7b9ef9b5e5a309, user_id=aa739259e84e495e9cb60a7a1e1ed777, role_id=27e3e65e24df4b86b0d3d18d3212101d)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:46.247571 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edc3060-79e2-4b44-8be7-3e75503aedf7 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:46.275020 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 905/1809] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 11:33:46 2022] PUT /identity/v3/projects/e400d1b2448741ba8d7b9ef9b5e5a309/users/aa739259e84e495e9cb60a7a1e1ed777/roles/27e3e65e24df4b86b0d3d18d3212101d => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:33:46.284037 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edc3060-79e2-4b44-8be7-3e75503aedf7 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:46.284037 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-8edc3060-79e2-4b44-8be7-3e75503aedf7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:46.302892 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:46.326405 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-5e91ce43-9dc0-4caa-9b64-6c1d1380c076 None None] MFA Rules not processed for user `5bfd72d5fe714437be00c7c5533115b4`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:33:46.327717 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-5e91ce43-9dc0-4caa-9b64-6c1d1380c076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:46.440627 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edc3060-79e2-4b44-8be7-3e75503aedf7 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:46.450480 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4ec2dd-e9b9-4d14-b4e8-b4f197362414 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2d061d25d83443c9232218c90792d51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:46.451126 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4ec2dd-e9b9-4d14-b4e8-b4f197362414 service neutron] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:46.451405 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4ec2dd-e9b9-4d14-b4e8-b4f197362414 service neutron] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:46.451672 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4ec2dd-e9b9-4d14-b4e8-b4f197362414 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:46.482963 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 905/1810] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:33:46 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:33:46.484565 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1acadc8-c408-47df-89f0-b2fe56877405 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:46.486368 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1acadc8-c408-47df-89f0-b2fe56877405 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:46.486660 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1acadc8-c408-47df-89f0-b2fe56877405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:46.596829 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-e1acadc8-c408-47df-89f0-b2fe56877405 None None] MFA Rules not processed for user `aa739259e84e495e9cb60a7a1e1ed777`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:33:46.603087 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-e1acadc8-c408-47df-89f0-b2fe56877405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:46.646066 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:46.721261 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4ec2dd-e9b9-4d14-b4e8-b4f197362414 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:46.722765 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4ec2dd-e9b9-4d14-b4e8-b4f197362414 service neutron] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:46.751479 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 906/1811] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:33:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:33:46.775502 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4ec2dd-e9b9-4d14-b4e8-b4f197362414 service neutron] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:46.783969 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-1e4ec2dd-e9b9-4d14-b4e8-b4f197362414 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:46.912804 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 906/1812] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:33:46 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 429 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:33:46.917112 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1acadc8-c408-47df-89f0-b2fe56877405 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:46.938393 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1acadc8-c408-47df-89f0-b2fe56877405 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:46.949901 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d15887-db66-41ae-adc0-366bc301fa23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:46.950573 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d15887-db66-41ae-adc0-366bc301fa23 admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:46.950849 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d15887-db66-41ae-adc0-366bc301fa23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:46.951122 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d15887-db66-41ae-adc0-366bc301fa23 admin admin] PATH_INFO: `/v3/projects` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:46.951767 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d15887-db66-41ae-adc0-366bc301fa23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:46.953856 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d15887-db66-41ae-adc0-366bc301fa23 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:46.977913 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4ec2dd-e9b9-4d14-b4e8-b4f197362414 service neutron] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:46.986831 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cade1c1-496f-4986-ac32-d09fa3c20c24 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92862b76ba3b4513b5dc5b5c962faac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:46.987819 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cade1c1-496f-4986-ac32-d09fa3c20c24 service cinder] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:46.988337 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cade1c1-496f-4986-ac32-d09fa3c20c24 service cinder] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:46.988764 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cade1c1-496f-4986-ac32-d09fa3c20c24 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:46.991758 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-8cade1c1-496f-4986-ac32-d09fa3c20c24 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:47.020248 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 907/1813] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 11:33:46 2022] POST /identity/v3/projects => generated 385 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:33:47.027214 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d15887-db66-41ae-adc0-366bc301fa23 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:47.193040 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cade1c1-496f-4986-ac32-d09fa3c20c24 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:47.195518 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cade1c1-496f-4986-ac32-d09fa3c20c24 service cinder] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:47.204006 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d15887-db66-41ae-adc0-366bc301fa23 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:47.222306 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7c46d8-0ee3-4903-a146-225d263307ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:47.223113 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7c46d8-0ee3-4903-a146-225d263307ef admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:47.223625 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7c46d8-0ee3-4903-a146-225d263307ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:47.223787 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7c46d8-0ee3-4903-a146-225d263307ef admin admin] PATH_INFO: `/v3/users` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:47.229369 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 907/1814] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:33:46 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:33:47.229739 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7c46d8-0ee3-4903-a146-225d263307ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:47.231967 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7c46d8-0ee3-4903-a146-225d263307ef admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:47.316420 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 908/1815] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 11:33:47 2022] POST /identity/v3/users => generated 299 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:33:47.320886 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cade1c1-496f-4986-ac32-d09fa3c20c24 service cinder] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:47.346820 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cade1c1-496f-4986-ac32-d09fa3c20c24 service cinder] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:47.360807 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c5b3c7-1790-456a-ab7c-db745ab8b245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:47.362697 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c5b3c7-1790-456a-ab7c-db745ab8b245 admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:47.363526 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c5b3c7-1790-456a-ab7c-db745ab8b245 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:47.364577 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c5b3c7-1790-456a-ab7c-db745ab8b245 admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:47.367656 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c5b3c7-1790-456a-ab7c-db745ab8b245 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:47.373867 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c5b3c7-1790-456a-ab7c-db745ab8b245 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:47.411905 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 908/1816] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:33:47 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:33:47.419565 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7c46d8-0ee3-4903-a146-225d263307ef admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:47.436629 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7c46d8-0ee3-4903-a146-225d263307ef admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:47.461243 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1474da0a-954f-4e11-b74c-7a64a7195070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:47.461960 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1474da0a-954f-4e11-b74c-7a64a7195070 admin admin] REQUEST_METHOD: `PUT` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:47.462237 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1474da0a-954f-4e11-b74c-7a64a7195070 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:47.462541 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1474da0a-954f-4e11-b74c-7a64a7195070 admin admin] PATH_INFO: `/v3/projects/4e0cbefc9bea41b7b7028022d3b2df0b/users/fe98d13ad05a405c92f17856081e5745/roles/30bb1e97257f4ca5b90c88545777317b` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:47.477660 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:47.503824 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1474da0a-954f-4e11-b74c-7a64a7195070 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e0cbefc9bea41b7b7028022d3b2df0b, user_id=fe98d13ad05a405c92f17856081e5745, role_id=30bb1e97257f4ca5b90c88545777317b)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:47.506990 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1474da0a-954f-4e11-b74c-7a64a7195070 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:47.541515 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 909/1817] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 11:33:47 2022] PUT /identity/v3/projects/4e0cbefc9bea41b7b7028022d3b2df0b/users/fe98d13ad05a405c92f17856081e5745/roles/30bb1e97257f4ca5b90c88545777317b => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:33:47.545371 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c5b3c7-1790-456a-ab7c-db745ab8b245 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:47.560063 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c5b3c7-1790-456a-ab7c-db745ab8b245 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:47.725902 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0138bb7b-96ae-464d-b6fc-48bf3002f9f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:47.727087 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0138bb7b-96ae-464d-b6fc-48bf3002f9f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:47.727087 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0138bb7b-96ae-464d-b6fc-48bf3002f9f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:47.727087 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0138bb7b-96ae-464d-b6fc-48bf3002f9f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:47.727786 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0138bb7b-96ae-464d-b6fc-48bf3002f9f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:47.729442 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0138bb7b-96ae-464d-b6fc-48bf3002f9f6 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:47.776617 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 909/1818] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:33:47 2022] GET /identity/v3/roles => generated 1420 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:33:47.778264 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1474da0a-954f-4e11-b74c-7a64a7195070 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:47.791401 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1474da0a-954f-4e11-b74c-7a64a7195070 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:47.815276 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499859bb-ac1a-4a45-aa1d-b4cd929ece9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:47.823101 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499859bb-ac1a-4a45-aa1d-b4cd929ece9a admin admin] REQUEST_METHOD: `PUT` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:47.823677 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499859bb-ac1a-4a45-aa1d-b4cd929ece9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:47.823677 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499859bb-ac1a-4a45-aa1d-b4cd929ece9a admin admin] PATH_INFO: `/v3/projects/4e0cbefc9bea41b7b7028022d3b2df0b/users/fe98d13ad05a405c92f17856081e5745/roles/30bb1e97257f4ca5b90c88545777317b` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:47.828124 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499859bb-ac1a-4a45-aa1d-b4cd929ece9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e0cbefc9bea41b7b7028022d3b2df0b, user_id=fe98d13ad05a405c92f17856081e5745, role_id=30bb1e97257f4ca5b90c88545777317b)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:47.831266 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499859bb-ac1a-4a45-aa1d-b4cd929ece9a admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:47.875991 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bddb7c6-f428-46da-bec4-2eb2b4748d64 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:47.876718 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bddb7c6-f428-46da-bec4-2eb2b4748d64 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:47.878153 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bddb7c6-f428-46da-bec4-2eb2b4748d64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:47.879473 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 910/1819] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 11:33:47 2022] PUT /identity/v3/projects/4e0cbefc9bea41b7b7028022d3b2df0b/users/fe98d13ad05a405c92f17856081e5745/roles/30bb1e97257f4ca5b90c88545777317b => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:33:47.958796 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-4bddb7c6-f428-46da-bec4-2eb2b4748d64 None None] MFA Rules not processed for user `fe98d13ad05a405c92f17856081e5745`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:33:47.960171 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-4bddb7c6-f428-46da-bec4-2eb2b4748d64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:47.974149 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:48.091693 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 910/1820] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:33:47 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 11:33:48.099957 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499859bb-ac1a-4a45-aa1d-b4cd929ece9a admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:48.307621 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499859bb-ac1a-4a45-aa1d-b4cd929ece9a admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:48.317911 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f896931-dcdc-4b3c-b600-b5171cf6595c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92862b76ba3b4513b5dc5b5c962faac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:48.318659 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f896931-dcdc-4b3c-b600-b5171cf6595c service cinder] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:48.318978 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f896931-dcdc-4b3c-b600-b5171cf6595c service cinder] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:48.319253 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f896931-dcdc-4b3c-b600-b5171cf6595c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:48.336093 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f896931-dcdc-4b3c-b600-b5171cf6595c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:48.339358 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f896931-dcdc-4b3c-b600-b5171cf6595c service cinder] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:48.373828 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 911/1821] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:33:48 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:33:48.431472 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bddb7c6-f428-46da-bec4-2eb2b4748d64 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:48.538976 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bddb7c6-f428-46da-bec4-2eb2b4748d64 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:48.545017 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60693a7e-b01e-4212-9efe-0d4b5c6dd453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:48.546936 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60693a7e-b01e-4212-9efe-0d4b5c6dd453 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:48.547536 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60693a7e-b01e-4212-9efe-0d4b5c6dd453 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:48.547536 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60693a7e-b01e-4212-9efe-0d4b5c6dd453 admin admin] PATH_INFO: `/v3/users/aa739259e84e495e9cb60a7a1e1ed777` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:48.551062 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60693a7e-b01e-4212-9efe-0d4b5c6dd453 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa739259e84e495e9cb60a7a1e1ed777)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:48.554451 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60693a7e-b01e-4212-9efe-0d4b5c6dd453 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:48.659061 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-60693a7e-b01e-4212-9efe-0d4b5c6dd453 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa739259e84e495e9cb60a7a1e1ed777'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:33:48.660508 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-60693a7e-b01e-4212-9efe-0d4b5c6dd453 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa739259e84e495e9cb60a7a1e1ed777'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:33:48.685929 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-60693a7e-b01e-4212-9efe-0d4b5c6dd453 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa739259e84e495e9cb60a7a1e1ed777'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:33:48.702490 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-60693a7e-b01e-4212-9efe-0d4b5c6dd453 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa739259e84e495e9cb60a7a1e1ed777'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:33:48.704283 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-60693a7e-b01e-4212-9efe-0d4b5c6dd453 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa739259e84e495e9cb60a7a1e1ed777'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:33:48.790113 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 911/1822] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 11:33:48 2022] DELETE /identity/v3/users/aa739259e84e495e9cb60a7a1e1ed777 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:33:48.797527 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a76b10a-d921-4320-a2a7-f97880550a43 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:48.797990 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a76b10a-d921-4320-a2a7-f97880550a43 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:48.798861 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a76b10a-d921-4320-a2a7-f97880550a43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:48.860912 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-4a76b10a-d921-4320-a2a7-f97880550a43 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:33:48.864598 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-4a76b10a-d921-4320-a2a7-f97880550a43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:49.024537 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 912/1823] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:33:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:33:49.175921 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60693a7e-b01e-4212-9efe-0d4b5c6dd453 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:49.178007 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-60693a7e-b01e-4212-9efe-0d4b5c6dd453 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:49.328744 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:49.479240 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60693a7e-b01e-4212-9efe-0d4b5c6dd453 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:49.482669 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dad509-3b0d-49ec-b02b-6c57da52f946 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:49.483183 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dad509-3b0d-49ec-b02b-6c57da52f946 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:49.483345 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dad509-3b0d-49ec-b02b-6c57da52f946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:49.514961 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13784a7b-20a2-40df-975b-14e4202a7c06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2d061d25d83443c9232218c90792d51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:49.515716 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13784a7b-20a2-40df-975b-14e4202a7c06 service neutron] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:49.516003 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13784a7b-20a2-40df-975b-14e4202a7c06 service neutron] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:49.516275 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13784a7b-20a2-40df-975b-14e4202a7c06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:49.550857 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13784a7b-20a2-40df-975b-14e4202a7c06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:49.552339 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13784a7b-20a2-40df-975b-14e4202a7c06 service neutron] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:49.614191 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 912/1824] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:33:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:33:49.675539 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-99dad509-3b0d-49ec-b02b-6c57da52f946 None None] MFA Rules not processed for user `a5915030f01941fc89f92228ff57c7f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:33:49.677581 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-99dad509-3b0d-49ec-b02b-6c57da52f946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:49.755984 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:49.853219 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 913/1825] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Aug 24 11:33:49 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 372 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 11:33:50.022721 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e204a7b2-0a78-4ef8-a6cf-d179ed8d6b39 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:50.023505 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e204a7b2-0a78-4ef8-a6cf-d179ed8d6b39 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:50.023781 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e204a7b2-0a78-4ef8-a6cf-d179ed8d6b39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:50.079751 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-e204a7b2-0a78-4ef8-a6cf-d179ed8d6b39 None None] MFA Rules not processed for user `aaf2b888c0604550a2baac76c5ca93d7`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:33:50.085676 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-e204a7b2-0a78-4ef8-a6cf-d179ed8d6b39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:50.146112 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dad509-3b0d-49ec-b02b-6c57da52f946 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:50.149295 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-99dad509-3b0d-49ec-b02b-6c57da52f946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:50.287755 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 913/1826] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:33:50 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:33:50.292061 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e204a7b2-0a78-4ef8-a6cf-d179ed8d6b39 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:50.293838 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-e204a7b2-0a78-4ef8-a6cf-d179ed8d6b39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:50.320957 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e204a7b2-0a78-4ef8-a6cf-d179ed8d6b39 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:50.327473 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd70649-4bb3-4cc2-b466-bb7bc123fd42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:50.328477 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd70649-4bb3-4cc2-b466-bb7bc123fd42 admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:50.328953 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd70649-4bb3-4cc2-b466-bb7bc123fd42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:50.329518 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd70649-4bb3-4cc2-b466-bb7bc123fd42 admin admin] PATH_INFO: `/v3/projects` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:50.330468 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd70649-4bb3-4cc2-b466-bb7bc123fd42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:50.332464 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dad509-3b0d-49ec-b02b-6c57da52f946 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:50.332881 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd70649-4bb3-4cc2-b466-bb7bc123fd42 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:50.348968 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec99735-f3d4-4020-a36e-33f6d9176093 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1069558c085449f9e4c9f06013b2a85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:50.349616 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec99735-f3d4-4020-a36e-33f6d9176093 service swift] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:50.349895 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec99735-f3d4-4020-a36e-33f6d9176093 service swift] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:50.350165 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec99735-f3d4-4020-a36e-33f6d9176093 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:50.370191 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec99735-f3d4-4020-a36e-33f6d9176093 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:50.375551 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec99735-f3d4-4020-a36e-33f6d9176093 service swift] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:50.397993 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 914/1827] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 11:33:50 2022] POST /identity/v3/projects => generated 373 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 11:33:50.402007 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 914/1828] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Aug 24 11:33:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 11:33:50.402852 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd70649-4bb3-4cc2-b466-bb7bc123fd42 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:50.597260 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd70649-4bb3-4cc2-b466-bb7bc123fd42 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:50.606741 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b1ad8e-b9f4-4514-a036-86608aa9fb5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:50.608463 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b1ad8e-b9f4-4514-a036-86608aa9fb5f admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:50.608891 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b1ad8e-b9f4-4514-a036-86608aa9fb5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:50.609299 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b1ad8e-b9f4-4514-a036-86608aa9fb5f admin admin] PATH_INFO: `/v3/users` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:50.610398 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b1ad8e-b9f4-4514-a036-86608aa9fb5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:50.614646 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b1ad8e-b9f4-4514-a036-86608aa9fb5f admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:50.655046 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 915/1829] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 11:33:50 2022] POST /identity/v3/users => generated 293 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:33:50.659291 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec99735-f3d4-4020-a36e-33f6d9176093 service swift] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:50.680683 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec99735-f3d4-4020-a36e-33f6d9176093 service swift] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:50.707916 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44638524-efa0-47aa-ac16-86030f60c3b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:50.708649 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44638524-efa0-47aa-ac16-86030f60c3b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:50.708981 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44638524-efa0-47aa-ac16-86030f60c3b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:50.709311 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44638524-efa0-47aa-ac16-86030f60c3b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:50.710056 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44638524-efa0-47aa-ac16-86030f60c3b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:50.714705 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44638524-efa0-47aa-ac16-86030f60c3b3 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:50.753072 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 915/1830] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:33:50 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:33:50.757075 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b1ad8e-b9f4-4514-a036-86608aa9fb5f admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:50.777369 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b1ad8e-b9f4-4514-a036-86608aa9fb5f admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:50.801179 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1222110b-1fc7-4762-ac02-9585545dbd7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:50.805621 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1222110b-1fc7-4762-ac02-9585545dbd7c admin admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:50.806727 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1222110b-1fc7-4762-ac02-9585545dbd7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:50.807945 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1222110b-1fc7-4762-ac02-9585545dbd7c admin admin] PATH_INFO: `/v3/projects/565e681d9c6e4ad99db252183fdcbbef/users/1422693644304d41ab67eddd6641baaf/roles/30bb1e97257f4ca5b90c88545777317b` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:50.909219 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1222110b-1fc7-4762-ac02-9585545dbd7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=565e681d9c6e4ad99db252183fdcbbef, user_id=1422693644304d41ab67eddd6641baaf, role_id=30bb1e97257f4ca5b90c88545777317b)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:50.925035 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1222110b-1fc7-4762-ac02-9585545dbd7c admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:50.949674 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:50.961431 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 916/1831] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 11:33:50 2022] PUT /identity/v3/projects/565e681d9c6e4ad99db252183fdcbbef/users/1422693644304d41ab67eddd6641baaf/roles/30bb1e97257f4ca5b90c88545777317b => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:33:50.967455 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44638524-efa0-47aa-ac16-86030f60c3b3 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:50.985016 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44638524-efa0-47aa-ac16-86030f60c3b3 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:51.281214 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0419f9-e1fd-40c0-865f-528df5611fd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:51.285761 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0419f9-e1fd-40c0-865f-528df5611fd1 admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:51.289655 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0419f9-e1fd-40c0-865f-528df5611fd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:51.291022 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0419f9-e1fd-40c0-865f-528df5611fd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:51.295204 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0419f9-e1fd-40c0-865f-528df5611fd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:51.297991 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0419f9-e1fd-40c0-865f-528df5611fd1 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:51.326605 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7415ac-81c2-42d0-970e-9faed3cfd58d None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:51.326955 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7415ac-81c2-42d0-970e-9faed3cfd58d None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:51.327257 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7415ac-81c2-42d0-970e-9faed3cfd58d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:51.369173 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 916/1832] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:33:50 2022] GET /identity/v3/roles => generated 1420 bytes in 396 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 11:33:51.370257 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0419f9-e1fd-40c0-865f-528df5611fd1 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:51.390314 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-fe7415ac-81c2-42d0-970e-9faed3cfd58d None None] MFA Rules not processed for user `e2d061d25d83443c9232218c90792d51`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:33:51.396897 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-fe7415ac-81c2-42d0-970e-9faed3cfd58d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:51.447558 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0419f9-e1fd-40c0-865f-528df5611fd1 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:51.472367 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2be03f1-e3d7-4cdc-abe7-bf168df3de1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:51.475499 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2be03f1-e3d7-4cdc-abe7-bf168df3de1e admin admin] REQUEST_METHOD: `PUT` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:51.479132 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2be03f1-e3d7-4cdc-abe7-bf168df3de1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:51.479442 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2be03f1-e3d7-4cdc-abe7-bf168df3de1e admin admin] PATH_INFO: `/v3/projects/565e681d9c6e4ad99db252183fdcbbef/users/1422693644304d41ab67eddd6641baaf/roles/30bb1e97257f4ca5b90c88545777317b` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:51.510133 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2be03f1-e3d7-4cdc-abe7-bf168df3de1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=565e681d9c6e4ad99db252183fdcbbef, user_id=1422693644304d41ab67eddd6641baaf, role_id=30bb1e97257f4ca5b90c88545777317b)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:51.530321 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2be03f1-e3d7-4cdc-abe7-bf168df3de1e admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:51.571631 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 917/1833] 10.222.0.97 () {58 vars in 1015 bytes} [Wed Aug 24 11:33:51 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:33:51.591804 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7415ac-81c2-42d0-970e-9faed3cfd58d None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:51.593747 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-fe7415ac-81c2-42d0-970e-9faed3cfd58d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:51.609479 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 917/1834] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 11:33:51 2022] PUT /identity/v3/projects/565e681d9c6e4ad99db252183fdcbbef/users/1422693644304d41ab67eddd6641baaf/roles/30bb1e97257f4ca5b90c88545777317b => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:33:51.634533 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7415ac-81c2-42d0-970e-9faed3cfd58d None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:51.815661 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1ac6f6-852e-47a8-bdf2-c4e9848e5c81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2d061d25d83443c9232218c90792d51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:51.825416 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1ac6f6-852e-47a8-bdf2-c4e9848e5c81 service neutron] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:51.827436 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1ac6f6-852e-47a8-bdf2-c4e9848e5c81 service neutron] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:51.829232 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1ac6f6-852e-47a8-bdf2-c4e9848e5c81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:51.854956 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1ac6f6-852e-47a8-bdf2-c4e9848e5c81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:51.856660 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1ac6f6-852e-47a8-bdf2-c4e9848e5c81 service neutron] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:51.886012 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 918/1835] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:33:51 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:33:52.716635 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2be03f1-e3d7-4cdc-abe7-bf168df3de1e admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:52.718854 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-e2be03f1-e3d7-4cdc-abe7-bf168df3de1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:52.806481 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:52.915031 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2be03f1-e3d7-4cdc-abe7-bf168df3de1e admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:52.930309 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52388eb9-e7b1-4a99-ac80-9f74b2e92ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:52.930309 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52388eb9-e7b1-4a99-ac80-9f74b2e92ab7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:52.930609 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52388eb9-e7b1-4a99-ac80-9f74b2e92ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:52.931112 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52388eb9-e7b1-4a99-ac80-9f74b2e92ab7 admin admin] PATH_INFO: `/v3/users/978361e6dbbb40cb81416441dd732e31` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:52.934396 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52388eb9-e7b1-4a99-ac80-9f74b2e92ab7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=978361e6dbbb40cb81416441dd732e31)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:52.935387 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52388eb9-e7b1-4a99-ac80-9f74b2e92ab7 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:53.086239 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-52388eb9-e7b1-4a99-ac80-9f74b2e92ab7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '978361e6dbbb40cb81416441dd732e31'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:33:53.087838 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-52388eb9-e7b1-4a99-ac80-9f74b2e92ab7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '978361e6dbbb40cb81416441dd732e31'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:33:53.089016 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-52388eb9-e7b1-4a99-ac80-9f74b2e92ab7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '978361e6dbbb40cb81416441dd732e31'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:33:53.135106 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-52388eb9-e7b1-4a99-ac80-9f74b2e92ab7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '978361e6dbbb40cb81416441dd732e31'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:33:53.167768 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-52388eb9-e7b1-4a99-ac80-9f74b2e92ab7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '978361e6dbbb40cb81416441dd732e31'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:33:53.199750 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 918/1836] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 11:33:52 2022] DELETE /identity/v3/users/978361e6dbbb40cb81416441dd732e31 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:33:53.205697 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9f229d-5bbf-424a-9acd-2d969a6d43de None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:53.206445 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9f229d-5bbf-424a-9acd-2d969a6d43de None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:53.206653 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9f229d-5bbf-424a-9acd-2d969a6d43de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:53.258448 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-1d9f229d-5bbf-424a-9acd-2d969a6d43de None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:33:53.260284 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-1d9f229d-5bbf-424a-9acd-2d969a6d43de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:53.462581 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 919/1837] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:33:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:33:53.473836 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52388eb9-e7b1-4a99-ac80-9f74b2e92ab7 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:53.475400 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-52388eb9-e7b1-4a99-ac80-9f74b2e92ab7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:53.620517 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52388eb9-e7b1-4a99-ac80-9f74b2e92ab7 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:53.625510 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd50bb98-dc45-49ac-9cba-c79e4aa38a4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2d061d25d83443c9232218c90792d51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:53.626168 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd50bb98-dc45-49ac-9cba-c79e4aa38a4a service neutron] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:53.626533 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd50bb98-dc45-49ac-9cba-c79e4aa38a4a service neutron] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:53.626807 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd50bb98-dc45-49ac-9cba-c79e4aa38a4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:53.642589 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd50bb98-dc45-49ac-9cba-c79e4aa38a4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:53.644414 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd50bb98-dc45-49ac-9cba-c79e4aa38a4a service neutron] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:53.658340 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 919/1838] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:33:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:33:53.785468 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9f229d-5bbf-424a-9acd-2d969a6d43de None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:53.787194 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-1d9f229d-5bbf-424a-9acd-2d969a6d43de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:53.811526 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9f229d-5bbf-424a-9acd-2d969a6d43de None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:53.817037 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f798fe4-5e07-42cf-a8d0-2a180fdb75e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:53.817834 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f798fe4-5e07-42cf-a8d0-2a180fdb75e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:53.818179 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f798fe4-5e07-42cf-a8d0-2a180fdb75e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:53.818583 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f798fe4-5e07-42cf-a8d0-2a180fdb75e1 admin admin] PATH_INFO: `/v3/projects/e400d1b2448741ba8d7b9ef9b5e5a309` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:53.819855 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f798fe4-5e07-42cf-a8d0-2a180fdb75e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e400d1b2448741ba8d7b9ef9b5e5a309)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:53.821919 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f798fe4-5e07-42cf-a8d0-2a180fdb75e1 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:53.881405 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:53.885666 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-5f798fe4-5e07-42cf-a8d0-2a180fdb75e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e400d1b2448741ba8d7b9ef9b5e5a309', 'request_id': 'req-5f798fe4-5e07-42cf-a8d0-2a180fdb75e1'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:33:53.899425 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-5f798fe4-5e07-42cf-a8d0-2a180fdb75e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e400d1b2448741ba8d7b9ef9b5e5a309', 'request_id': 'req-5f798fe4-5e07-42cf-a8d0-2a180fdb75e1'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:33:53.915749 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-5f798fe4-5e07-42cf-a8d0-2a180fdb75e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e400d1b2448741ba8d7b9ef9b5e5a309', 'request_id': 'req-5f798fe4-5e07-42cf-a8d0-2a180fdb75e1'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:33:53.945531 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-5f798fe4-5e07-42cf-a8d0-2a180fdb75e1 admin admin] The token cache is being invalidate because project e400d1b2448741ba8d7b9ef9b5e5a309 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:33:53.946226 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-5f798fe4-5e07-42cf-a8d0-2a180fdb75e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:33:53.947608 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-5f798fe4-5e07-42cf-a8d0-2a180fdb75e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:33:53.954837 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 920/1839] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 11:33:53 2022] DELETE /identity/v3/projects/e400d1b2448741ba8d7b9ef9b5e5a309 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:33:53.955212 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd50bb98-dc45-49ac-9cba-c79e4aa38a4a service neutron] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:53.969756 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd50bb98-dc45-49ac-9cba-c79e4aa38a4a service neutron] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:54.144995 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:54.184489 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8d0a05-f33e-4d29-9327-f9e91dfa15a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:54.184489 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8d0a05-f33e-4d29-9327-f9e91dfa15a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:54.184489 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8d0a05-f33e-4d29-9327-f9e91dfa15a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:54.184489 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8d0a05-f33e-4d29-9327-f9e91dfa15a6 admin admin] PATH_INFO: `/v3/users/fe98d13ad05a405c92f17856081e5745` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:54.186385 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8d0a05-f33e-4d29-9327-f9e91dfa15a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe98d13ad05a405c92f17856081e5745)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:54.201751 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8d0a05-f33e-4d29-9327-f9e91dfa15a6 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:54.344706 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-0f8d0a05-f33e-4d29-9327-f9e91dfa15a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe98d13ad05a405c92f17856081e5745'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:33:54.345685 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-0f8d0a05-f33e-4d29-9327-f9e91dfa15a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe98d13ad05a405c92f17856081e5745'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:33:54.346668 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-0f8d0a05-f33e-4d29-9327-f9e91dfa15a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe98d13ad05a405c92f17856081e5745'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:33:54.363823 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-0f8d0a05-f33e-4d29-9327-f9e91dfa15a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe98d13ad05a405c92f17856081e5745'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:33:54.376987 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-0f8d0a05-f33e-4d29-9327-f9e91dfa15a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe98d13ad05a405c92f17856081e5745'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:33:54.426377 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 920/1840] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 11:33:53 2022] DELETE /identity/v3/users/fe98d13ad05a405c92f17856081e5745 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:33:54.514674 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdb20d8-19f7-4ae9-b570-15a7895b4c2b None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:54.515120 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdb20d8-19f7-4ae9-b570-15a7895b4c2b None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:54.515203 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdb20d8-19f7-4ae9-b570-15a7895b4c2b None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:54.516578 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 921/1841] 10.222.0.27 () {54 vars in 921 bytes} [Wed Aug 24 11:33:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:33:54.547326 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d149d2a2-fff2-4cf3-b56c-ad845c434977 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:54.548011 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d149d2a2-fff2-4cf3-b56c-ad845c434977 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:54.548311 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d149d2a2-fff2-4cf3-b56c-ad845c434977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:54.627370 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-d149d2a2-fff2-4cf3-b56c-ad845c434977 None None] MFA Rules not processed for user `282ec32864d046b2bea170f6a3845cc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:33:54.644951 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-d149d2a2-fff2-4cf3-b56c-ad845c434977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:54.747376 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288c6f04-a277-4978-b1e6-fa43c21ef551 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:54.747661 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288c6f04-a277-4978-b1e6-fa43c21ef551 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:54.747967 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288c6f04-a277-4978-b1e6-fa43c21ef551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:54.933194 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-288c6f04-a277-4978-b1e6-fa43c21ef551 None None] MFA Rules not processed for user `1422693644304d41ab67eddd6641baaf`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:33:54.936671 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-288c6f04-a277-4978-b1e6-fa43c21ef551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:55.019376 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 921/1842] 10.222.0.27 () {58 vars in 1018 bytes} [Wed Aug 24 11:33:54 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 473 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:33:55.179221 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 922/1843] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:33:54 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 431 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:33:55.182254 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6278fb35-867a-45b3-aa30-bfb16f56e313 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:55.182904 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6278fb35-867a-45b3-aa30-bfb16f56e313 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:55.183383 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6278fb35-867a-45b3-aa30-bfb16f56e313 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:55.251218 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-6278fb35-867a-45b3-aa30-bfb16f56e313 None None] MFA Rules not processed for user `aaf2b888c0604550a2baac76c5ca93d7`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:33:55.260667 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-6278fb35-867a-45b3-aa30-bfb16f56e313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:55.507588 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 922/1844] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:33:55 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:33:55.536143 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288c6f04-a277-4978-b1e6-fa43c21ef551 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:55.538245 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-288c6f04-a277-4978-b1e6-fa43c21ef551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:55.695479 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6278fb35-867a-45b3-aa30-bfb16f56e313 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:55.697222 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-6278fb35-867a-45b3-aa30-bfb16f56e313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:55.752331 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6278fb35-867a-45b3-aa30-bfb16f56e313 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:55.779766 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d00d691-b64a-47fa-bdee-90c7286cb5e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '282ec32864d046b2bea170f6a3845cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:55.780661 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d00d691-b64a-47fa-bdee-90c7286cb5e6 service nova] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:55.781181 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d00d691-b64a-47fa-bdee-90c7286cb5e6 service nova] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:55.781418 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d00d691-b64a-47fa-bdee-90c7286cb5e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:55.792469 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:55.800330 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288c6f04-a277-4978-b1e6-fa43c21ef551 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:55.821811 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d00d691-b64a-47fa-bdee-90c7286cb5e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:55.824256 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d00d691-b64a-47fa-bdee-90c7286cb5e6 service nova] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:55.831272 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42269aba-1b87-479c-8fa8-ae276d004dc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:55.832049 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42269aba-1b87-479c-8fa8-ae276d004dc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:55.832432 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42269aba-1b87-479c-8fa8-ae276d004dc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:55.832749 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42269aba-1b87-479c-8fa8-ae276d004dc6 admin admin] PATH_INFO: `/v3/projects/82eba1107f964639b656be3d52e9c216` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:55.839316 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42269aba-1b87-479c-8fa8-ae276d004dc6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=82eba1107f964639b656be3d52e9c216)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:55.841426 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42269aba-1b87-479c-8fa8-ae276d004dc6 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:55.862824 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 923/1845] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:33:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:33:55.991245 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-42269aba-1b87-479c-8fa8-ae276d004dc6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82eba1107f964639b656be3d52e9c216', 'request_id': 'req-42269aba-1b87-479c-8fa8-ae276d004dc6'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:33:56.011952 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-42269aba-1b87-479c-8fa8-ae276d004dc6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82eba1107f964639b656be3d52e9c216', 'request_id': 'req-42269aba-1b87-479c-8fa8-ae276d004dc6'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:33:56.042967 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:56.047897 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-42269aba-1b87-479c-8fa8-ae276d004dc6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82eba1107f964639b656be3d52e9c216', 'request_id': 'req-42269aba-1b87-479c-8fa8-ae276d004dc6'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:33:56.082256 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-42269aba-1b87-479c-8fa8-ae276d004dc6 admin admin] The token cache is being invalidate because project 82eba1107f964639b656be3d52e9c216 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:33:56.083308 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-42269aba-1b87-479c-8fa8-ae276d004dc6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:33:56.090857 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-42269aba-1b87-479c-8fa8-ae276d004dc6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:33:56.092890 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 923/1846] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 11:33:55 2022] DELETE /identity/v3/projects/82eba1107f964639b656be3d52e9c216 => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 11:33:56.097418 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d00d691-b64a-47fa-bdee-90c7286cb5e6 service nova] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:56.120312 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d00d691-b64a-47fa-bdee-90c7286cb5e6 service nova] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:56.134944 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42269aba-1b87-479c-8fa8-ae276d004dc6 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:56.137052 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-42269aba-1b87-479c-8fa8-ae276d004dc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:56.335628 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073f4949-9ea9-4745-baac-f5f164f600b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:56.336993 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073f4949-9ea9-4745-baac-f5f164f600b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:56.338059 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073f4949-9ea9-4745-baac-f5f164f600b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:56.339966 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073f4949-9ea9-4745-baac-f5f164f600b6 admin admin] PATH_INFO: `/v3/users/6379980eb1e84a36959d73ecd1b2f09f` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:56.342334 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073f4949-9ea9-4745-baac-f5f164f600b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6379980eb1e84a36959d73ecd1b2f09f)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:56.350124 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073f4949-9ea9-4745-baac-f5f164f600b6 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:56.374884 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42269aba-1b87-479c-8fa8-ae276d004dc6 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:56.400329 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a75813a-1c84-421c-958e-6d29e6a1af62 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '282ec32864d046b2bea170f6a3845cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:56.401273 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a75813a-1c84-421c-958e-6d29e6a1af62 service nova] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:56.401708 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a75813a-1c84-421c-958e-6d29e6a1af62 service nova] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:56.402558 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a75813a-1c84-421c-958e-6d29e6a1af62 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:56.405777 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-6a75813a-1c84-421c-958e-6d29e6a1af62 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:56.477228 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-073f4949-9ea9-4745-baac-f5f164f600b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6379980eb1e84a36959d73ecd1b2f09f'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:33:56.478273 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-073f4949-9ea9-4745-baac-f5f164f600b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6379980eb1e84a36959d73ecd1b2f09f'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:33:56.479075 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-073f4949-9ea9-4745-baac-f5f164f600b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6379980eb1e84a36959d73ecd1b2f09f'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:33:56.503679 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-073f4949-9ea9-4745-baac-f5f164f600b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6379980eb1e84a36959d73ecd1b2f09f'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:33:56.528589 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-073f4949-9ea9-4745-baac-f5f164f600b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6379980eb1e84a36959d73ecd1b2f09f'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:33:56.544881 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a75813a-1c84-421c-958e-6d29e6a1af62 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:56.549437 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a75813a-1c84-421c-958e-6d29e6a1af62 service nova] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:56.566140 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 924/1847] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:33:56 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:33:56.569843 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 924/1848] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 11:33:56 2022] DELETE /identity/v3/users/6379980eb1e84a36959d73ecd1b2f09f => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 11:33:57.436032 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a75813a-1c84-421c-958e-6d29e6a1af62 service nova] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:57.437514 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-6a75813a-1c84-421c-958e-6d29e6a1af62 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:57.461867 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a75813a-1c84-421c-958e-6d29e6a1af62 service nova] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:57.704244 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1ead45-7fc7-40c9-970e-256e6367f16d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:57.704931 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1ead45-7fc7-40c9-970e-256e6367f16d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:57.705256 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1ead45-7fc7-40c9-970e-256e6367f16d admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:57.705545 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1ead45-7fc7-40c9-970e-256e6367f16d admin admin] PATH_INFO: `/v3/projects/4e0cbefc9bea41b7b7028022d3b2df0b` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:57.707532 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1ead45-7fc7-40c9-970e-256e6367f16d admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e0cbefc9bea41b7b7028022d3b2df0b)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:57.717984 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1ead45-7fc7-40c9-970e-256e6367f16d admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:57.817329 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:57.893462 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-3c1ead45-7fc7-40c9-970e-256e6367f16d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e0cbefc9bea41b7b7028022d3b2df0b', 'request_id': 'req-3c1ead45-7fc7-40c9-970e-256e6367f16d'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:33:57.918392 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-3c1ead45-7fc7-40c9-970e-256e6367f16d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e0cbefc9bea41b7b7028022d3b2df0b', 'request_id': 'req-3c1ead45-7fc7-40c9-970e-256e6367f16d'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:33:57.943011 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-3c1ead45-7fc7-40c9-970e-256e6367f16d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e0cbefc9bea41b7b7028022d3b2df0b', 'request_id': 'req-3c1ead45-7fc7-40c9-970e-256e6367f16d'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:33:57.972643 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-3c1ead45-7fc7-40c9-970e-256e6367f16d admin admin] The token cache is being invalidate because project 4e0cbefc9bea41b7b7028022d3b2df0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:33:57.972643 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-3c1ead45-7fc7-40c9-970e-256e6367f16d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:33:57.973929 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-3c1ead45-7fc7-40c9-970e-256e6367f16d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:33:57.987307 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 925/1849] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 11:33:57 2022] DELETE /identity/v3/projects/4e0cbefc9bea41b7b7028022d3b2df0b => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:33:57.988585 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e8e16e-e9ce-45da-b82d-916681b0d988 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:57.989063 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e8e16e-e9ce-45da-b82d-916681b0d988 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:57.989369 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e8e16e-e9ce-45da-b82d-916681b0d988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:58.080332 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-76e8e16e-e9ce-45da-b82d-916681b0d988 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:33:58.082624 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-76e8e16e-e9ce-45da-b82d-916681b0d988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:58.283125 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 925/1850] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:33:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:33:58.286101 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24a7e27-10bf-4064-a216-e9647d503b36 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:58.286648 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24a7e27-10bf-4064-a216-e9647d503b36 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:58.287138 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24a7e27-10bf-4064-a216-e9647d503b36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:58.332470 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-b24a7e27-10bf-4064-a216-e9647d503b36 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:33:58.337123 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-b24a7e27-10bf-4064-a216-e9647d503b36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:58.363994 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 926/1851] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:33:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:33:58.365138 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e8e16e-e9ce-45da-b82d-916681b0d988 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:58.388332 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e8e16e-e9ce-45da-b82d-916681b0d988 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:58.410642 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d026d2-479f-4d91-999c-17e58d305f8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:58.411613 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d026d2-479f-4d91-999c-17e58d305f8b admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:58.416810 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d026d2-479f-4d91-999c-17e58d305f8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:58.416810 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d026d2-479f-4d91-999c-17e58d305f8b admin admin] PATH_INFO: `/v3/domains` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:58.416810 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d026d2-479f-4d91-999c-17e58d305f8b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:58.416810 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d026d2-479f-4d91-999c-17e58d305f8b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:58.416810 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d026d2-479f-4d91-999c-17e58d305f8b admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:58.429821 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:58.439101 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 926/1852] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 24 11:33:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:33:58.440010 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24a7e27-10bf-4064-a216-e9647d503b36 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:58.454698 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24a7e27-10bf-4064-a216-e9647d503b36 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:58.463428 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcee335b-e395-4f9c-b862-063a8a2b2098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:58.464355 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcee335b-e395-4f9c-b862-063a8a2b2098 admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:58.464782 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcee335b-e395-4f9c-b862-063a8a2b2098 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:58.465190 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcee335b-e395-4f9c-b862-063a8a2b2098 admin admin] PATH_INFO: `/v3/projects` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:58.465979 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcee335b-e395-4f9c-b862-063a8a2b2098 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:58.468092 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcee335b-e395-4f9c-b862-063a8a2b2098 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:58.528136 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 927/1853] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 11:33:58 2022] POST /identity/v3/projects => generated 367 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:33:58.532529 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d026d2-479f-4d91-999c-17e58d305f8b admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:58.543805 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d026d2-479f-4d91-999c-17e58d305f8b admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:58.637885 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fe5107-fb1c-42cc-9c14-76ac1666eb3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:58.638469 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fe5107-fb1c-42cc-9c14-76ac1666eb3c admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:58.638777 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fe5107-fb1c-42cc-9c14-76ac1666eb3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:58.639020 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fe5107-fb1c-42cc-9c14-76ac1666eb3c admin admin] PATH_INFO: `/v3/users` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:58.639699 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fe5107-fb1c-42cc-9c14-76ac1666eb3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:58.642206 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fe5107-fb1c-42cc-9c14-76ac1666eb3c admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:58.672576 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 927/1854] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 11:33:58 2022] POST /identity/v3/users => generated 284 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:33:58.673833 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcee335b-e395-4f9c-b862-063a8a2b2098 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:58.698335 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcee335b-e395-4f9c-b862-063a8a2b2098 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:58.703239 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5c6238-128b-4c19-9fb5-e0f691262b10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:58.703883 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5c6238-128b-4c19-9fb5-e0f691262b10 admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:58.704162 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5c6238-128b-4c19-9fb5-e0f691262b10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:58.704445 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5c6238-128b-4c19-9fb5-e0f691262b10 admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:58.705256 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5c6238-128b-4c19-9fb5-e0f691262b10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:58.706890 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5c6238-128b-4c19-9fb5-e0f691262b10 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:58.721782 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 928/1855] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:33:58 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:33:58.724192 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fe5107-fb1c-42cc-9c14-76ac1666eb3c admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:58.737400 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fe5107-fb1c-42cc-9c14-76ac1666eb3c admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:58.744914 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6c9a84-23f4-4d5c-9774-9c9bda269c17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:58.745679 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6c9a84-23f4-4d5c-9774-9c9bda269c17 admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:58.745960 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6c9a84-23f4-4d5c-9774-9c9bda269c17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:58.746224 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6c9a84-23f4-4d5c-9774-9c9bda269c17 admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:58.746988 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6c9a84-23f4-4d5c-9774-9c9bda269c17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:58.748971 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6c9a84-23f4-4d5c-9774-9c9bda269c17 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:58.782818 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 928/1856] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:33:58 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:33:58.785041 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5c6238-128b-4c19-9fb5-e0f691262b10 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:58.806250 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5c6238-128b-4c19-9fb5-e0f691262b10 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:58.814260 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f294a52-0ed8-4892-ba55-5c8242b05e09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:58.816142 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f294a52-0ed8-4892-ba55-5c8242b05e09 admin admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:58.817062 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f294a52-0ed8-4892-ba55-5c8242b05e09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:58.817932 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f294a52-0ed8-4892-ba55-5c8242b05e09 admin admin] PATH_INFO: `/v3/projects/5fc897d2061747ca98b102e9ad9e852c/users/382eb3d8b75043e9a69f15a52ad35eaf/roles/27e3e65e24df4b86b0d3d18d3212101d` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:58.856015 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f294a52-0ed8-4892-ba55-5c8242b05e09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fc897d2061747ca98b102e9ad9e852c, user_id=382eb3d8b75043e9a69f15a52ad35eaf, role_id=27e3e65e24df4b86b0d3d18d3212101d)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:58.861000 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f294a52-0ed8-4892-ba55-5c8242b05e09 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:58.905988 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 929/1857] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 11:33:58 2022] PUT /identity/v3/projects/5fc897d2061747ca98b102e9ad9e852c/users/382eb3d8b75043e9a69f15a52ad35eaf/roles/27e3e65e24df4b86b0d3d18d3212101d => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:33:58.908152 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ae2212-2003-43df-a5bf-201c7a7cffd7 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:58.908565 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ae2212-2003-43df-a5bf-201c7a7cffd7 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:58.908904 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ae2212-2003-43df-a5bf-201c7a7cffd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:58.969603 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-86ae2212-2003-43df-a5bf-201c7a7cffd7 None None] MFA Rules not processed for user `382eb3d8b75043e9a69f15a52ad35eaf`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:33:58.972332 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-86ae2212-2003-43df-a5bf-201c7a7cffd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:59.103397 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 929/1858] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:33:58 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:33:59.108494 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f294a52-0ed8-4892-ba55-5c8242b05e09 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:59.263655 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ae2212-2003-43df-a5bf-201c7a7cffd7 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:59.265182 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-86ae2212-2003-43df-a5bf-201c7a7cffd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:59.292487 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f294a52-0ed8-4892-ba55-5c8242b05e09 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:59.304617 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffa744e-7654-4ca7-85a8-c99bc9c7b508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:59.305505 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffa744e-7654-4ca7-85a8-c99bc9c7b508 admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:59.305892 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffa744e-7654-4ca7-85a8-c99bc9c7b508 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:59.306172 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffa744e-7654-4ca7-85a8-c99bc9c7b508 admin admin] PATH_INFO: `/v3/projects` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:59.306926 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffa744e-7654-4ca7-85a8-c99bc9c7b508 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:59.311591 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ae2212-2003-43df-a5bf-201c7a7cffd7 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:59.313775 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffa744e-7654-4ca7-85a8-c99bc9c7b508 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:59.324675 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff93628-788f-49ed-be23-96663d353079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:59.325360 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff93628-788f-49ed-be23-96663d353079 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:59.325641 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff93628-788f-49ed-be23-96663d353079 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:59.325914 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff93628-788f-49ed-be23-96663d353079 admin admin] PATH_INFO: `/v3/projects/00b1f14e2fb745868f640058649dd427` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:59.330957 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff93628-788f-49ed-be23-96663d353079 admin admin] RBAC: Authorizing `identity:delete_project(project_id=00b1f14e2fb745868f640058649dd427)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:59.337699 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff93628-788f-49ed-be23-96663d353079 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:59.382931 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 930/1859] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 11:33:59 2022] POST /identity/v3/projects => generated 365 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:33:59.384029 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffa744e-7654-4ca7-85a8-c99bc9c7b508 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:59.486101 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-8ff93628-788f-49ed-be23-96663d353079 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00b1f14e2fb745868f640058649dd427', 'request_id': 'req-8ff93628-788f-49ed-be23-96663d353079'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:33:59.511192 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-8ff93628-788f-49ed-be23-96663d353079 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00b1f14e2fb745868f640058649dd427', 'request_id': 'req-8ff93628-788f-49ed-be23-96663d353079'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:33:59.511401 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:59.525721 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-8ff93628-788f-49ed-be23-96663d353079 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00b1f14e2fb745868f640058649dd427', 'request_id': 'req-8ff93628-788f-49ed-be23-96663d353079'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:33:59.529846 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:59.561292 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-8ff93628-788f-49ed-be23-96663d353079 admin admin] The token cache is being invalidate because project 00b1f14e2fb745868f640058649dd427 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81501) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:33:59.561292 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-8ff93628-788f-49ed-be23-96663d353079 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:33:59.561903 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-8ff93628-788f-49ed-be23-96663d353079 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:33:59.564435 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 930/1860] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 11:33:59 2022] DELETE /identity/v3/projects/00b1f14e2fb745868f640058649dd427 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:33:59.566862 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffa744e-7654-4ca7-85a8-c99bc9c7b508 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:59.570263 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8438d45-476d-4c6b-b779-fbd4fe010691 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:59.570608 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8438d45-476d-4c6b-b779-fbd4fe010691 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:59.570723 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8438d45-476d-4c6b-b779-fbd4fe010691 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:59.641697 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-b8438d45-476d-4c6b-b779-fbd4fe010691 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:33:59.643098 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-b8438d45-476d-4c6b-b779-fbd4fe010691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:59.737454 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb3768a-147f-40f7-a19c-bc3443f93ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:59.737911 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb3768a-147f-40f7-a19c-bc3443f93ec4 admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:59.738026 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb3768a-147f-40f7-a19c-bc3443f93ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:59.738296 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb3768a-147f-40f7-a19c-bc3443f93ec4 admin admin] PATH_INFO: `/v3/users` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:59.738982 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb3768a-147f-40f7-a19c-bc3443f93ec4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:59.740921 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb3768a-147f-40f7-a19c-bc3443f93ec4 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:59.816061 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 931/1861] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 11:33:59 2022] POST /identity/v3/users => generated 289 bytes in 432 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:33:59.826476 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb3768a-147f-40f7-a19c-bc3443f93ec4 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:59.826670 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 931/1862] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:33:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:33:59.833765 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9099a4f4-9a94-4676-a064-4d3be5b52992 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:59.834037 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9099a4f4-9a94-4676-a064-4d3be5b52992 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:59.834657 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9099a4f4-9a94-4676-a064-4d3be5b52992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:59.835844 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-cdb3768a-147f-40f7-a19c-bc3443f93ec4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:59.878582 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-9099a4f4-9a94-4676-a064-4d3be5b52992 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:33:59.883496 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-9099a4f4-9a94-4676-a064-4d3be5b52992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:59.886373 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb3768a-147f-40f7-a19c-bc3443f93ec4 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:59.912375 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 932/1863] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:33:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:33:59.916688 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9099a4f4-9a94-4676-a064-4d3be5b52992 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:59.921268 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f683f6e-ca51-441d-b1da-26a6def1adf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:59.924010 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f683f6e-ca51-441d-b1da-26a6def1adf4 admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:59.927484 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f683f6e-ca51-441d-b1da-26a6def1adf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:59.927974 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f683f6e-ca51-441d-b1da-26a6def1adf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:59.932411 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f683f6e-ca51-441d-b1da-26a6def1adf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:59.935624 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f683f6e-ca51-441d-b1da-26a6def1adf4 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:59.942395 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9099a4f4-9a94-4676-a064-4d3be5b52992 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:59.950512 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9fc1b0-8481-4acd-b4cd-f91242b02c7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:59.951276 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9fc1b0-8481-4acd-b4cd-f91242b02c7b admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:59.951625 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9fc1b0-8481-4acd-b4cd-f91242b02c7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:59.951935 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9fc1b0-8481-4acd-b4cd-f91242b02c7b admin admin] PATH_INFO: `/v3/domains` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:59.952963 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9fc1b0-8481-4acd-b4cd-f91242b02c7b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:59.952963 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9fc1b0-8481-4acd-b4cd-f91242b02c7b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:59.954548 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9fc1b0-8481-4acd-b4cd-f91242b02c7b admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:59.956843 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 932/1864] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:33:59 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:33:59.961830 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f683f6e-ca51-441d-b1da-26a6def1adf4 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:59.988296 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f683f6e-ca51-441d-b1da-26a6def1adf4 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:59.991638 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 933/1865] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 24 11:33:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:33:59.996172 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9fc1b0-8481-4acd-b4cd-f91242b02c7b admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:00.003741 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f6bdc9-2033-4258-8d27-0262222760d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:00.008028 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f6bdc9-2033-4258-8d27-0262222760d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:00.008678 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f6bdc9-2033-4258-8d27-0262222760d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:00.009239 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f6bdc9-2033-4258-8d27-0262222760d4 admin admin] PATH_INFO: `/v3/projects/c1d2be49e2cd49ecaa688b332f6bdbef/users/7b0669a9fa534d228343a35131266fda/roles/30bb1e97257f4ca5b90c88545777317b` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:00.009638 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9fc1b0-8481-4acd-b4cd-f91242b02c7b admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:00.015419 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14572fa-d924-4a43-952a-80ca3eb6f7be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:00.016088 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14572fa-d924-4a43-952a-80ca3eb6f7be admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:00.016525 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14572fa-d924-4a43-952a-80ca3eb6f7be admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:00.016813 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14572fa-d924-4a43-952a-80ca3eb6f7be admin admin] PATH_INFO: `/v3/projects` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:00.017444 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14572fa-d924-4a43-952a-80ca3eb6f7be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:00.019962 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14572fa-d924-4a43-952a-80ca3eb6f7be admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:00.049236 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f6bdc9-2033-4258-8d27-0262222760d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1d2be49e2cd49ecaa688b332f6bdbef, user_id=7b0669a9fa534d228343a35131266fda, role_id=30bb1e97257f4ca5b90c88545777317b)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:00.057836 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f6bdc9-2033-4258-8d27-0262222760d4 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:00.062096 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 934/1866] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 11:33:59 2022] POST /identity/v3/projects => generated 387 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:34:00.066121 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14572fa-d924-4a43-952a-80ca3eb6f7be admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:00.076687 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 933/1867] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 11:33:59 2022] PUT /identity/v3/projects/c1d2be49e2cd49ecaa688b332f6bdbef/users/7b0669a9fa534d228343a35131266fda/roles/30bb1e97257f4ca5b90c88545777317b => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:34:00.082897 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f6bdc9-2033-4258-8d27-0262222760d4 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:00.223922 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14572fa-d924-4a43-952a-80ca3eb6f7be admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:00.270969 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f6bdc9-2033-4258-8d27-0262222760d4 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:00.283203 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f24f33-a8ea-4156-b5c8-8e872815c11d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:00.284164 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f24f33-a8ea-4156-b5c8-8e872815c11d admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:00.285394 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f24f33-a8ea-4156-b5c8-8e872815c11d admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:00.285702 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f24f33-a8ea-4156-b5c8-8e872815c11d admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:00.288826 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f24f33-a8ea-4156-b5c8-8e872815c11d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:00.291554 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f24f33-a8ea-4156-b5c8-8e872815c11d admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:00.310916 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 934/1868] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:34:00 2022] GET /identity/v3/roles => generated 1420 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:34:00.315267 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f24f33-a8ea-4156-b5c8-8e872815c11d admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:00.315827 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:INSERT=2,keystone:DELETE=1,keystone:SELECT=97 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:00.333567 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f24f33-a8ea-4156-b5c8-8e872815c11d admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:00.333827 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314b2d57-5e03-401e-9250-1d744e4ed032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:00.335463 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314b2d57-5e03-401e-9250-1d744e4ed032 admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:00.339780 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4224189c-0847-4659-a46e-7619ba2fb14b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:00.340417 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314b2d57-5e03-401e-9250-1d744e4ed032 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:00.340776 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4224189c-0847-4659-a46e-7619ba2fb14b admin admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:00.340936 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4224189c-0847-4659-a46e-7619ba2fb14b admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:00.341277 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4224189c-0847-4659-a46e-7619ba2fb14b admin admin] PATH_INFO: `/v3/projects/c1d2be49e2cd49ecaa688b332f6bdbef/users/7b0669a9fa534d228343a35131266fda/roles/30bb1e97257f4ca5b90c88545777317b` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:00.343381 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314b2d57-5e03-401e-9250-1d744e4ed032 admin admin] PATH_INFO: `/v3/users` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:00.344147 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314b2d57-5e03-401e-9250-1d744e4ed032 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:00.346469 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4224189c-0847-4659-a46e-7619ba2fb14b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1d2be49e2cd49ecaa688b332f6bdbef, user_id=7b0669a9fa534d228343a35131266fda, role_id=30bb1e97257f4ca5b90c88545777317b)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:00.349112 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4224189c-0847-4659-a46e-7619ba2fb14b admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:00.358882 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314b2d57-5e03-401e-9250-1d744e4ed032 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:00.375698 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 935/1869] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 11:34:00 2022] PUT /identity/v3/projects/c1d2be49e2cd49ecaa688b332f6bdbef/users/7b0669a9fa534d228343a35131266fda/roles/30bb1e97257f4ca5b90c88545777317b => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 11:34:00.391267 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c41fe0d-7078-4316-8586-981af261fda2 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:00.392320 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c41fe0d-7078-4316-8586-981af261fda2 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:00.393276 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c41fe0d-7078-4316-8586-981af261fda2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:00.408274 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 935/1870] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 11:34:00 2022] POST /identity/v3/users => generated 294 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:34:00.413242 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314b2d57-5e03-401e-9250-1d744e4ed032 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:00.440172 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314b2d57-5e03-401e-9250-1d744e4ed032 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:00.465581 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-3c41fe0d-7078-4316-8586-981af261fda2 None None] MFA Rules not processed for user `7b0669a9fa534d228343a35131266fda`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:34:00.467334 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-3c41fe0d-7078-4316-8586-981af261fda2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:00.483812 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:00.619915 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ab3584-63e8-48d7-ba7f-698aa545a93f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:00.620752 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ab3584-63e8-48d7-ba7f-698aa545a93f admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:00.621089 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ab3584-63e8-48d7-ba7f-698aa545a93f admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:00.621291 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ab3584-63e8-48d7-ba7f-698aa545a93f admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:00.626757 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ab3584-63e8-48d7-ba7f-698aa545a93f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:00.629230 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ab3584-63e8-48d7-ba7f-698aa545a93f admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:00.647321 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 936/1871] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:34:00 2022] GET /identity/v3/roles => generated 1420 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:34:00.651111 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ab3584-63e8-48d7-ba7f-698aa545a93f admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:00.666183 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ab3584-63e8-48d7-ba7f-698aa545a93f admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:00.683485 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2809d1-0669-4b72-a705-6511db8525f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:00.684394 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2809d1-0669-4b72-a705-6511db8525f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:00.686852 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2809d1-0669-4b72-a705-6511db8525f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:00.687432 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2809d1-0669-4b72-a705-6511db8525f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:00.688428 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2809d1-0669-4b72-a705-6511db8525f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:00.695289 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2809d1-0669-4b72-a705-6511db8525f9 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:00.716199 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 936/1872] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:34:00 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:34:00.726459 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 937/1873] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:34:00 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 11:34:00.733208 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c41fe0d-7078-4316-8586-981af261fda2 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:00.734218 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2809d1-0669-4b72-a705-6511db8525f9 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:00.737506 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-7b2809d1-0669-4b72-a705-6511db8525f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:00.773703 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c41fe0d-7078-4316-8586-981af261fda2 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:00.804521 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78587255-424b-40fc-ad54-0aeefc003256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:00.809599 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78587255-424b-40fc-ad54-0aeefc003256 admin admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:00.812760 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78587255-424b-40fc-ad54-0aeefc003256 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:00.813808 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78587255-424b-40fc-ad54-0aeefc003256 admin admin] PATH_INFO: `/v3/projects/6de59514ef9547c6b3261e304e941182/users/21d610f26cba45e3bc3844162fa98492/roles/27e3e65e24df4b86b0d3d18d3212101d` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:00.879853 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78587255-424b-40fc-ad54-0aeefc003256 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6de59514ef9547c6b3261e304e941182, user_id=21d610f26cba45e3bc3844162fa98492, role_id=27e3e65e24df4b86b0d3d18d3212101d)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:00.893955 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78587255-424b-40fc-ad54-0aeefc003256 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:00.898932 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2809d1-0669-4b72-a705-6511db8525f9 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:00.904419 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc0f603-c983-485f-8f6a-c47e67f71d1e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92862b76ba3b4513b5dc5b5c962faac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:00.905990 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc0f603-c983-485f-8f6a-c47e67f71d1e service cinder] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:00.906395 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc0f603-c983-485f-8f6a-c47e67f71d1e service cinder] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:00.906729 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc0f603-c983-485f-8f6a-c47e67f71d1e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:00.929861 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc0f603-c983-485f-8f6a-c47e67f71d1e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:00.932177 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc0f603-c983-485f-8f6a-c47e67f71d1e service cinder] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:00.950406 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 937/1874] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 11:34:00 2022] PUT /identity/v3/projects/6de59514ef9547c6b3261e304e941182/users/21d610f26cba45e3bc3844162fa98492/roles/27e3e65e24df4b86b0d3d18d3212101d => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:34:00.957116 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f95971b-b384-43e9-8a5e-c0ee10d53864 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:00.957697 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f95971b-b384-43e9-8a5e-c0ee10d53864 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:00.957886 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 938/1875] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:34:00 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:34:00.958433 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f95971b-b384-43e9-8a5e-c0ee10d53864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:01.023466 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-2f95971b-b384-43e9-8a5e-c0ee10d53864 None None] MFA Rules not processed for user `21d610f26cba45e3bc3844162fa98492`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:34:01.025195 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-2f95971b-b384-43e9-8a5e-c0ee10d53864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:01.141191 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc0f603-c983-485f-8f6a-c47e67f71d1e service cinder] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:01.164552 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc0f603-c983-485f-8f6a-c47e67f71d1e service cinder] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:01.168837 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 938/1876] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:34:00 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 11:34:01.173731 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f95971b-b384-43e9-8a5e-c0ee10d53864 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:01.338097 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433a12f6-d585-473d-8366-bbc4d6ae057a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92862b76ba3b4513b5dc5b5c962faac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:01.340443 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433a12f6-d585-473d-8366-bbc4d6ae057a service cinder] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:01.340733 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433a12f6-d585-473d-8366-bbc4d6ae057a service cinder] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:01.341013 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433a12f6-d585-473d-8366-bbc4d6ae057a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:01.345586 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-433a12f6-d585-473d-8366-bbc4d6ae057a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:01.365278 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f95971b-b384-43e9-8a5e-c0ee10d53864 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:01.382811 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb81187-af81-4b22-8fac-679f195a6cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:01.383451 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb81187-af81-4b22-8fac-679f195a6cc7 admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:01.383732 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb81187-af81-4b22-8fac-679f195a6cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:01.385004 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb81187-af81-4b22-8fac-679f195a6cc7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:01.388166 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb81187-af81-4b22-8fac-679f195a6cc7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:01.396800 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb81187-af81-4b22-8fac-679f195a6cc7 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:01.430247 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:01.460968 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:01.486813 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 939/1877] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 11:34:01 2022] POST /identity/v3/projects => generated 385 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 11:34:01.491332 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb81187-af81-4b22-8fac-679f195a6cc7 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:01.498723 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433a12f6-d585-473d-8366-bbc4d6ae057a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:01.500628 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433a12f6-d585-473d-8366-bbc4d6ae057a service cinder] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:01.534103 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 939/1878] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:34:01 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:34:01.693950 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb81187-af81-4b22-8fac-679f195a6cc7 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:01.707179 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af1501f-f705-4c04-9b6d-8e4e0aabfc14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:01.707853 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af1501f-f705-4c04-9b6d-8e4e0aabfc14 admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:01.708290 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af1501f-f705-4c04-9b6d-8e4e0aabfc14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:01.708400 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af1501f-f705-4c04-9b6d-8e4e0aabfc14 admin admin] PATH_INFO: `/v3/users` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:01.709195 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af1501f-f705-4c04-9b6d-8e4e0aabfc14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:01.713739 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af1501f-f705-4c04-9b6d-8e4e0aabfc14 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:01.757281 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433a12f6-d585-473d-8366-bbc4d6ae057a service cinder] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:01.766999 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 940/1879] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 11:34:01 2022] POST /identity/v3/users => generated 293 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:34:01.772289 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433a12f6-d585-473d-8366-bbc4d6ae057a service cinder] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:01.777923 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f4b2d4-4cd1-4de9-8f61-7c83d59343ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:01.778711 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f4b2d4-4cd1-4de9-8f61-7c83d59343ca admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:01.779090 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f4b2d4-4cd1-4de9-8f61-7c83d59343ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:01.779662 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f4b2d4-4cd1-4de9-8f61-7c83d59343ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:01.780720 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f4b2d4-4cd1-4de9-8f61-7c83d59343ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:01.782984 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f4b2d4-4cd1-4de9-8f61-7c83d59343ca admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:01.810014 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 940/1880] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:34:01 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:34:01.810597 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af1501f-f705-4c04-9b6d-8e4e0aabfc14 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:01.832606 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af1501f-f705-4c04-9b6d-8e4e0aabfc14 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:01.839630 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc89aa8-0b48-492e-8274-f71a47c81b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:01.840465 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc89aa8-0b48-492e-8274-f71a47c81b0c admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:01.840827 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc89aa8-0b48-492e-8274-f71a47c81b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:01.841190 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc89aa8-0b48-492e-8274-f71a47c81b0c admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:01.842164 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc89aa8-0b48-492e-8274-f71a47c81b0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:01.863519 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc89aa8-0b48-492e-8274-f71a47c81b0c admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:01.884569 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 941/1881] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:34:01 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 11:34:01.894902 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f4b2d4-4cd1-4de9-8f61-7c83d59343ca admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:01.909897 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f4b2d4-4cd1-4de9-8f61-7c83d59343ca admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:01.925873 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f74a85-a63f-4249-b3be-c09e9da14649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:01.927455 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f74a85-a63f-4249-b3be-c09e9da14649 admin admin] REQUEST_METHOD: `PUT` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:01.928683 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f74a85-a63f-4249-b3be-c09e9da14649 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:01.929783 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f74a85-a63f-4249-b3be-c09e9da14649 admin admin] PATH_INFO: `/v3/projects/4d2dc848e5c14df4b731d35686650f4d/users/96a49d068b6842f482f1814a024db1b7/roles/27e3e65e24df4b86b0d3d18d3212101d` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:01.988103 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f74a85-a63f-4249-b3be-c09e9da14649 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d2dc848e5c14df4b731d35686650f4d, user_id=96a49d068b6842f482f1814a024db1b7, role_id=27e3e65e24df4b86b0d3d18d3212101d)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:02.003468 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f74a85-a63f-4249-b3be-c09e9da14649 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:02.064481 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 941/1882] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 11:34:01 2022] PUT /identity/v3/projects/4d2dc848e5c14df4b731d35686650f4d/users/96a49d068b6842f482f1814a024db1b7/roles/27e3e65e24df4b86b0d3d18d3212101d => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:34:02.088342 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f723e898-72c1-489a-94c3-0153a573154e None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:02.089799 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f723e898-72c1-489a-94c3-0153a573154e None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:02.089799 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f723e898-72c1-489a-94c3-0153a573154e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:02.174889 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-f723e898-72c1-489a-94c3-0153a573154e None None] MFA Rules not processed for user `96a49d068b6842f482f1814a024db1b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:34:02.177403 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-f723e898-72c1-489a-94c3-0153a573154e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:02.304071 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 942/1883] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:34:02 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:34:02.308749 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f74a85-a63f-4249-b3be-c09e9da14649 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:02.399436 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f74a85-a63f-4249-b3be-c09e9da14649 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:02.406694 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a173c7f2-2981-4575-951b-d65d560498e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:02.407528 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a173c7f2-2981-4575-951b-d65d560498e4 admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:02.407941 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a173c7f2-2981-4575-951b-d65d560498e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:02.408377 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a173c7f2-2981-4575-951b-d65d560498e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:02.409727 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a173c7f2-2981-4575-951b-d65d560498e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:02.412365 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a173c7f2-2981-4575-951b-d65d560498e4 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:02.440986 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 942/1884] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 11:34:02 2022] POST /identity/v3/projects => generated 385 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:34:02.445288 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f723e898-72c1-489a-94c3-0153a573154e None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:02.460889 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f723e898-72c1-489a-94c3-0153a573154e None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:02.536160 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f685ccb-2549-4eb3-8b97-9b554fe7de6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:02.536922 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f685ccb-2549-4eb3-8b97-9b554fe7de6a admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:02.537293 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f685ccb-2549-4eb3-8b97-9b554fe7de6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:02.537657 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f685ccb-2549-4eb3-8b97-9b554fe7de6a admin admin] PATH_INFO: `/v3/users` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:02.538539 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f685ccb-2549-4eb3-8b97-9b554fe7de6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:02.541577 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f685ccb-2549-4eb3-8b97-9b554fe7de6a admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:02.557373 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:02.578763 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 943/1885] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 11:34:02 2022] POST /identity/v3/users => generated 299 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 11:34:02.580380 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a173c7f2-2981-4575-951b-d65d560498e4 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:02.601053 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a173c7f2-2981-4575-951b-d65d560498e4 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:02.608025 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e91f0b2-4a71-4f0b-9a6c-42c7b1297236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:02.608689 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e91f0b2-4a71-4f0b-9a6c-42c7b1297236 admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:02.609146 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e91f0b2-4a71-4f0b-9a6c-42c7b1297236 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:02.609656 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e91f0b2-4a71-4f0b-9a6c-42c7b1297236 admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:02.610448 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e91f0b2-4a71-4f0b-9a6c-42c7b1297236 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:02.612518 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e91f0b2-4a71-4f0b-9a6c-42c7b1297236 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:02.630398 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 943/1886] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:34:02 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:34:02.633469 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f685ccb-2549-4eb3-8b97-9b554fe7de6a admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:02.647337 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f685ccb-2549-4eb3-8b97-9b554fe7de6a admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:02.652807 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d983f2-9c93-427a-8094-dfb1b1881d3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:02.653753 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d983f2-9c93-427a-8094-dfb1b1881d3e admin admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:02.654096 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d983f2-9c93-427a-8094-dfb1b1881d3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:02.654468 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d983f2-9c93-427a-8094-dfb1b1881d3e admin admin] PATH_INFO: `/v3/projects/a9a32ef73a244cd5b70280ae9fa1e13b/users/381996f8198c4420abeead81a4aaf84f/roles/30bb1e97257f4ca5b90c88545777317b` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:02.699551 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d983f2-9c93-427a-8094-dfb1b1881d3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9a32ef73a244cd5b70280ae9fa1e13b, user_id=381996f8198c4420abeead81a4aaf84f, role_id=30bb1e97257f4ca5b90c88545777317b)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:02.707154 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d983f2-9c93-427a-8094-dfb1b1881d3e admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:02.737552 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 944/1887] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 11:34:02 2022] PUT /identity/v3/projects/a9a32ef73a244cd5b70280ae9fa1e13b/users/381996f8198c4420abeead81a4aaf84f/roles/30bb1e97257f4ca5b90c88545777317b => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:34:02.741840 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e91f0b2-4a71-4f0b-9a6c-42c7b1297236 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:02.752892 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e91f0b2-4a71-4f0b-9a6c-42c7b1297236 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:02.855334 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b64606b-d3ab-4047-b4bf-19b1dae50afd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:02.855689 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b64606b-d3ab-4047-b4bf-19b1dae50afd admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:02.856066 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b64606b-d3ab-4047-b4bf-19b1dae50afd admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:02.856482 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b64606b-d3ab-4047-b4bf-19b1dae50afd admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:02.857385 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b64606b-d3ab-4047-b4bf-19b1dae50afd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:02.859737 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b64606b-d3ab-4047-b4bf-19b1dae50afd admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:02.877328 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 944/1888] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:34:02 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:34:02.879849 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d983f2-9c93-427a-8094-dfb1b1881d3e admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:02.891297 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d983f2-9c93-427a-8094-dfb1b1881d3e admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:02.896259 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df84726-df5a-432f-b267-1fe3b785f163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:02.896998 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df84726-df5a-432f-b267-1fe3b785f163 admin admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:02.897338 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df84726-df5a-432f-b267-1fe3b785f163 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:02.897674 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df84726-df5a-432f-b267-1fe3b785f163 admin admin] PATH_INFO: `/v3/projects/a9a32ef73a244cd5b70280ae9fa1e13b/users/381996f8198c4420abeead81a4aaf84f/roles/30bb1e97257f4ca5b90c88545777317b` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:02.899704 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df84726-df5a-432f-b267-1fe3b785f163 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9a32ef73a244cd5b70280ae9fa1e13b, user_id=381996f8198c4420abeead81a4aaf84f, role_id=30bb1e97257f4ca5b90c88545777317b)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:02.902458 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df84726-df5a-432f-b267-1fe3b785f163 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:02.913126 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 945/1889] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 11:34:02 2022] PUT /identity/v3/projects/a9a32ef73a244cd5b70280ae9fa1e13b/users/381996f8198c4420abeead81a4aaf84f/roles/30bb1e97257f4ca5b90c88545777317b => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:34:02.923890 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d116f5-3d8b-4836-98f3-116ce1296872 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:02.924175 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d116f5-3d8b-4836-98f3-116ce1296872 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:02.924512 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d116f5-3d8b-4836-98f3-116ce1296872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:02.932645 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:02.953631 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-88d116f5-3d8b-4836-98f3-116ce1296872 None None] MFA Rules not processed for user `381996f8198c4420abeead81a4aaf84f`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:34:02.955089 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-88d116f5-3d8b-4836-98f3-116ce1296872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:03.044137 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 945/1890] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:34:02 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:34:03.055122 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df84726-df5a-432f-b267-1fe3b785f163 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:03.056974 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-9df84726-df5a-432f-b267-1fe3b785f163 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:03.098854 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2bddf3-485b-4629-9c93-c3df6411510f None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:03.099080 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2bddf3-485b-4629-9c93-c3df6411510f None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:03.099450 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2bddf3-485b-4629-9c93-c3df6411510f None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:03.101098 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 946/1891] 10.222.0.27 () {54 vars in 921 bytes} [Wed Aug 24 11:34:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:34:03.118678 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d686a3-02b0-4d88-8ab7-f3b825249406 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:03.119576 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d686a3-02b0-4d88-8ab7-f3b825249406 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:03.120458 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d686a3-02b0-4d88-8ab7-f3b825249406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:03.126866 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df84726-df5a-432f-b267-1fe3b785f163 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:03.131481 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bf6d04-a2dd-4ed1-ac30-9d3ce32ec8d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92862b76ba3b4513b5dc5b5c962faac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:03.132366 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bf6d04-a2dd-4ed1-ac30-9d3ce32ec8d4 service cinder] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:03.132647 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bf6d04-a2dd-4ed1-ac30-9d3ce32ec8d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:03.132982 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bf6d04-a2dd-4ed1-ac30-9d3ce32ec8d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:03.145512 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bf6d04-a2dd-4ed1-ac30-9d3ce32ec8d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:03.147263 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bf6d04-a2dd-4ed1-ac30-9d3ce32ec8d4 service cinder] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:03.151872 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-f2d686a3-02b0-4d88-8ab7-f3b825249406 None None] MFA Rules not processed for user `282ec32864d046b2bea170f6a3845cc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:34:03.153872 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-f2d686a3-02b0-4d88-8ab7-f3b825249406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:03.171906 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 946/1892] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:34:03 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:34:03.310841 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 947/1893] 10.222.0.27 () {58 vars in 1018 bytes} [Wed Aug 24 11:34:03 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 11:34:03.405957 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bf6d04-a2dd-4ed1-ac30-9d3ce32ec8d4 service cinder] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:03.407591 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-08bf6d04-a2dd-4ed1-ac30-9d3ce32ec8d4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:03.425115 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bf6d04-a2dd-4ed1-ac30-9d3ce32ec8d4 service cinder] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:03.433545 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab51e570-2287-4ba1-978b-95ade71cbc38 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '282ec32864d046b2bea170f6a3845cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:03.434298 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab51e570-2287-4ba1-978b-95ade71cbc38 service nova] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:03.434613 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab51e570-2287-4ba1-978b-95ade71cbc38 service nova] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:03.434884 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab51e570-2287-4ba1-978b-95ade71cbc38 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:03.454601 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab51e570-2287-4ba1-978b-95ade71cbc38 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:03.456358 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab51e570-2287-4ba1-978b-95ade71cbc38 service nova] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:03.469220 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 947/1894] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:34:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:34:04.009742 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d686a3-02b0-4d88-8ab7-f3b825249406 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:04.019624 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d686a3-02b0-4d88-8ab7-f3b825249406 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:04.023863 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4d92d8-3cc2-4c07-b6c0-009718bfe5f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92862b76ba3b4513b5dc5b5c962faac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:04.024569 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4d92d8-3cc2-4c07-b6c0-009718bfe5f0 service cinder] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:04.024939 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4d92d8-3cc2-4c07-b6c0-009718bfe5f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:04.025277 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4d92d8-3cc2-4c07-b6c0-009718bfe5f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:04.108371 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4d92d8-3cc2-4c07-b6c0-009718bfe5f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:04.109900 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4d92d8-3cc2-4c07-b6c0-009718bfe5f0 service cinder] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:04.135698 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 948/1895] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:34:04 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:34:06.317671 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab51e570-2287-4ba1-978b-95ade71cbc38 service nova] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:06.321432 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-ab51e570-2287-4ba1-978b-95ade71cbc38 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:06.405170 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab51e570-2287-4ba1-978b-95ade71cbc38 service nova] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:06.411639 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f63e29-722c-4fc8-81f8-58929bbd8b80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:06.413136 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f63e29-722c-4fc8-81f8-58929bbd8b80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:06.413527 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f63e29-722c-4fc8-81f8-58929bbd8b80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:06.413878 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f63e29-722c-4fc8-81f8-58929bbd8b80 admin admin] PATH_INFO: `/v3/users/db180cf75f684ff78ca1c7cecdf595ab` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:06.415266 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f63e29-722c-4fc8-81f8-58929bbd8b80 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db180cf75f684ff78ca1c7cecdf595ab)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:06.417563 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f63e29-722c-4fc8-81f8-58929bbd8b80 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:06.516112 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-19f63e29-722c-4fc8-81f8-58929bbd8b80 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db180cf75f684ff78ca1c7cecdf595ab'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:06.517738 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-19f63e29-722c-4fc8-81f8-58929bbd8b80 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db180cf75f684ff78ca1c7cecdf595ab'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:06.524913 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:06.534894 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-19f63e29-722c-4fc8-81f8-58929bbd8b80 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db180cf75f684ff78ca1c7cecdf595ab'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:06.550670 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-19f63e29-722c-4fc8-81f8-58929bbd8b80 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db180cf75f684ff78ca1c7cecdf595ab'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:06.553244 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-19f63e29-722c-4fc8-81f8-58929bbd8b80 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db180cf75f684ff78ca1c7cecdf595ab'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:06.574407 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 948/1896] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 11:34:06 2022] DELETE /identity/v3/users/db180cf75f684ff78ca1c7cecdf595ab => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:34:06.579181 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e0d10e-63ce-492a-8e92-87e88e254b83 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:06.579660 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e0d10e-63ce-492a-8e92-87e88e254b83 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:06.579848 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e0d10e-63ce-492a-8e92-87e88e254b83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:06.599226 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-f3e0d10e-63ce-492a-8e92-87e88e254b83 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:34:06.600487 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-f3e0d10e-63ce-492a-8e92-87e88e254b83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:06.615679 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:06.668403 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 949/1897] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:34:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:34:06.683754 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f63e29-722c-4fc8-81f8-58929bbd8b80 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:06.692173 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-19f63e29-722c-4fc8-81f8-58929bbd8b80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:06.773615 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f63e29-722c-4fc8-81f8-58929bbd8b80 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:06.777354 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce99cb00-5865-4186-8169-219c955e06c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2d061d25d83443c9232218c90792d51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:06.777980 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce99cb00-5865-4186-8169-219c955e06c0 service neutron] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:06.778264 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce99cb00-5865-4186-8169-219c955e06c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:06.778828 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce99cb00-5865-4186-8169-219c955e06c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:06.792303 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce99cb00-5865-4186-8169-219c955e06c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:06.793783 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce99cb00-5865-4186-8169-219c955e06c0 service neutron] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:06.805580 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 949/1898] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:34:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:34:07.136745 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e0d10e-63ce-492a-8e92-87e88e254b83 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:07.138777 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-f3e0d10e-63ce-492a-8e92-87e88e254b83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:07.161639 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e0d10e-63ce-492a-8e92-87e88e254b83 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:07.166841 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55578ea1-fe51-4416-9703-5ddb18c87b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:07.167781 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55578ea1-fe51-4416-9703-5ddb18c87b76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:07.168267 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55578ea1-fe51-4416-9703-5ddb18c87b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:07.168747 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55578ea1-fe51-4416-9703-5ddb18c87b76 admin admin] PATH_INFO: `/v3/projects/a48e3eafe65d42e29331f8170cc7b133` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:07.170055 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55578ea1-fe51-4416-9703-5ddb18c87b76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a48e3eafe65d42e29331f8170cc7b133)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:07.172215 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55578ea1-fe51-4416-9703-5ddb18c87b76 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:07.341845 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-55578ea1-fe51-4416-9703-5ddb18c87b76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a48e3eafe65d42e29331f8170cc7b133', 'request_id': 'req-55578ea1-fe51-4416-9703-5ddb18c87b76'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:07.360486 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-55578ea1-fe51-4416-9703-5ddb18c87b76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a48e3eafe65d42e29331f8170cc7b133', 'request_id': 'req-55578ea1-fe51-4416-9703-5ddb18c87b76'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:07.371616 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-55578ea1-fe51-4416-9703-5ddb18c87b76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a48e3eafe65d42e29331f8170cc7b133', 'request_id': 'req-55578ea1-fe51-4416-9703-5ddb18c87b76'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:07.496809 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-55578ea1-fe51-4416-9703-5ddb18c87b76 admin admin] The token cache is being invalidate because project a48e3eafe65d42e29331f8170cc7b133 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81501) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:34:07.497593 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-55578ea1-fe51-4416-9703-5ddb18c87b76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:07.498167 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-55578ea1-fe51-4416-9703-5ddb18c87b76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:07.500369 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 950/1899] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 11:34:07 2022] DELETE /identity/v3/projects/a48e3eafe65d42e29331f8170cc7b133 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:34:07.504430 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce99cb00-5865-4186-8169-219c955e06c0 service neutron] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:07.514907 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce99cb00-5865-4186-8169-219c955e06c0 service neutron] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:07.653845 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55578ea1-fe51-4416-9703-5ddb18c87b76 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:07.655944 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6092f41f-8093-4b9c-9ac2-85923de6958b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:07.656106 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-55578ea1-fe51-4416-9703-5ddb18c87b76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:07.656923 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6092f41f-8093-4b9c-9ac2-85923de6958b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:07.657317 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6092f41f-8093-4b9c-9ac2-85923de6958b admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:07.657601 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6092f41f-8093-4b9c-9ac2-85923de6958b admin admin] PATH_INFO: `/v3/users/779d269ee26249e19c54d9b90c10a2a6` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:07.658925 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6092f41f-8093-4b9c-9ac2-85923de6958b admin admin] RBAC: Authorizing `identity:delete_user(user_id=779d269ee26249e19c54d9b90c10a2a6)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:07.660873 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6092f41f-8093-4b9c-9ac2-85923de6958b admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:07.680480 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55578ea1-fe51-4416-9703-5ddb18c87b76 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:07.703346 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a5650d-d1bd-47eb-b828-ea993928b7b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:07.705360 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a5650d-d1bd-47eb-b828-ea993928b7b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:07.705662 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a5650d-d1bd-47eb-b828-ea993928b7b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:07.705962 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a5650d-d1bd-47eb-b828-ea993928b7b8 admin admin] PATH_INFO: `/v3/users/382eb3d8b75043e9a69f15a52ad35eaf` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:07.711663 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a5650d-d1bd-47eb-b828-ea993928b7b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=382eb3d8b75043e9a69f15a52ad35eaf)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:07.713910 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a5650d-d1bd-47eb-b828-ea993928b7b8 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:07.761721 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-6092f41f-8093-4b9c-9ac2-85923de6958b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '779d269ee26249e19c54d9b90c10a2a6'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:07.762678 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-6092f41f-8093-4b9c-9ac2-85923de6958b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '779d269ee26249e19c54d9b90c10a2a6'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:07.774953 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-6092f41f-8093-4b9c-9ac2-85923de6958b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '779d269ee26249e19c54d9b90c10a2a6'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:07.795472 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-6092f41f-8093-4b9c-9ac2-85923de6958b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '779d269ee26249e19c54d9b90c10a2a6'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:07.796355 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-6092f41f-8093-4b9c-9ac2-85923de6958b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '779d269ee26249e19c54d9b90c10a2a6'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:07.799943 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-70a5650d-d1bd-47eb-b828-ea993928b7b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '382eb3d8b75043e9a69f15a52ad35eaf'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:07.800602 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-70a5650d-d1bd-47eb-b828-ea993928b7b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '382eb3d8b75043e9a69f15a52ad35eaf'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:07.801220 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-70a5650d-d1bd-47eb-b828-ea993928b7b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '382eb3d8b75043e9a69f15a52ad35eaf'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:07.807880 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:07.818457 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-70a5650d-d1bd-47eb-b828-ea993928b7b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '382eb3d8b75043e9a69f15a52ad35eaf'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:07.828531 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 950/1900] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 11:34:07 2022] DELETE /identity/v3/users/779d269ee26249e19c54d9b90c10a2a6 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:34:07.830801 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-70a5650d-d1bd-47eb-b828-ea993928b7b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '382eb3d8b75043e9a69f15a52ad35eaf'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:07.851155 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 951/1901] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 11:34:07 2022] DELETE /identity/v3/users/382eb3d8b75043e9a69f15a52ad35eaf => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 11:34:07.855710 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061e3418-dbce-4c2b-87c0-fd316a15d968 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:07.856101 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061e3418-dbce-4c2b-87c0-fd316a15d968 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:07.856464 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061e3418-dbce-4c2b-87c0-fd316a15d968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:07.884953 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-061e3418-dbce-4c2b-87c0-fd316a15d968 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:34:07.886618 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-061e3418-dbce-4c2b-87c0-fd316a15d968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:07.966604 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 951/1902] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:34:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:34:08.005097 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a5650d-d1bd-47eb-b828-ea993928b7b8 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:08.006761 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-70a5650d-d1bd-47eb-b828-ea993928b7b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:08.042380 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:08.126913 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a5650d-d1bd-47eb-b828-ea993928b7b8 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:08.130995 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba08d912-447e-4ebc-9ddb-f8a96768014b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2d061d25d83443c9232218c90792d51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:08.131689 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba08d912-447e-4ebc-9ddb-f8a96768014b service neutron] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:08.131979 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba08d912-447e-4ebc-9ddb-f8a96768014b service neutron] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:08.132244 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba08d912-447e-4ebc-9ddb-f8a96768014b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:08.142588 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba08d912-447e-4ebc-9ddb-f8a96768014b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:08.144057 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba08d912-447e-4ebc-9ddb-f8a96768014b service neutron] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:08.154396 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 952/1903] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:34:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:34:08.193679 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061e3418-dbce-4c2b-87c0-fd316a15d968 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:08.197634 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-061e3418-dbce-4c2b-87c0-fd316a15d968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:08.225816 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061e3418-dbce-4c2b-87c0-fd316a15d968 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:08.231577 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d55800-189c-454a-9587-7ba68d9289b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:08.232382 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d55800-189c-454a-9587-7ba68d9289b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:08.232728 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d55800-189c-454a-9587-7ba68d9289b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:08.233063 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d55800-189c-454a-9587-7ba68d9289b4 admin admin] PATH_INFO: `/v3/projects/19c4dff6edd64961a8896e0e51fa852b` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:08.234421 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d55800-189c-454a-9587-7ba68d9289b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=19c4dff6edd64961a8896e0e51fa852b)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:08.237337 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d55800-189c-454a-9587-7ba68d9289b4 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:08.315882 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-b5d55800-189c-454a-9587-7ba68d9289b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19c4dff6edd64961a8896e0e51fa852b', 'request_id': 'req-b5d55800-189c-454a-9587-7ba68d9289b4'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:08.323192 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-b5d55800-189c-454a-9587-7ba68d9289b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19c4dff6edd64961a8896e0e51fa852b', 'request_id': 'req-b5d55800-189c-454a-9587-7ba68d9289b4'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:08.330891 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-b5d55800-189c-454a-9587-7ba68d9289b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19c4dff6edd64961a8896e0e51fa852b', 'request_id': 'req-b5d55800-189c-454a-9587-7ba68d9289b4'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:08.343538 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-b5d55800-189c-454a-9587-7ba68d9289b4 admin admin] The token cache is being invalidate because project 19c4dff6edd64961a8896e0e51fa852b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:34:08.343909 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-b5d55800-189c-454a-9587-7ba68d9289b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:08.344592 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-b5d55800-189c-454a-9587-7ba68d9289b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:08.346271 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 952/1904] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 11:34:08 2022] DELETE /identity/v3/projects/19c4dff6edd64961a8896e0e51fa852b => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 11:34:08.351337 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122bf0a9-cd7a-4372-b7fb-d97ab42f920d None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:08.351690 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122bf0a9-cd7a-4372-b7fb-d97ab42f920d None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:08.352033 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122bf0a9-cd7a-4372-b7fb-d97ab42f920d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:08.372085 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-122bf0a9-cd7a-4372-b7fb-d97ab42f920d None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:34:08.373297 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-122bf0a9-cd7a-4372-b7fb-d97ab42f920d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:08.438804 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 953/1905] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:34:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:34:08.451267 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160d6bb1-4e3c-401c-b30b-b0c38eb7936d None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:08.451644 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160d6bb1-4e3c-401c-b30b-b0c38eb7936d None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:08.452041 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160d6bb1-4e3c-401c-b30b-b0c38eb7936d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:08.475403 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-160d6bb1-4e3c-401c-b30b-b0c38eb7936d None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:34:08.477209 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-160d6bb1-4e3c-401c-b30b-b0c38eb7936d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:08.487085 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 953/1906] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:34:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:34:08.491983 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122bf0a9-cd7a-4372-b7fb-d97ab42f920d None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:08.503026 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122bf0a9-cd7a-4372-b7fb-d97ab42f920d None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:08.509619 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8036a13e-da91-471c-b3d9-0a939c9d8bae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:08.510248 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8036a13e-da91-471c-b3d9-0a939c9d8bae admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:08.510928 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8036a13e-da91-471c-b3d9-0a939c9d8bae admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:08.511658 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8036a13e-da91-471c-b3d9-0a939c9d8bae admin admin] PATH_INFO: `/v3/domains` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:08.511853 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8036a13e-da91-471c-b3d9-0a939c9d8bae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:34:08.512169 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8036a13e-da91-471c-b3d9-0a939c9d8bae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:08.515548 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8036a13e-da91-471c-b3d9-0a939c9d8bae admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:08.531216 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 954/1907] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 24 11:34:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:34:08.539106 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160d6bb1-4e3c-401c-b30b-b0c38eb7936d None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:08.551038 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160d6bb1-4e3c-401c-b30b-b0c38eb7936d None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:08.555802 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cfd90e-cbea-46a6-927f-0ebc8a422bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:08.556629 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cfd90e-cbea-46a6-927f-0ebc8a422bce admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:08.556973 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cfd90e-cbea-46a6-927f-0ebc8a422bce admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:08.557315 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cfd90e-cbea-46a6-927f-0ebc8a422bce admin admin] PATH_INFO: `/v3/projects` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:08.558466 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cfd90e-cbea-46a6-927f-0ebc8a422bce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:08.560822 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cfd90e-cbea-46a6-927f-0ebc8a422bce admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:08.592562 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 954/1908] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 11:34:08 2022] POST /identity/v3/projects => generated 399 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 11:34:08.597038 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8036a13e-da91-471c-b3d9-0a939c9d8bae admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:08.608165 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8036a13e-da91-471c-b3d9-0a939c9d8bae admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:08.669556 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776cefc6-da21-459b-ab9c-a7375112a340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:08.670255 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776cefc6-da21-459b-ab9c-a7375112a340 admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:08.670542 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776cefc6-da21-459b-ab9c-a7375112a340 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:08.670918 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776cefc6-da21-459b-ab9c-a7375112a340 admin admin] PATH_INFO: `/v3/users` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:08.671693 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776cefc6-da21-459b-ab9c-a7375112a340 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:08.674374 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776cefc6-da21-459b-ab9c-a7375112a340 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:08.686556 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cfd90e-cbea-46a6-927f-0ebc8a422bce admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:08.688987 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-e1cfd90e-cbea-46a6-927f-0ebc8a422bce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:08.699721 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 955/1909] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 11:34:08 2022] POST /identity/v3/users => generated 300 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:34:08.704102 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776cefc6-da21-459b-ab9c-a7375112a340 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:08.719122 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776cefc6-da21-459b-ab9c-a7375112a340 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:08.725187 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b8695a-6991-4a2b-9d8f-f5b5bc281603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:08.725907 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b8695a-6991-4a2b-9d8f-f5b5bc281603 admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:08.726185 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b8695a-6991-4a2b-9d8f-f5b5bc281603 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:08.726485 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b8695a-6991-4a2b-9d8f-f5b5bc281603 admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:08.727146 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b8695a-6991-4a2b-9d8f-f5b5bc281603 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:08.728976 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b8695a-6991-4a2b-9d8f-f5b5bc281603 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:08.748572 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 956/1910] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:34:08 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:34:08.748878 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cfd90e-cbea-46a6-927f-0ebc8a422bce admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:08.749496 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b8695a-6991-4a2b-9d8f-f5b5bc281603 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:08.757477 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd976bb-d440-471a-af0b-4ac2b0659dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:08.759583 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd976bb-d440-471a-af0b-4ac2b0659dfb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:08.759869 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd976bb-d440-471a-af0b-4ac2b0659dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:08.760140 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd976bb-d440-471a-af0b-4ac2b0659dfb admin admin] PATH_INFO: `/v3/projects/5fc897d2061747ca98b102e9ad9e852c` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:08.761808 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd976bb-d440-471a-af0b-4ac2b0659dfb admin admin] RBAC: Authorizing `identity:delete_project(project_id=5fc897d2061747ca98b102e9ad9e852c)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:08.763176 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b8695a-6991-4a2b-9d8f-f5b5bc281603 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:08.764805 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd976bb-d440-471a-af0b-4ac2b0659dfb admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:08.771215 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6486ed-f2ab-46fa-a4c7-b42ba859b367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:08.771910 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6486ed-f2ab-46fa-a4c7-b42ba859b367 admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:08.772199 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6486ed-f2ab-46fa-a4c7-b42ba859b367 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:08.773119 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6486ed-f2ab-46fa-a4c7-b42ba859b367 admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:08.773797 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6486ed-f2ab-46fa-a4c7-b42ba859b367 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:08.775490 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6486ed-f2ab-46fa-a4c7-b42ba859b367 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:08.791821 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 957/1911] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:34:08 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:34:08.795313 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6486ed-f2ab-46fa-a4c7-b42ba859b367 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:08.810796 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6486ed-f2ab-46fa-a4c7-b42ba859b367 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:08.817302 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b322075-957e-45e8-8d00-8bfa4abb2713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:08.818485 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b322075-957e-45e8-8d00-8bfa4abb2713 admin admin] REQUEST_METHOD: `PUT` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:08.819019 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b322075-957e-45e8-8d00-8bfa4abb2713 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:08.819751 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b322075-957e-45e8-8d00-8bfa4abb2713 admin admin] PATH_INFO: `/v3/projects/51fe7bd2bec34d278d5695c859f5dabc/users/22e0806609574a9fbfaf37d552846287/roles/27e3e65e24df4b86b0d3d18d3212101d` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:08.832167 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:08.842169 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:08.843614 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-ebd976bb-d440-471a-af0b-4ac2b0659dfb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5fc897d2061747ca98b102e9ad9e852c', 'request_id': 'req-ebd976bb-d440-471a-af0b-4ac2b0659dfb'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:08.852976 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b322075-957e-45e8-8d00-8bfa4abb2713 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51fe7bd2bec34d278d5695c859f5dabc, user_id=22e0806609574a9fbfaf37d552846287, role_id=27e3e65e24df4b86b0d3d18d3212101d)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:08.854442 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-ebd976bb-d440-471a-af0b-4ac2b0659dfb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5fc897d2061747ca98b102e9ad9e852c', 'request_id': 'req-ebd976bb-d440-471a-af0b-4ac2b0659dfb'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:08.856777 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b322075-957e-45e8-8d00-8bfa4abb2713 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:08.862552 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-ebd976bb-d440-471a-af0b-4ac2b0659dfb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5fc897d2061747ca98b102e9ad9e852c', 'request_id': 'req-ebd976bb-d440-471a-af0b-4ac2b0659dfb'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:08.882293 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 958/1912] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 11:34:08 2022] PUT /identity/v3/projects/51fe7bd2bec34d278d5695c859f5dabc/users/22e0806609574a9fbfaf37d552846287/roles/27e3e65e24df4b86b0d3d18d3212101d => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 11:34:08.892086 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-ebd976bb-d440-471a-af0b-4ac2b0659dfb admin admin] The token cache is being invalidate because project 5fc897d2061747ca98b102e9ad9e852c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:34:08.892964 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-ebd976bb-d440-471a-af0b-4ac2b0659dfb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:08.893157 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc8ac01-37f3-4645-803d-58c575965547 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:08.893442 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc8ac01-37f3-4645-803d-58c575965547 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:08.893724 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc8ac01-37f3-4645-803d-58c575965547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:08.894499 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-ebd976bb-d440-471a-af0b-4ac2b0659dfb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:08.900388 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 955/1913] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 11:34:08 2022] DELETE /identity/v3/projects/5fc897d2061747ca98b102e9ad9e852c => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 11:34:08.901552 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd976bb-d440-471a-af0b-4ac2b0659dfb admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:08.903159 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-ebd976bb-d440-471a-af0b-4ac2b0659dfb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:08.946010 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-7dc8ac01-37f3-4645-803d-58c575965547 None None] MFA Rules not processed for user `22e0806609574a9fbfaf37d552846287`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:34:08.947675 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-7dc8ac01-37f3-4645-803d-58c575965547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:08.996962 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd976bb-d440-471a-af0b-4ac2b0659dfb admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:09.067530 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 959/1914] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:34:08 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:34:09.068950 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc8ac01-37f3-4645-803d-58c575965547 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:09.071098 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-7dc8ac01-37f3-4645-803d-58c575965547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:09.087635 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9884e4d4-9b6d-4c15-9656-42acb6f5d85b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:09.088981 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9884e4d4-9b6d-4c15-9656-42acb6f5d85b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:09.089474 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9884e4d4-9b6d-4c15-9656-42acb6f5d85b admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:09.089947 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9884e4d4-9b6d-4c15-9656-42acb6f5d85b admin admin] PATH_INFO: `/v3/users/7b0669a9fa534d228343a35131266fda` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:09.091905 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9884e4d4-9b6d-4c15-9656-42acb6f5d85b admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b0669a9fa534d228343a35131266fda)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:09.094705 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9884e4d4-9b6d-4c15-9656-42acb6f5d85b admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:09.159168 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc8ac01-37f3-4645-803d-58c575965547 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:09.164973 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47723392-e9f0-4a81-b7f1-9037d397b04a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92862b76ba3b4513b5dc5b5c962faac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:09.165829 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47723392-e9f0-4a81-b7f1-9037d397b04a service cinder] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:09.166865 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-9884e4d4-9b6d-4c15-9656-42acb6f5d85b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b0669a9fa534d228343a35131266fda'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:09.167243 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47723392-e9f0-4a81-b7f1-9037d397b04a service cinder] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:09.167742 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47723392-e9f0-4a81-b7f1-9037d397b04a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:09.167920 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-9884e4d4-9b6d-4c15-9656-42acb6f5d85b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b0669a9fa534d228343a35131266fda'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:09.170161 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-47723392-e9f0-4a81-b7f1-9037d397b04a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:09.186997 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-9884e4d4-9b6d-4c15-9656-42acb6f5d85b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b0669a9fa534d228343a35131266fda'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:09.197456 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-9884e4d4-9b6d-4c15-9656-42acb6f5d85b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b0669a9fa534d228343a35131266fda'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:09.198286 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-9884e4d4-9b6d-4c15-9656-42acb6f5d85b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b0669a9fa534d228343a35131266fda'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:09.224195 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:09.242706 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 956/1915] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 11:34:08 2022] DELETE /identity/v3/users/7b0669a9fa534d228343a35131266fda => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:34:09.248980 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9884e4d4-9b6d-4c15-9656-42acb6f5d85b admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:09.251827 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-9884e4d4-9b6d-4c15-9656-42acb6f5d85b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:09.349063 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47723392-e9f0-4a81-b7f1-9037d397b04a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:09.350900 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47723392-e9f0-4a81-b7f1-9037d397b04a service cinder] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:09.363217 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9884e4d4-9b6d-4c15-9656-42acb6f5d85b admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:09.377154 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 960/1916] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:34:09 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:34:09.377426 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c5b6a0-3270-4843-be37-3133dec6a37d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:09.378129 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c5b6a0-3270-4843-be37-3133dec6a37d admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:09.378644 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd46980-a9d3-42d3-99bf-28a6985e6627 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:09.378930 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd46980-a9d3-42d3-99bf-28a6985e6627 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:09.379269 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c5b6a0-3270-4843-be37-3133dec6a37d admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:09.379374 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd46980-a9d3-42d3-99bf-28a6985e6627 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:09.379563 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c5b6a0-3270-4843-be37-3133dec6a37d admin admin] PATH_INFO: `/v3/projects` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:09.380905 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c5b6a0-3270-4843-be37-3133dec6a37d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:09.381955 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 961/1917] 10.222.0.27 () {54 vars in 921 bytes} [Wed Aug 24 11:34:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:34:09.386097 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c5b6a0-3270-4843-be37-3133dec6a37d admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:09.414887 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b665d97-c9f6-40a7-862a-50002fffa5b2 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:09.415562 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b665d97-c9f6-40a7-862a-50002fffa5b2 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:09.415847 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b665d97-c9f6-40a7-862a-50002fffa5b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:09.452946 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 957/1918] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 11:34:09 2022] POST /identity/v3/projects => generated 401 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:34:09.458834 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c5b6a0-3270-4843-be37-3133dec6a37d admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:09.459891 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-7b665d97-c9f6-40a7-862a-50002fffa5b2 None None] MFA Rules not processed for user `282ec32864d046b2bea170f6a3845cc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:34:09.461771 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-7b665d97-c9f6-40a7-862a-50002fffa5b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:09.538655 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:09.541119 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c5b6a0-3270-4843-be37-3133dec6a37d admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:09.553321 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef691ff4-76e0-4dca-9cb9-c0026a453004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:09.554383 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef691ff4-76e0-4dca-9cb9-c0026a453004 admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:09.554669 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef691ff4-76e0-4dca-9cb9-c0026a453004 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:09.555034 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef691ff4-76e0-4dca-9cb9-c0026a453004 admin admin] PATH_INFO: `/v3/users` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:09.555826 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef691ff4-76e0-4dca-9cb9-c0026a453004 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:09.562243 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef691ff4-76e0-4dca-9cb9-c0026a453004 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:09.590673 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 962/1919] 10.222.0.27 () {58 vars in 1018 bytes} [Wed Aug 24 11:34:09 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 11:34:09.607352 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 958/1920] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 11:34:09 2022] POST /identity/v3/users => generated 307 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:34:09.612552 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b665d97-c9f6-40a7-862a-50002fffa5b2 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:09.628152 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b665d97-c9f6-40a7-862a-50002fffa5b2 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:09.635167 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffd9839-29be-4b0f-9a00-44ef525c89c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:09.635958 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffd9839-29be-4b0f-9a00-44ef525c89c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:09.636339 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffd9839-29be-4b0f-9a00-44ef525c89c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:09.636523 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffd9839-29be-4b0f-9a00-44ef525c89c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:09.637177 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffd9839-29be-4b0f-9a00-44ef525c89c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:09.638897 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffd9839-29be-4b0f-9a00-44ef525c89c2 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:09.666134 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 963/1921] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:34:09 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:34:09.668065 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef691ff4-76e0-4dca-9cb9-c0026a453004 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:09.684687 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef691ff4-76e0-4dca-9cb9-c0026a453004 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:09.692459 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffec592-9ea1-4b6e-86c0-c88e6a683c7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:09.694005 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffec592-9ea1-4b6e-86c0-c88e6a683c7a admin admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:09.694005 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffec592-9ea1-4b6e-86c0-c88e6a683c7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:09.694341 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffec592-9ea1-4b6e-86c0-c88e6a683c7a admin admin] PATH_INFO: `/v3/projects/0b65004874da440fb61dbee1b6250237/users/d9f5c3a113ed4fd6bbc84206889e9023/roles/30bb1e97257f4ca5b90c88545777317b` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:09.715048 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffec592-9ea1-4b6e-86c0-c88e6a683c7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b65004874da440fb61dbee1b6250237, user_id=d9f5c3a113ed4fd6bbc84206889e9023, role_id=30bb1e97257f4ca5b90c88545777317b)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:09.717906 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffec592-9ea1-4b6e-86c0-c88e6a683c7a admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:09.739777 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 959/1922] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 11:34:09 2022] PUT /identity/v3/projects/0b65004874da440fb61dbee1b6250237/users/d9f5c3a113ed4fd6bbc84206889e9023/roles/30bb1e97257f4ca5b90c88545777317b => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:34:09.741661 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffd9839-29be-4b0f-9a00-44ef525c89c2 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:09.756306 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffd9839-29be-4b0f-9a00-44ef525c89c2 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:09.808967 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffec592-9ea1-4b6e-86c0-c88e6a683c7a admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:09.812930 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-0ffec592-9ea1-4b6e-86c0-c88e6a683c7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:09.882647 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf2f06c-46cb-4190-858e-455babd6d99a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:09.883796 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf2f06c-46cb-4190-858e-455babd6d99a admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:09.884292 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf2f06c-46cb-4190-858e-455babd6d99a admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:09.884957 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf2f06c-46cb-4190-858e-455babd6d99a admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:09.885892 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf2f06c-46cb-4190-858e-455babd6d99a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:09.888475 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:DELETE=1,keystone:SELECT=94,keystone:INSERT=5 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:09.889577 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf2f06c-46cb-4190-858e-455babd6d99a admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:09.907258 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 964/1923] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:34:09 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:34:09.912508 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf2f06c-46cb-4190-858e-455babd6d99a admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:09.918233 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffec592-9ea1-4b6e-86c0-c88e6a683c7a admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:09.922962 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf2f06c-46cb-4190-858e-455babd6d99a admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:09.924374 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5539df3-d077-4c2e-b78a-9088df33c4c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:09.925017 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5539df3-d077-4c2e-b78a-9088df33c4c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:09.925296 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5539df3-d077-4c2e-b78a-9088df33c4c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:09.925566 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5539df3-d077-4c2e-b78a-9088df33c4c0 admin admin] PATH_INFO: `/v3/projects/c1d2be49e2cd49ecaa688b332f6bdbef` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:09.927375 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5539df3-d077-4c2e-b78a-9088df33c4c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1d2be49e2cd49ecaa688b332f6bdbef)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:09.928735 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f2a818-8f21-4493-8017-fb646b5504fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:09.929758 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f2a818-8f21-4493-8017-fb646b5504fa admin admin] REQUEST_METHOD: `PUT` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:09.930184 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f2a818-8f21-4493-8017-fb646b5504fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:09.930637 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f2a818-8f21-4493-8017-fb646b5504fa admin admin] PATH_INFO: `/v3/projects/0b65004874da440fb61dbee1b6250237/users/d9f5c3a113ed4fd6bbc84206889e9023/roles/30bb1e97257f4ca5b90c88545777317b` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:09.932730 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f2a818-8f21-4493-8017-fb646b5504fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b65004874da440fb61dbee1b6250237, user_id=d9f5c3a113ed4fd6bbc84206889e9023, role_id=30bb1e97257f4ca5b90c88545777317b)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:09.935984 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f2a818-8f21-4493-8017-fb646b5504fa admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:09.943931 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5539df3-d077-4c2e-b78a-9088df33c4c0 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:09.950398 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 965/1924] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 11:34:09 2022] PUT /identity/v3/projects/0b65004874da440fb61dbee1b6250237/users/d9f5c3a113ed4fd6bbc84206889e9023/roles/30bb1e97257f4ca5b90c88545777317b => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 11:34:09.963609 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cfc869-7e96-4b32-a26a-3a62105f7b31 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:09.964096 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cfc869-7e96-4b32-a26a-3a62105f7b31 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:09.964519 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cfc869-7e96-4b32-a26a-3a62105f7b31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:10.006441 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-87cfc869-7e96-4b32-a26a-3a62105f7b31 None None] MFA Rules not processed for user `d9f5c3a113ed4fd6bbc84206889e9023`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:34:10.018413 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-87cfc869-7e96-4b32-a26a-3a62105f7b31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:10.019817 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-c5539df3-d077-4c2e-b78a-9088df33c4c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1d2be49e2cd49ecaa688b332f6bdbef', 'request_id': 'req-c5539df3-d077-4c2e-b78a-9088df33c4c0'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:10.028314 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-c5539df3-d077-4c2e-b78a-9088df33c4c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1d2be49e2cd49ecaa688b332f6bdbef', 'request_id': 'req-c5539df3-d077-4c2e-b78a-9088df33c4c0'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:10.037176 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-c5539df3-d077-4c2e-b78a-9088df33c4c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1d2be49e2cd49ecaa688b332f6bdbef', 'request_id': 'req-c5539df3-d077-4c2e-b78a-9088df33c4c0'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:10.063034 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-c5539df3-d077-4c2e-b78a-9088df33c4c0 admin admin] The token cache is being invalidate because project c1d2be49e2cd49ecaa688b332f6bdbef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:34:10.063512 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-c5539df3-d077-4c2e-b78a-9088df33c4c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:10.065534 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-c5539df3-d077-4c2e-b78a-9088df33c4c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:10.067560 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 960/1925] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 11:34:09 2022] DELETE /identity/v3/projects/c1d2be49e2cd49ecaa688b332f6bdbef => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 11:34:10.072776 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e964b4-165e-4852-82fb-e3c7447598e2 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:10.073053 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e964b4-165e-4852-82fb-e3c7447598e2 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:10.073322 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e964b4-165e-4852-82fb-e3c7447598e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:10.100044 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-04e964b4-165e-4852-82fb-e3c7447598e2 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:34:10.101268 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-04e964b4-165e-4852-82fb-e3c7447598e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:10.151990 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 966/1926] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:34:09 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:34:10.152937 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cfc869-7e96-4b32-a26a-3a62105f7b31 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:10.154632 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-87cfc869-7e96-4b32-a26a-3a62105f7b31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:10.184547 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:10.212142 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 961/1927] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:34:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:34:10.213283 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e964b4-165e-4852-82fb-e3c7447598e2 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:10.215195 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-04e964b4-165e-4852-82fb-e3c7447598e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:10.265719 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cfc869-7e96-4b32-a26a-3a62105f7b31 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:10.275455 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e85d164-5b3e-4423-9df3-790263aa4756 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '282ec32864d046b2bea170f6a3845cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:10.276104 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e85d164-5b3e-4423-9df3-790263aa4756 service nova] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:10.276386 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e85d164-5b3e-4423-9df3-790263aa4756 service nova] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:10.276661 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e85d164-5b3e-4423-9df3-790263aa4756 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:10.279385 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e964b4-165e-4852-82fb-e3c7447598e2 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:10.279645 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-2e85d164-5b3e-4423-9df3-790263aa4756 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:10.283267 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222d1a9e-b786-4e57-912b-6cfa0af248fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92862b76ba3b4513b5dc5b5c962faac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:10.284023 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222d1a9e-b786-4e57-912b-6cfa0af248fe service cinder] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:10.284305 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222d1a9e-b786-4e57-912b-6cfa0af248fe service cinder] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:10.284570 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222d1a9e-b786-4e57-912b-6cfa0af248fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:10.295350 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222d1a9e-b786-4e57-912b-6cfa0af248fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:10.295563 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e85d164-5b3e-4423-9df3-790263aa4756 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:10.296921 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222d1a9e-b786-4e57-912b-6cfa0af248fe service cinder] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:10.298023 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e85d164-5b3e-4423-9df3-790263aa4756 service nova] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:10.307997 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 962/1928] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:34:10 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:34:10.311116 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 967/1929] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:34:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:34:10.316519 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b802a278-c45f-420f-8171-d25a5122deb8 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:10.316885 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b802a278-c45f-420f-8171-d25a5122deb8 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:10.317227 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b802a278-c45f-420f-8171-d25a5122deb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:10.363087 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-b802a278-c45f-420f-8171-d25a5122deb8 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:34:10.365208 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-b802a278-c45f-420f-8171-d25a5122deb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:10.393664 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 963/1930] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:34:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:34:10.398326 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e85d164-5b3e-4423-9df3-790263aa4756 service nova] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:10.413633 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e85d164-5b3e-4423-9df3-790263aa4756 service nova] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:10.440412 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5fb9ea-18b0-48f9-9742-0252c3767c0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:10.441305 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5fb9ea-18b0-48f9-9742-0252c3767c0d admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:10.441882 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5fb9ea-18b0-48f9-9742-0252c3767c0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:10.443209 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5fb9ea-18b0-48f9-9742-0252c3767c0d admin admin] PATH_INFO: `/v3/domains` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:10.444057 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5fb9ea-18b0-48f9-9742-0252c3767c0d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:34:10.445464 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5fb9ea-18b0-48f9-9742-0252c3767c0d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:10.448752 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5fb9ea-18b0-48f9-9742-0252c3767c0d admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:10.480666 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b802a278-c45f-420f-8171-d25a5122deb8 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:10.494724 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b802a278-c45f-420f-8171-d25a5122deb8 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:10.507746 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 968/1931] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 24 11:34:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:34:10.510236 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b99014-2faa-4496-9db7-fe796e68af64 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92862b76ba3b4513b5dc5b5c962faac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:10.513259 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5fb9ea-18b0-48f9-9742-0252c3767c0d admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:10.514792 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b99014-2faa-4496-9db7-fe796e68af64 service cinder] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:10.515126 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b99014-2faa-4496-9db7-fe796e68af64 service cinder] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:10.517874 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b99014-2faa-4496-9db7-fe796e68af64 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:10.525826 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-86b99014-2faa-4496-9db7-fe796e68af64 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:10.546987 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5fb9ea-18b0-48f9-9742-0252c3767c0d admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:10.552877 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:10.560987 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17796481-5446-4450-b4c7-45e5352274cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:10.562033 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17796481-5446-4450-b4c7-45e5352274cc admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:10.562525 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17796481-5446-4450-b4c7-45e5352274cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:10.563035 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17796481-5446-4450-b4c7-45e5352274cc admin admin] PATH_INFO: `/v3/projects` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:10.564343 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17796481-5446-4450-b4c7-45e5352274cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:10.566929 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17796481-5446-4450-b4c7-45e5352274cc admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:10.619464 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 969/1932] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 11:34:10 2022] POST /identity/v3/projects => generated 385 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:34:10.622097 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17796481-5446-4450-b4c7-45e5352274cc admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:10.639042 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b99014-2faa-4496-9db7-fe796e68af64 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:10.641050 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b99014-2faa-4496-9db7-fe796e68af64 service cinder] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:10.652783 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 964/1933] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:34:10 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:34:10.723574 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17796481-5446-4450-b4c7-45e5352274cc admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:10.729183 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf85c68-3eb0-4252-aecc-939257ef14a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:10.729992 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf85c68-3eb0-4252-aecc-939257ef14a3 admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:10.730330 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf85c68-3eb0-4252-aecc-939257ef14a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:10.730706 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf85c68-3eb0-4252-aecc-939257ef14a3 admin admin] PATH_INFO: `/v3/users` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:10.731417 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf85c68-3eb0-4252-aecc-939257ef14a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:10.733774 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf85c68-3eb0-4252-aecc-939257ef14a3 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:10.779280 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b99014-2faa-4496-9db7-fe796e68af64 service cinder] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:10.791361 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 970/1934] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 11:34:10 2022] POST /identity/v3/users => generated 293 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:34:10.800004 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b99014-2faa-4496-9db7-fe796e68af64 service cinder] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:10.808571 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdeeb74-49e7-4a26-adc7-322e0406a37a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:10.809763 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdeeb74-49e7-4a26-adc7-322e0406a37a admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:10.810666 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdeeb74-49e7-4a26-adc7-322e0406a37a admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:10.811017 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdeeb74-49e7-4a26-adc7-322e0406a37a admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:10.813069 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdeeb74-49e7-4a26-adc7-322e0406a37a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:10.815683 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdeeb74-49e7-4a26-adc7-322e0406a37a admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:10.836746 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 965/1935] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:34:10 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:34:10.838290 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf85c68-3eb0-4252-aecc-939257ef14a3 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:10.853302 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf85c68-3eb0-4252-aecc-939257ef14a3 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:10.859303 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d808a89f-86cf-44c5-b503-edcdf8b51ef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:10.860149 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d808a89f-86cf-44c5-b503-edcdf8b51ef9 admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:10.860721 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d808a89f-86cf-44c5-b503-edcdf8b51ef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:10.861655 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d808a89f-86cf-44c5-b503-edcdf8b51ef9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:10.862952 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d808a89f-86cf-44c5-b503-edcdf8b51ef9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:10.866069 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d808a89f-86cf-44c5-b503-edcdf8b51ef9 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:10.881070 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 971/1936] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:34:10 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:34:10.885280 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdeeb74-49e7-4a26-adc7-322e0406a37a admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:10.904596 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdeeb74-49e7-4a26-adc7-322e0406a37a admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:10.919208 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a947c847-b66a-4ed7-8947-c12376c7bf0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:10.920173 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a947c847-b66a-4ed7-8947-c12376c7bf0c admin admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:10.920613 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a947c847-b66a-4ed7-8947-c12376c7bf0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:10.922604 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a947c847-b66a-4ed7-8947-c12376c7bf0c admin admin] PATH_INFO: `/v3/projects/2f9c7ef6dd1e4571927a31960b57204a/users/8f81496c097742e6be5c212613a55a51/roles/27e3e65e24df4b86b0d3d18d3212101d` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:10.955872 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a947c847-b66a-4ed7-8947-c12376c7bf0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f9c7ef6dd1e4571927a31960b57204a, user_id=8f81496c097742e6be5c212613a55a51, role_id=27e3e65e24df4b86b0d3d18d3212101d)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:10.962126 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a947c847-b66a-4ed7-8947-c12376c7bf0c admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:10.988211 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 966/1937] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 11:34:10 2022] PUT /identity/v3/projects/2f9c7ef6dd1e4571927a31960b57204a/users/8f81496c097742e6be5c212613a55a51/roles/27e3e65e24df4b86b0d3d18d3212101d => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:34:11.000140 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c8a1ac-97de-4225-a532-b9db87454cd0 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:11.000481 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c8a1ac-97de-4225-a532-b9db87454cd0 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:11.000703 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c8a1ac-97de-4225-a532-b9db87454cd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:11.047897 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-a9c8a1ac-97de-4225-a532-b9db87454cd0 None None] MFA Rules not processed for user `8f81496c097742e6be5c212613a55a51`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:34:11.049487 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-a9c8a1ac-97de-4225-a532-b9db87454cd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:11.108898 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:11.153007 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 972/1938] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:34:10 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:34:11.157623 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a947c847-b66a-4ed7-8947-c12376c7bf0c admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:11.289357 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a947c847-b66a-4ed7-8947-c12376c7bf0c admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:11.294838 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1daf51-bee3-4d1c-9ba2-09d654790172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:11.295641 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1daf51-bee3-4d1c-9ba2-09d654790172 admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:11.296108 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1daf51-bee3-4d1c-9ba2-09d654790172 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:11.296445 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1daf51-bee3-4d1c-9ba2-09d654790172 admin admin] PATH_INFO: `/v3/projects` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:11.297147 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1daf51-bee3-4d1c-9ba2-09d654790172 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:11.299934 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1daf51-bee3-4d1c-9ba2-09d654790172 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:11.346186 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 967/1939] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 11:34:11 2022] POST /identity/v3/projects => generated 383 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 11:34:11.350607 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c8a1ac-97de-4225-a532-b9db87454cd0 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:11.368583 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c8a1ac-97de-4225-a532-b9db87454cd0 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:11.468751 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa51a0c6-9b12-4aa0-ab19-4a67fd4150ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:11.469858 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa51a0c6-9b12-4aa0-ab19-4a67fd4150ef admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:11.470600 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa51a0c6-9b12-4aa0-ab19-4a67fd4150ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:11.471074 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa51a0c6-9b12-4aa0-ab19-4a67fd4150ef admin admin] PATH_INFO: `/v3/users` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:11.474430 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa51a0c6-9b12-4aa0-ab19-4a67fd4150ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:11.478325 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa51a0c6-9b12-4aa0-ab19-4a67fd4150ef admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:11.514579 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 973/1940] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 11:34:11 2022] POST /identity/v3/users => generated 292 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:34:11.515895 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1daf51-bee3-4d1c-9ba2-09d654790172 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:11.527790 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1daf51-bee3-4d1c-9ba2-09d654790172 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:11.538875 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544c5675-2e2c-4dfe-9330-0600fc409ce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:11.540074 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544c5675-2e2c-4dfe-9330-0600fc409ce7 admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:11.540546 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544c5675-2e2c-4dfe-9330-0600fc409ce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:11.540814 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544c5675-2e2c-4dfe-9330-0600fc409ce7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:11.541520 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544c5675-2e2c-4dfe-9330-0600fc409ce7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:11.543243 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544c5675-2e2c-4dfe-9330-0600fc409ce7 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:11.566388 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 968/1941] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:34:11 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 11:34:11.567057 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa51a0c6-9b12-4aa0-ab19-4a67fd4150ef admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:11.593715 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa51a0c6-9b12-4aa0-ab19-4a67fd4150ef admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:11.601263 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26365fa-e9f2-4826-a539-d3e51176e839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:11.603244 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26365fa-e9f2-4826-a539-d3e51176e839 admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:11.603651 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26365fa-e9f2-4826-a539-d3e51176e839 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:11.604107 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26365fa-e9f2-4826-a539-d3e51176e839 admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:11.604880 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26365fa-e9f2-4826-a539-d3e51176e839 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:11.606924 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26365fa-e9f2-4826-a539-d3e51176e839 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:11.625924 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 974/1942] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:34:11 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 11:34:11.630813 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544c5675-2e2c-4dfe-9330-0600fc409ce7 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:11.642030 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544c5675-2e2c-4dfe-9330-0600fc409ce7 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:11.647438 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4cf6ef-89de-4c47-91e4-431fe4631876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:11.648364 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4cf6ef-89de-4c47-91e4-431fe4631876 admin admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:11.648841 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4cf6ef-89de-4c47-91e4-431fe4631876 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:11.649517 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4cf6ef-89de-4c47-91e4-431fe4631876 admin admin] PATH_INFO: `/v3/projects/df1de5dd63f441e9bd32ef8c53354206/users/3e3f546a17524f1bbfea535ba637c0c9/roles/27e3e65e24df4b86b0d3d18d3212101d` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:11.692275 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4cf6ef-89de-4c47-91e4-431fe4631876 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df1de5dd63f441e9bd32ef8c53354206, user_id=3e3f546a17524f1bbfea535ba637c0c9, role_id=27e3e65e24df4b86b0d3d18d3212101d)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:11.695091 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4cf6ef-89de-4c47-91e4-431fe4631876 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:11.724685 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 969/1943] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 11:34:11 2022] PUT /identity/v3/projects/df1de5dd63f441e9bd32ef8c53354206/users/3e3f546a17524f1bbfea535ba637c0c9/roles/27e3e65e24df4b86b0d3d18d3212101d => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:34:11.746845 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c679764-83f8-4d81-bc50-1663a9f74def None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:11.747132 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c679764-83f8-4d81-bc50-1663a9f74def None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:11.747403 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c679764-83f8-4d81-bc50-1663a9f74def None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:11.782446 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-6c679764-83f8-4d81-bc50-1663a9f74def None None] MFA Rules not processed for user `3e3f546a17524f1bbfea535ba637c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:34:11.783952 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-6c679764-83f8-4d81-bc50-1663a9f74def None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:11.870463 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 975/1944] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:34:11 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 11:34:11.875165 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4cf6ef-89de-4c47-91e4-431fe4631876 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:11.907500 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:11.953875 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4cf6ef-89de-4c47-91e4-431fe4631876 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:11.958876 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3224b5-b582-494f-9360-ba1f7284eb63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:11.959789 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3224b5-b582-494f-9360-ba1f7284eb63 admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:11.959789 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3224b5-b582-494f-9360-ba1f7284eb63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:11.960079 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3224b5-b582-494f-9360-ba1f7284eb63 admin admin] PATH_INFO: `/v3/projects` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:11.960690 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3224b5-b582-494f-9360-ba1f7284eb63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:11.962652 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3224b5-b582-494f-9360-ba1f7284eb63 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:11.994891 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 970/1945] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 11:34:11 2022] POST /identity/v3/projects => generated 385 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 11:34:11.998832 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c679764-83f8-4d81-bc50-1663a9f74def None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:12.011232 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c679764-83f8-4d81-bc50-1663a9f74def None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:12.130125 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:12.148041 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33194c2-6560-4ed5-ba63-7afb2ba592e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:12.148677 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33194c2-6560-4ed5-ba63-7afb2ba592e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:12.149426 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33194c2-6560-4ed5-ba63-7afb2ba592e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:12.149426 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33194c2-6560-4ed5-ba63-7afb2ba592e9 admin admin] PATH_INFO: `/v3/users` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:12.149997 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33194c2-6560-4ed5-ba63-7afb2ba592e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:12.152118 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33194c2-6560-4ed5-ba63-7afb2ba592e9 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:12.192715 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 976/1946] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 11:34:11 2022] POST /identity/v3/users => generated 299 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 11:34:12.194089 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3224b5-b582-494f-9360-ba1f7284eb63 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:12.211561 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33194c2-6560-4ed5-ba63-7afb2ba592e9 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:12.213438 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-c33194c2-6560-4ed5-ba63-7afb2ba592e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:12.214440 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3224b5-b582-494f-9360-ba1f7284eb63 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:12.231966 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e701c9bd-83fd-4772-b68b-dc670bbf7644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:12.232684 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e701c9bd-83fd-4772-b68b-dc670bbf7644 admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:12.233406 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e701c9bd-83fd-4772-b68b-dc670bbf7644 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:12.233835 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e701c9bd-83fd-4772-b68b-dc670bbf7644 admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:12.234695 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e701c9bd-83fd-4772-b68b-dc670bbf7644 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:12.236994 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e701c9bd-83fd-4772-b68b-dc670bbf7644 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:12.244118 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33194c2-6560-4ed5-ba63-7afb2ba592e9 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:12.263995 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58f87a4-77d2-455b-b1bd-90fcc99a92a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:12.264848 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58f87a4-77d2-455b-b1bd-90fcc99a92a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:12.265308 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58f87a4-77d2-455b-b1bd-90fcc99a92a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:12.265588 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58f87a4-77d2-455b-b1bd-90fcc99a92a8 admin admin] PATH_INFO: `/v3/users/21d610f26cba45e3bc3844162fa98492` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:12.268829 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 971/1947] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:34:12 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:34:12.269241 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58f87a4-77d2-455b-b1bd-90fcc99a92a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=21d610f26cba45e3bc3844162fa98492)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:12.269766 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e701c9bd-83fd-4772-b68b-dc670bbf7644 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:12.272251 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58f87a4-77d2-455b-b1bd-90fcc99a92a8 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:12.282259 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e701c9bd-83fd-4772-b68b-dc670bbf7644 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:12.288532 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d10bcf-ccad-4d52-ae19-2908afc43688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:12.290196 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d10bcf-ccad-4d52-ae19-2908afc43688 admin admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:12.290689 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d10bcf-ccad-4d52-ae19-2908afc43688 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:12.291150 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d10bcf-ccad-4d52-ae19-2908afc43688 admin admin] PATH_INFO: `/v3/projects/9dc2e0152c0748e1b4ebe2f036e65d40/users/0ee15feaf6c84b01b1c81bd29d275dc9/roles/30bb1e97257f4ca5b90c88545777317b` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:12.317566 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d10bcf-ccad-4d52-ae19-2908afc43688 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9dc2e0152c0748e1b4ebe2f036e65d40, user_id=0ee15feaf6c84b01b1c81bd29d275dc9, role_id=30bb1e97257f4ca5b90c88545777317b)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:12.321077 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d10bcf-ccad-4d52-ae19-2908afc43688 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:12.352064 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 972/1948] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 11:34:12 2022] PUT /identity/v3/projects/9dc2e0152c0748e1b4ebe2f036e65d40/users/0ee15feaf6c84b01b1c81bd29d275dc9/roles/30bb1e97257f4ca5b90c88545777317b => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:34:12.354525 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d10bcf-ccad-4d52-ae19-2908afc43688 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:12.378063 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-e58f87a4-77d2-455b-b1bd-90fcc99a92a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21d610f26cba45e3bc3844162fa98492'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:12.378899 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-e58f87a4-77d2-455b-b1bd-90fcc99a92a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21d610f26cba45e3bc3844162fa98492'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:12.380632 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-e58f87a4-77d2-455b-b1bd-90fcc99a92a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21d610f26cba45e3bc3844162fa98492'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:12.390660 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-e58f87a4-77d2-455b-b1bd-90fcc99a92a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21d610f26cba45e3bc3844162fa98492'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:12.404215 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-e58f87a4-77d2-455b-b1bd-90fcc99a92a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21d610f26cba45e3bc3844162fa98492'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:12.459352 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 977/1949] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 11:34:12 2022] DELETE /identity/v3/users/21d610f26cba45e3bc3844162fa98492 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 11:34:12.468897 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476956af-6935-4d3b-af68-608573dd5400 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:12.469543 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476956af-6935-4d3b-af68-608573dd5400 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:12.470040 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476956af-6935-4d3b-af68-608573dd5400 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:12.508202 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-476956af-6935-4d3b-af68-608573dd5400 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:34:12.511141 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-476956af-6935-4d3b-af68-608573dd5400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:12.527278 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d10bcf-ccad-4d52-ae19-2908afc43688 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:12.659567 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251e6773-d0ab-401e-ac25-0b3465bd7e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:12.660332 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251e6773-d0ab-401e-ac25-0b3465bd7e36 admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:12.660578 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251e6773-d0ab-401e-ac25-0b3465bd7e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:12.660870 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251e6773-d0ab-401e-ac25-0b3465bd7e36 admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:12.663991 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251e6773-d0ab-401e-ac25-0b3465bd7e36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:12.665341 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251e6773-d0ab-401e-ac25-0b3465bd7e36 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:12.679867 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 978/1950] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:34:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:34:12.692651 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 973/1951] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:34:12 2022] GET /identity/v3/roles => generated 1420 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:34:12.693002 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476956af-6935-4d3b-af68-608573dd5400 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:12.694538 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-476956af-6935-4d3b-af68-608573dd5400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:12.702691 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251e6773-d0ab-401e-ac25-0b3465bd7e36 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:12.709156 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-251e6773-d0ab-401e-ac25-0b3465bd7e36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:12.740729 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476956af-6935-4d3b-af68-608573dd5400 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:12.757984 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edfa75b-67ba-42a9-9d2d-1b7d3a289ed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:12.758757 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edfa75b-67ba-42a9-9d2d-1b7d3a289ed9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:12.759395 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edfa75b-67ba-42a9-9d2d-1b7d3a289ed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:12.759395 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edfa75b-67ba-42a9-9d2d-1b7d3a289ed9 admin admin] PATH_INFO: `/v3/projects/9dc2e0152c0748e1b4ebe2f036e65d40/users/0ee15feaf6c84b01b1c81bd29d275dc9/roles/30bb1e97257f4ca5b90c88545777317b` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:12.775360 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edfa75b-67ba-42a9-9d2d-1b7d3a289ed9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9dc2e0152c0748e1b4ebe2f036e65d40, user_id=0ee15feaf6c84b01b1c81bd29d275dc9, role_id=30bb1e97257f4ca5b90c88545777317b)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:12.780645 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edfa75b-67ba-42a9-9d2d-1b7d3a289ed9 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:12.811401 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 979/1952] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 11:34:12 2022] PUT /identity/v3/projects/9dc2e0152c0748e1b4ebe2f036e65d40/users/0ee15feaf6c84b01b1c81bd29d275dc9/roles/30bb1e97257f4ca5b90c88545777317b => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:34:12.813368 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37c89a4-ef8d-4c15-af79-f59770c023d6 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:12.813764 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37c89a4-ef8d-4c15-af79-f59770c023d6 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:12.814227 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37c89a4-ef8d-4c15-af79-f59770c023d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:12.817529 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:12.856810 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-a37c89a4-ef8d-4c15-af79-f59770c023d6 None None] MFA Rules not processed for user `0ee15feaf6c84b01b1c81bd29d275dc9`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:34:12.858420 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-a37c89a4-ef8d-4c15-af79-f59770c023d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:12.901368 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:12.927376 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251e6773-d0ab-401e-ac25-0b3465bd7e36 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:12.972165 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 980/1953] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:34:12 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:34:12.994576 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37c89a4-ef8d-4c15-af79-f59770c023d6 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:12.994576 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-a37c89a4-ef8d-4c15-af79-f59770c023d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:13.003584 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ff62b1-8afb-4af4-882a-0bca483b3a8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2d061d25d83443c9232218c90792d51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:13.004302 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ff62b1-8afb-4af4-882a-0bca483b3a8b service neutron] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:13.004947 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ff62b1-8afb-4af4-882a-0bca483b3a8b service neutron] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:13.005221 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ff62b1-8afb-4af4-882a-0bca483b3a8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:13.066280 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37c89a4-ef8d-4c15-af79-f59770c023d6 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:13.071836 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5692b71d-f0d3-4423-b936-ff3a4760e262 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92862b76ba3b4513b5dc5b5c962faac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:13.072738 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5692b71d-f0d3-4423-b936-ff3a4760e262 service cinder] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:13.073260 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5692b71d-f0d3-4423-b936-ff3a4760e262 service cinder] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:13.073670 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5692b71d-f0d3-4423-b936-ff3a4760e262 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:13.088483 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-5692b71d-f0d3-4423-b936-ff3a4760e262 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:13.098446 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ff62b1-8afb-4af4-882a-0bca483b3a8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:13.099945 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ff62b1-8afb-4af4-882a-0bca483b3a8b service neutron] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:13.110492 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 974/1954] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:34:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:34:13.164376 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5692b71d-f0d3-4423-b936-ff3a4760e262 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:13.165856 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5692b71d-f0d3-4423-b936-ff3a4760e262 service cinder] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:13.180959 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 981/1955] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:34:12 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 11:34:13.593589 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ff62b1-8afb-4af4-882a-0bca483b3a8b service neutron] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:13.595596 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-32ff62b1-8afb-4af4-882a-0bca483b3a8b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:13.633079 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ff62b1-8afb-4af4-882a-0bca483b3a8b service neutron] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:13.655109 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49a7959-dfd5-42ef-b76b-25130d923c8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:13.656041 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49a7959-dfd5-42ef-b76b-25130d923c8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:13.656302 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49a7959-dfd5-42ef-b76b-25130d923c8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:13.658511 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49a7959-dfd5-42ef-b76b-25130d923c8b admin admin] PATH_INFO: `/v3/projects/6de59514ef9547c6b3261e304e941182` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:13.663558 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49a7959-dfd5-42ef-b76b-25130d923c8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=6de59514ef9547c6b3261e304e941182)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:13.666484 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49a7959-dfd5-42ef-b76b-25130d923c8b admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:13.764158 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-d49a7959-dfd5-42ef-b76b-25130d923c8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6de59514ef9547c6b3261e304e941182', 'request_id': 'req-d49a7959-dfd5-42ef-b76b-25130d923c8b'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:13.777067 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-d49a7959-dfd5-42ef-b76b-25130d923c8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6de59514ef9547c6b3261e304e941182', 'request_id': 'req-d49a7959-dfd5-42ef-b76b-25130d923c8b'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:13.785081 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-d49a7959-dfd5-42ef-b76b-25130d923c8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6de59514ef9547c6b3261e304e941182', 'request_id': 'req-d49a7959-dfd5-42ef-b76b-25130d923c8b'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:13.806058 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-d49a7959-dfd5-42ef-b76b-25130d923c8b admin admin] The token cache is being invalidate because project 6de59514ef9547c6b3261e304e941182 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:34:13.806438 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-d49a7959-dfd5-42ef-b76b-25130d923c8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:13.807175 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-d49a7959-dfd5-42ef-b76b-25130d923c8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:13.809313 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 975/1956] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 11:34:13 2022] DELETE /identity/v3/projects/6de59514ef9547c6b3261e304e941182 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:34:13.813127 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5692b71d-f0d3-4423-b936-ff3a4760e262 service cinder] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:13.846749 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5692b71d-f0d3-4423-b936-ff3a4760e262 service cinder] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:13.925133 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ca04b9-d6b7-422b-80b9-efb479c1e4dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:13.925976 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ca04b9-d6b7-422b-80b9-efb479c1e4dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:13.926543 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ca04b9-d6b7-422b-80b9-efb479c1e4dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:13.926922 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ca04b9-d6b7-422b-80b9-efb479c1e4dd admin admin] PATH_INFO: `/v3/users/96a49d068b6842f482f1814a024db1b7` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:13.928223 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ca04b9-d6b7-422b-80b9-efb479c1e4dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=96a49d068b6842f482f1814a024db1b7)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:13.930537 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ca04b9-d6b7-422b-80b9-efb479c1e4dd admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:13.967801 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:14.025032 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-f1ca04b9-d6b7-422b-80b9-efb479c1e4dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96a49d068b6842f482f1814a024db1b7'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:14.025694 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-f1ca04b9-d6b7-422b-80b9-efb479c1e4dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96a49d068b6842f482f1814a024db1b7'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:14.026404 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-f1ca04b9-d6b7-422b-80b9-efb479c1e4dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96a49d068b6842f482f1814a024db1b7'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:14.041046 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-f1ca04b9-d6b7-422b-80b9-efb479c1e4dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96a49d068b6842f482f1814a024db1b7'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:14.057145 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-f1ca04b9-d6b7-422b-80b9-efb479c1e4dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96a49d068b6842f482f1814a024db1b7'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:14.092654 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 982/1957] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 11:34:13 2022] DELETE /identity/v3/users/96a49d068b6842f482f1814a024db1b7 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:34:14.688587 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49a7959-dfd5-42ef-b76b-25130d923c8b admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:14.690926 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-d49a7959-dfd5-42ef-b76b-25130d923c8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:14.712481 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49a7959-dfd5-42ef-b76b-25130d923c8b admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:14.716846 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:14.786561 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e76753-e6c8-41f2-9d53-99e3813cc26e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:14.787255 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e76753-e6c8-41f2-9d53-99e3813cc26e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:14.787535 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e76753-e6c8-41f2-9d53-99e3813cc26e admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:14.787817 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e76753-e6c8-41f2-9d53-99e3813cc26e admin admin] PATH_INFO: `/v3/projects/4d2dc848e5c14df4b731d35686650f4d` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:14.789196 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e76753-e6c8-41f2-9d53-99e3813cc26e admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d2dc848e5c14df4b731d35686650f4d)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:14.791486 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e76753-e6c8-41f2-9d53-99e3813cc26e admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:14.856743 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-65e76753-e6c8-41f2-9d53-99e3813cc26e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d2dc848e5c14df4b731d35686650f4d', 'request_id': 'req-65e76753-e6c8-41f2-9d53-99e3813cc26e'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:14.864372 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-65e76753-e6c8-41f2-9d53-99e3813cc26e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d2dc848e5c14df4b731d35686650f4d', 'request_id': 'req-65e76753-e6c8-41f2-9d53-99e3813cc26e'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:14.871713 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-65e76753-e6c8-41f2-9d53-99e3813cc26e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d2dc848e5c14df4b731d35686650f4d', 'request_id': 'req-65e76753-e6c8-41f2-9d53-99e3813cc26e'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:14.899047 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-65e76753-e6c8-41f2-9d53-99e3813cc26e admin admin] The token cache is being invalidate because project 4d2dc848e5c14df4b731d35686650f4d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:34:14.899531 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-65e76753-e6c8-41f2-9d53-99e3813cc26e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:14.900365 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-65e76753-e6c8-41f2-9d53-99e3813cc26e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:14.902305 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 976/1958] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 11:34:14 2022] DELETE /identity/v3/projects/4d2dc848e5c14df4b731d35686650f4d => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:34:14.907030 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ca04b9-d6b7-422b-80b9-efb479c1e4dd admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:14.908817 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-f1ca04b9-d6b7-422b-80b9-efb479c1e4dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:14.929066 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ca04b9-d6b7-422b-80b9-efb479c1e4dd admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:14.959667 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e76753-e6c8-41f2-9d53-99e3813cc26e admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:14.961593 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-65e76753-e6c8-41f2-9d53-99e3813cc26e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:15.002123 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a41d62d-295c-4e66-9dd5-c8971b3ef3d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:15.002904 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a41d62d-295c-4e66-9dd5-c8971b3ef3d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:15.003021 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a41d62d-295c-4e66-9dd5-c8971b3ef3d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:15.003314 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a41d62d-295c-4e66-9dd5-c8971b3ef3d6 admin admin] PATH_INFO: `/v3/users/381996f8198c4420abeead81a4aaf84f` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:15.005442 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a41d62d-295c-4e66-9dd5-c8971b3ef3d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=381996f8198c4420abeead81a4aaf84f)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:15.007602 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a41d62d-295c-4e66-9dd5-c8971b3ef3d6 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:15.086135 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e76753-e6c8-41f2-9d53-99e3813cc26e admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:15.091845 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcd47df-df92-46f9-a6ba-427722ecfc97 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92862b76ba3b4513b5dc5b5c962faac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:15.093586 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcd47df-df92-46f9-a6ba-427722ecfc97 service cinder] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:15.093959 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcd47df-df92-46f9-a6ba-427722ecfc97 service cinder] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:15.094570 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcd47df-df92-46f9-a6ba-427722ecfc97 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:15.098169 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-8fcd47df-df92-46f9-a6ba-427722ecfc97 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:15.105716 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-5a41d62d-295c-4e66-9dd5-c8971b3ef3d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '381996f8198c4420abeead81a4aaf84f'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:15.108302 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-5a41d62d-295c-4e66-9dd5-c8971b3ef3d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '381996f8198c4420abeead81a4aaf84f'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:15.110226 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-5a41d62d-295c-4e66-9dd5-c8971b3ef3d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '381996f8198c4420abeead81a4aaf84f'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:15.133223 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-5a41d62d-295c-4e66-9dd5-c8971b3ef3d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '381996f8198c4420abeead81a4aaf84f'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:15.142005 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-5a41d62d-295c-4e66-9dd5-c8971b3ef3d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '381996f8198c4420abeead81a4aaf84f'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:15.166261 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 983/1959] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 11:34:14 2022] DELETE /identity/v3/users/381996f8198c4420abeead81a4aaf84f => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:34:15.196841 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:15.243251 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcd47df-df92-46f9-a6ba-427722ecfc97 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:15.244930 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcd47df-df92-46f9-a6ba-427722ecfc97 service cinder] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:15.265047 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 977/1960] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:34:14 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 11:34:15.550798 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a41d62d-295c-4e66-9dd5-c8971b3ef3d6 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:15.552525 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-5a41d62d-295c-4e66-9dd5-c8971b3ef3d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:15.580569 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:DELETE=18,keystone:SELECT=80,keystone:INSERT=2 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:15.674753 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a41d62d-295c-4e66-9dd5-c8971b3ef3d6 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:15.682674 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f258e2b-2f02-4a84-8d1e-4f6c3fa4ffa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:15.684582 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f258e2b-2f02-4a84-8d1e-4f6c3fa4ffa0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:15.684874 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f258e2b-2f02-4a84-8d1e-4f6c3fa4ffa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:15.685154 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f258e2b-2f02-4a84-8d1e-4f6c3fa4ffa0 admin admin] PATH_INFO: `/v3/users/22e0806609574a9fbfaf37d552846287` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:15.686421 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f258e2b-2f02-4a84-8d1e-4f6c3fa4ffa0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=22e0806609574a9fbfaf37d552846287)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:15.688602 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f258e2b-2f02-4a84-8d1e-4f6c3fa4ffa0 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:15.781691 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-9f258e2b-2f02-4a84-8d1e-4f6c3fa4ffa0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22e0806609574a9fbfaf37d552846287'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:15.782943 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-9f258e2b-2f02-4a84-8d1e-4f6c3fa4ffa0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22e0806609574a9fbfaf37d552846287'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:15.784039 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-9f258e2b-2f02-4a84-8d1e-4f6c3fa4ffa0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22e0806609574a9fbfaf37d552846287'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:15.815503 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-9f258e2b-2f02-4a84-8d1e-4f6c3fa4ffa0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22e0806609574a9fbfaf37d552846287'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:15.830477 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-9f258e2b-2f02-4a84-8d1e-4f6c3fa4ffa0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22e0806609574a9fbfaf37d552846287'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:15.880631 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 984/1961] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 11:34:15 2022] DELETE /identity/v3/users/22e0806609574a9fbfaf37d552846287 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:34:15.885224 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14814a3a-1549-4761-a56f-ab5a228b1340 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:15.886128 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14814a3a-1549-4761-a56f-ab5a228b1340 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:15.886606 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14814a3a-1549-4761-a56f-ab5a228b1340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:15.932518 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-14814a3a-1549-4761-a56f-ab5a228b1340 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:34:15.940226 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-14814a3a-1549-4761-a56f-ab5a228b1340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:16.119320 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 978/1962] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:34:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:34:16.156476 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f258e2b-2f02-4a84-8d1e-4f6c3fa4ffa0 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:16.157999 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-9f258e2b-2f02-4a84-8d1e-4f6c3fa4ffa0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:16.281779 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14814a3a-1549-4761-a56f-ab5a228b1340 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:16.284896 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-14814a3a-1549-4761-a56f-ab5a228b1340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:16.319389 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f258e2b-2f02-4a84-8d1e-4f6c3fa4ffa0 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:16.326718 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a2d8a4-eae8-460c-b323-eae6c6f8c8a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2d061d25d83443c9232218c90792d51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:16.327470 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a2d8a4-eae8-460c-b323-eae6c6f8c8a1 service neutron] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:16.327850 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a2d8a4-eae8-460c-b323-eae6c6f8c8a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:16.328113 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a2d8a4-eae8-460c-b323-eae6c6f8c8a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:16.342509 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a2d8a4-eae8-460c-b323-eae6c6f8c8a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:16.344576 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a2d8a4-eae8-460c-b323-eae6c6f8c8a1 service neutron] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:16.358607 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 985/1963] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:34:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:34:16.405025 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14814a3a-1549-4761-a56f-ab5a228b1340 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:16.413418 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d78ffed-0919-4092-a7dd-206e9b0cd06b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92862b76ba3b4513b5dc5b5c962faac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:16.414143 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d78ffed-0919-4092-a7dd-206e9b0cd06b service cinder] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:16.414452 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d78ffed-0919-4092-a7dd-206e9b0cd06b service cinder] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:16.415077 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d78ffed-0919-4092-a7dd-206e9b0cd06b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:16.425379 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-7d78ffed-0919-4092-a7dd-206e9b0cd06b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:16.502762 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a2d8a4-eae8-460c-b323-eae6c6f8c8a1 service neutron] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:16.505097 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-02a2d8a4-eae8-460c-b323-eae6c6f8c8a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:16.523043 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a2d8a4-eae8-460c-b323-eae6c6f8c8a1 service neutron] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:16.531252 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfff4cdf-3c33-448a-b504-768f0cefb6e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:16.532363 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfff4cdf-3c33-448a-b504-768f0cefb6e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:16.532644 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfff4cdf-3c33-448a-b504-768f0cefb6e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:16.533073 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfff4cdf-3c33-448a-b504-768f0cefb6e4 admin admin] PATH_INFO: `/v3/projects/a9a32ef73a244cd5b70280ae9fa1e13b` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:16.534718 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfff4cdf-3c33-448a-b504-768f0cefb6e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9a32ef73a244cd5b70280ae9fa1e13b)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:16.537542 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfff4cdf-3c33-448a-b504-768f0cefb6e4 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:16.599713 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d78ffed-0919-4092-a7dd-206e9b0cd06b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:16.603644 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d78ffed-0919-4092-a7dd-206e9b0cd06b service cinder] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:16.629768 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 979/1964] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:34:16 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 11:34:16.652119 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:16.674764 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-dfff4cdf-3c33-448a-b504-768f0cefb6e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9a32ef73a244cd5b70280ae9fa1e13b', 'request_id': 'req-dfff4cdf-3c33-448a-b504-768f0cefb6e4'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:16.684511 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-dfff4cdf-3c33-448a-b504-768f0cefb6e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9a32ef73a244cd5b70280ae9fa1e13b', 'request_id': 'req-dfff4cdf-3c33-448a-b504-768f0cefb6e4'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:16.690710 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-dfff4cdf-3c33-448a-b504-768f0cefb6e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9a32ef73a244cd5b70280ae9fa1e13b', 'request_id': 'req-dfff4cdf-3c33-448a-b504-768f0cefb6e4'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:16.709090 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-dfff4cdf-3c33-448a-b504-768f0cefb6e4 admin admin] The token cache is being invalidate because project a9a32ef73a244cd5b70280ae9fa1e13b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81501) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:34:16.709388 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-dfff4cdf-3c33-448a-b504-768f0cefb6e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:16.710153 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-dfff4cdf-3c33-448a-b504-768f0cefb6e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:16.712953 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 986/1965] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 11:34:16 2022] DELETE /identity/v3/projects/a9a32ef73a244cd5b70280ae9fa1e13b => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:34:16.723158 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc9092f-4fc8-42b0-9952-d314adf682ee None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:16.723652 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc9092f-4fc8-42b0-9952-d314adf682ee None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:16.724106 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc9092f-4fc8-42b0-9952-d314adf682ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:16.749187 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-5bc9092f-4fc8-42b0-9952-d314adf682ee None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:34:16.750665 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-5bc9092f-4fc8-42b0-9952-d314adf682ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:16.862315 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:16.901560 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 980/1966] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:34:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:34:16.920989 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9585b17b-c592-425f-8d11-916084974e9d None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:16.922473 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9585b17b-c592-425f-8d11-916084974e9d None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:16.923429 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9585b17b-c592-425f-8d11-916084974e9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:16.945380 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc9092f-4fc8-42b0-9952-d314adf682ee None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:16.947284 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-5bc9092f-4fc8-42b0-9952-d314adf682ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:16.969408 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc9092f-4fc8-42b0-9952-d314adf682ee None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:16.979709 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-9585b17b-c592-425f-8d11-916084974e9d None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:34:16.984402 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-9585b17b-c592-425f-8d11-916084974e9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:16.997870 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52996a0-8748-4b6d-a25a-40b69e57b9b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:16.998669 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52996a0-8748-4b6d-a25a-40b69e57b9b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:16.999016 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52996a0-8748-4b6d-a25a-40b69e57b9b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:16.999638 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52996a0-8748-4b6d-a25a-40b69e57b9b7 admin admin] PATH_INFO: `/v3/projects/51fe7bd2bec34d278d5695c859f5dabc` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:17.002802 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52996a0-8748-4b6d-a25a-40b69e57b9b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=51fe7bd2bec34d278d5695c859f5dabc)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:17.011344 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52996a0-8748-4b6d-a25a-40b69e57b9b7 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:17.024468 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 987/1967] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:34:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:34:17.027384 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9585b17b-c592-425f-8d11-916084974e9d None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:17.042339 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9585b17b-c592-425f-8d11-916084974e9d None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:17.053208 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62991e34-4bb2-48fe-868f-4f11d402e4e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:17.053879 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62991e34-4bb2-48fe-868f-4f11d402e4e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:17.054725 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62991e34-4bb2-48fe-868f-4f11d402e4e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:17.056072 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62991e34-4bb2-48fe-868f-4f11d402e4e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:17.057798 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62991e34-4bb2-48fe-868f-4f11d402e4e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:34:17.058283 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62991e34-4bb2-48fe-868f-4f11d402e4e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:17.066577 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62991e34-4bb2-48fe-868f-4f11d402e4e1 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:17.103829 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 988/1968] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 24 11:34:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:34:17.112956 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62991e34-4bb2-48fe-868f-4f11d402e4e1 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:17.135800 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-d52996a0-8748-4b6d-a25a-40b69e57b9b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51fe7bd2bec34d278d5695c859f5dabc', 'request_id': 'req-d52996a0-8748-4b6d-a25a-40b69e57b9b7'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:17.141225 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62991e34-4bb2-48fe-868f-4f11d402e4e1 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:17.146413 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-d52996a0-8748-4b6d-a25a-40b69e57b9b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51fe7bd2bec34d278d5695c859f5dabc', 'request_id': 'req-d52996a0-8748-4b6d-a25a-40b69e57b9b7'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:17.153512 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-d52996a0-8748-4b6d-a25a-40b69e57b9b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51fe7bd2bec34d278d5695c859f5dabc', 'request_id': 'req-d52996a0-8748-4b6d-a25a-40b69e57b9b7'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:17.170268 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-d52996a0-8748-4b6d-a25a-40b69e57b9b7 admin admin] The token cache is being invalidate because project 51fe7bd2bec34d278d5695c859f5dabc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:34:17.170791 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-d52996a0-8748-4b6d-a25a-40b69e57b9b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:17.172203 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-d52996a0-8748-4b6d-a25a-40b69e57b9b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:17.174405 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 981/1969] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 11:34:16 2022] DELETE /identity/v3/projects/51fe7bd2bec34d278d5695c859f5dabc => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:34:17.178068 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52996a0-8748-4b6d-a25a-40b69e57b9b7 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:17.180341 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-d52996a0-8748-4b6d-a25a-40b69e57b9b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:17.211839 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68ba5cb-025d-4ae0-a8b9-7769ede95dc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:17.213042 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68ba5cb-025d-4ae0-a8b9-7769ede95dc6 admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:17.213468 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68ba5cb-025d-4ae0-a8b9-7769ede95dc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:17.213883 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68ba5cb-025d-4ae0-a8b9-7769ede95dc6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:17.214735 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68ba5cb-025d-4ae0-a8b9-7769ede95dc6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:17.217005 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68ba5cb-025d-4ae0-a8b9-7769ede95dc6 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:17.250398 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 989/1970] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 11:34:17 2022] POST /identity/v3/projects => generated 381 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:34:17.252944 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68ba5cb-025d-4ae0-a8b9-7769ede95dc6 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:17.254981 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-d68ba5cb-025d-4ae0-a8b9-7769ede95dc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:17.264011 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52996a0-8748-4b6d-a25a-40b69e57b9b7 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:17.328264 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4128ce99-eab5-4454-951a-7ed68cb05cf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:17.328491 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68ba5cb-025d-4ae0-a8b9-7769ede95dc6 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:17.328821 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4128ce99-eab5-4454-951a-7ed68cb05cf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:17.329095 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4128ce99-eab5-4454-951a-7ed68cb05cf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:17.329360 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4128ce99-eab5-4454-951a-7ed68cb05cf7 admin admin] PATH_INFO: `/v3/users/d9f5c3a113ed4fd6bbc84206889e9023` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:17.330601 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4128ce99-eab5-4454-951a-7ed68cb05cf7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9f5c3a113ed4fd6bbc84206889e9023)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:17.332846 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4128ce99-eab5-4454-951a-7ed68cb05cf7 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:17.334636 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffeb194-528e-4c39-8d03-da84031e00bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:17.335521 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffeb194-528e-4c39-8d03-da84031e00bb admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:17.335721 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffeb194-528e-4c39-8d03-da84031e00bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:17.335987 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffeb194-528e-4c39-8d03-da84031e00bb admin admin] PATH_INFO: `/v3/users` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:17.336650 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffeb194-528e-4c39-8d03-da84031e00bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:17.338641 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffeb194-528e-4c39-8d03-da84031e00bb admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:17.349644 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:17.375635 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 990/1971] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 11:34:17 2022] POST /identity/v3/users => generated 291 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 11:34:17.380013 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffeb194-528e-4c39-8d03-da84031e00bb admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:17.406532 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffeb194-528e-4c39-8d03-da84031e00bb admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:17.413718 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2a81d2-58c1-4ef9-9a5a-7c1b93135248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:17.414501 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2a81d2-58c1-4ef9-9a5a-7c1b93135248 admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:17.414786 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2a81d2-58c1-4ef9-9a5a-7c1b93135248 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:17.415215 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2a81d2-58c1-4ef9-9a5a-7c1b93135248 admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:17.415780 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2a81d2-58c1-4ef9-9a5a-7c1b93135248 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:17.417533 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2a81d2-58c1-4ef9-9a5a-7c1b93135248 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:17.421568 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-4128ce99-eab5-4454-951a-7ed68cb05cf7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9f5c3a113ed4fd6bbc84206889e9023'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:17.422314 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-4128ce99-eab5-4454-951a-7ed68cb05cf7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9f5c3a113ed4fd6bbc84206889e9023'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:17.430060 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 991/1972] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:34:17 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:34:17.434937 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2a81d2-58c1-4ef9-9a5a-7c1b93135248 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:17.437393 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-3d2a81d2-58c1-4ef9-9a5a-7c1b93135248 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:17.439379 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-4128ce99-eab5-4454-951a-7ed68cb05cf7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9f5c3a113ed4fd6bbc84206889e9023'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:17.452219 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-4128ce99-eab5-4454-951a-7ed68cb05cf7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9f5c3a113ed4fd6bbc84206889e9023'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:17.453440 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:17.454076 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-4128ce99-eab5-4454-951a-7ed68cb05cf7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9f5c3a113ed4fd6bbc84206889e9023'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:17.458188 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2a81d2-58c1-4ef9-9a5a-7c1b93135248 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:17.465816 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78090f70-0125-43f2-8dab-8cfb39e926d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:17.466945 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78090f70-0125-43f2-8dab-8cfb39e926d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:17.466945 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78090f70-0125-43f2-8dab-8cfb39e926d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:17.467261 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78090f70-0125-43f2-8dab-8cfb39e926d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:17.468477 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78090f70-0125-43f2-8dab-8cfb39e926d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:17.471347 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78090f70-0125-43f2-8dab-8cfb39e926d1 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:17.485491 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 992/1973] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:34:17 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:34:17.488742 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78090f70-0125-43f2-8dab-8cfb39e926d1 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:17.492758 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 982/1974] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 11:34:17 2022] DELETE /identity/v3/users/d9f5c3a113ed4fd6bbc84206889e9023 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 11:34:17.499629 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78090f70-0125-43f2-8dab-8cfb39e926d1 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:17.610857 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed6c888-445b-4ce5-b282-1dbc916165a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:17.612180 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed6c888-445b-4ce5-b282-1dbc916165a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:17.612785 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed6c888-445b-4ce5-b282-1dbc916165a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:17.613227 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed6c888-445b-4ce5-b282-1dbc916165a0 admin admin] PATH_INFO: `/v3/projects/8033d0755d1c46fe8ced1b3595a0ea5a/users/806a72fb5ba143ca8648d39e4f70520b/roles/27e3e65e24df4b86b0d3d18d3212101d` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:17.634691 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed6c888-445b-4ce5-b282-1dbc916165a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8033d0755d1c46fe8ced1b3595a0ea5a, user_id=806a72fb5ba143ca8648d39e4f70520b, role_id=27e3e65e24df4b86b0d3d18d3212101d)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:17.637920 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed6c888-445b-4ce5-b282-1dbc916165a0 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:17.661594 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 993/1975] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 11:34:17 2022] PUT /identity/v3/projects/8033d0755d1c46fe8ced1b3595a0ea5a/users/806a72fb5ba143ca8648d39e4f70520b/roles/27e3e65e24df4b86b0d3d18d3212101d => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 11:34:17.676259 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf2982e-2356-4377-9746-a7638d0e0534 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:17.676756 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf2982e-2356-4377-9746-a7638d0e0534 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:17.677973 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf2982e-2356-4377-9746-a7638d0e0534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:17.718387 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-cdf2982e-2356-4377-9746-a7638d0e0534 None None] MFA Rules not processed for user `806a72fb5ba143ca8648d39e4f70520b`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:34:17.719793 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-cdf2982e-2356-4377-9746-a7638d0e0534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:17.845285 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 983/1976] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:34:17 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:34:17.849925 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed6c888-445b-4ce5-b282-1dbc916165a0 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:17.934537 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed6c888-445b-4ce5-b282-1dbc916165a0 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:17.939617 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedfbf0c-aa8b-48d1-aba2-a32dfe0af5d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:17.940328 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedfbf0c-aa8b-48d1-aba2-a32dfe0af5d7 admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:17.940668 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedfbf0c-aa8b-48d1-aba2-a32dfe0af5d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:17.941004 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedfbf0c-aa8b-48d1-aba2-a32dfe0af5d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:17.942128 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedfbf0c-aa8b-48d1-aba2-a32dfe0af5d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:17.944213 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedfbf0c-aa8b-48d1-aba2-a32dfe0af5d7 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:17.996792 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 994/1977] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 11:34:17 2022] POST /identity/v3/projects => generated 383 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:34:18.000073 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf2982e-2356-4377-9746-a7638d0e0534 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:18.018694 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf2982e-2356-4377-9746-a7638d0e0534 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:18.144736 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca562bc5-0d02-49ab-a27d-e79b77b47c53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:18.145596 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca562bc5-0d02-49ab-a27d-e79b77b47c53 admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:18.146105 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca562bc5-0d02-49ab-a27d-e79b77b47c53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:18.146751 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca562bc5-0d02-49ab-a27d-e79b77b47c53 admin admin] PATH_INFO: `/v3/users` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:18.147850 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca562bc5-0d02-49ab-a27d-e79b77b47c53 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:18.151720 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca562bc5-0d02-49ab-a27d-e79b77b47c53 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:18.209430 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 984/1978] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 11:34:17 2022] POST /identity/v3/users => generated 298 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:34:18.210339 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedfbf0c-aa8b-48d1-aba2-a32dfe0af5d7 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:18.251549 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedfbf0c-aa8b-48d1-aba2-a32dfe0af5d7 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:18.258809 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257319d9-3e49-4dc8-94ff-d369a0e419b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:18.260272 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257319d9-3e49-4dc8-94ff-d369a0e419b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:18.260841 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257319d9-3e49-4dc8-94ff-d369a0e419b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:18.261217 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257319d9-3e49-4dc8-94ff-d369a0e419b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:18.262020 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257319d9-3e49-4dc8-94ff-d369a0e419b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:18.263796 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257319d9-3e49-4dc8-94ff-d369a0e419b7 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:18.282639 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 995/1979] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:34:18 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:34:18.283398 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca562bc5-0d02-49ab-a27d-e79b77b47c53 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:18.295088 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca562bc5-0d02-49ab-a27d-e79b77b47c53 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:18.302454 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18a45ed-a038-4755-ae10-dd40b4683054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:18.303146 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18a45ed-a038-4755-ae10-dd40b4683054 admin admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:18.303453 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18a45ed-a038-4755-ae10-dd40b4683054 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:18.303725 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18a45ed-a038-4755-ae10-dd40b4683054 admin admin] PATH_INFO: `/v3/projects/9475f716a53c4dafb871845789ea4f18/users/20b930ce74c24261afb39c89f286dffc/roles/30bb1e97257f4ca5b90c88545777317b` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:18.315585 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:18.325789 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18a45ed-a038-4755-ae10-dd40b4683054 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9475f716a53c4dafb871845789ea4f18, user_id=20b930ce74c24261afb39c89f286dffc, role_id=30bb1e97257f4ca5b90c88545777317b)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:18.328603 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18a45ed-a038-4755-ae10-dd40b4683054 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:18.370521 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 985/1980] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 11:34:18 2022] PUT /identity/v3/projects/9475f716a53c4dafb871845789ea4f18/users/20b930ce74c24261afb39c89f286dffc/roles/30bb1e97257f4ca5b90c88545777317b => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 11:34:18.371783 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257319d9-3e49-4dc8-94ff-d369a0e419b7 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:18.405112 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257319d9-3e49-4dc8-94ff-d369a0e419b7 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:18.435667 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18a45ed-a038-4755-ae10-dd40b4683054 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:18.437449 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-c18a45ed-a038-4755-ae10-dd40b4683054 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:18.469450 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:18.484986 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c4fec1-2cd8-4ea2-8702-d04802e091dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:18.486179 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c4fec1-2cd8-4ea2-8702-d04802e091dd admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:18.486658 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c4fec1-2cd8-4ea2-8702-d04802e091dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:18.487145 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c4fec1-2cd8-4ea2-8702-d04802e091dd admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:18.488262 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c4fec1-2cd8-4ea2-8702-d04802e091dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:18.490108 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c4fec1-2cd8-4ea2-8702-d04802e091dd admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:18.502338 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 996/1981] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:34:18 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:34:18.506936 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c4fec1-2cd8-4ea2-8702-d04802e091dd admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:18.518158 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c4fec1-2cd8-4ea2-8702-d04802e091dd admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:18.523776 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40770b2a-5a4a-4e54-a21e-736dd1433d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:18.524670 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40770b2a-5a4a-4e54-a21e-736dd1433d42 admin admin] REQUEST_METHOD: `PUT` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:18.525096 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40770b2a-5a4a-4e54-a21e-736dd1433d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:18.525514 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40770b2a-5a4a-4e54-a21e-736dd1433d42 admin admin] PATH_INFO: `/v3/projects/9475f716a53c4dafb871845789ea4f18/users/20b930ce74c24261afb39c89f286dffc/roles/30bb1e97257f4ca5b90c88545777317b` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:18.527946 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40770b2a-5a4a-4e54-a21e-736dd1433d42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9475f716a53c4dafb871845789ea4f18, user_id=20b930ce74c24261afb39c89f286dffc, role_id=30bb1e97257f4ca5b90c88545777317b)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:18.531250 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40770b2a-5a4a-4e54-a21e-736dd1433d42 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:18.541383 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18a45ed-a038-4755-ae10-dd40b4683054 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:18.545009 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 997/1982] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 11:34:18 2022] PUT /identity/v3/projects/9475f716a53c4dafb871845789ea4f18/users/20b930ce74c24261afb39c89f286dffc/roles/30bb1e97257f4ca5b90c88545777317b => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 11:34:18.556068 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1c663f-c943-4869-bc88-0dd573ea7baf None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:18.556828 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1c663f-c943-4869-bc88-0dd573ea7baf None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:18.557105 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1c663f-c943-4869-bc88-0dd573ea7baf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:18.590834 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-eb1c663f-c943-4869-bc88-0dd573ea7baf None None] MFA Rules not processed for user `20b930ce74c24261afb39c89f286dffc`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:34:18.593532 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-eb1c663f-c943-4869-bc88-0dd573ea7baf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:18.654590 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6726f2-9b83-4026-b9fd-f01964b36be1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:18.655465 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6726f2-9b83-4026-b9fd-f01964b36be1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:18.655811 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6726f2-9b83-4026-b9fd-f01964b36be1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:18.656215 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6726f2-9b83-4026-b9fd-f01964b36be1 admin admin] PATH_INFO: `/v3/projects/0b65004874da440fb61dbee1b6250237` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:18.657722 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6726f2-9b83-4026-b9fd-f01964b36be1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b65004874da440fb61dbee1b6250237)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:18.660391 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6726f2-9b83-4026-b9fd-f01964b36be1 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:18.681146 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 998/1983] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:34:18 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:34:18.695528 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1c663f-c943-4869-bc88-0dd573ea7baf None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:18.697078 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-eb1c663f-c943-4869-bc88-0dd573ea7baf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:18.721993 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-ca6726f2-9b83-4026-b9fd-f01964b36be1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b65004874da440fb61dbee1b6250237', 'request_id': 'req-ca6726f2-9b83-4026-b9fd-f01964b36be1'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:18.730606 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-ca6726f2-9b83-4026-b9fd-f01964b36be1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b65004874da440fb61dbee1b6250237', 'request_id': 'req-ca6726f2-9b83-4026-b9fd-f01964b36be1'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:18.738184 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-ca6726f2-9b83-4026-b9fd-f01964b36be1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b65004874da440fb61dbee1b6250237', 'request_id': 'req-ca6726f2-9b83-4026-b9fd-f01964b36be1'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:18.756403 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-ca6726f2-9b83-4026-b9fd-f01964b36be1 admin admin] The token cache is being invalidate because project 0b65004874da440fb61dbee1b6250237 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:34:18.756943 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-ca6726f2-9b83-4026-b9fd-f01964b36be1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:18.757924 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-ca6726f2-9b83-4026-b9fd-f01964b36be1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:18.760259 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 986/1984] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 11:34:18 2022] DELETE /identity/v3/projects/0b65004874da440fb61dbee1b6250237 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:34:18.765432 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920d1db6-e157-499c-b505-68bc72e006a5 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:18.765943 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920d1db6-e157-499c-b505-68bc72e006a5 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:18.766235 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920d1db6-e157-499c-b505-68bc72e006a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:18.781364 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1c663f-c943-4869-bc88-0dd573ea7baf None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:18.819271 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-920d1db6-e157-499c-b505-68bc72e006a5 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:34:18.820515 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-920d1db6-e157-499c-b505-68bc72e006a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:18.854060 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:18.854605 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616009da-3233-4d43-9723-f4bb3e285f7f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92862b76ba3b4513b5dc5b5c962faac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:18.855563 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616009da-3233-4d43-9723-f4bb3e285f7f service cinder] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:18.855834 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616009da-3233-4d43-9723-f4bb3e285f7f service cinder] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:18.856171 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616009da-3233-4d43-9723-f4bb3e285f7f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:18.859006 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-616009da-3233-4d43-9723-f4bb3e285f7f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:18.894008 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:18.903066 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 987/1985] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:34:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:34:18.910975 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce2fb19-3cec-4f8b-b590-96fb5bb13d55 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:18.911334 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce2fb19-3cec-4f8b-b590-96fb5bb13d55 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:18.911608 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce2fb19-3cec-4f8b-b590-96fb5bb13d55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:18.930665 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-5ce2fb19-3cec-4f8b-b590-96fb5bb13d55 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:34:18.931853 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-5ce2fb19-3cec-4f8b-b590-96fb5bb13d55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:18.934956 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616009da-3233-4d43-9723-f4bb3e285f7f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:18.936462 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616009da-3233-4d43-9723-f4bb3e285f7f service cinder] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:18.940319 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 988/1986] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:34:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 11:34:18.944403 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce2fb19-3cec-4f8b-b590-96fb5bb13d55 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:18.946262 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 999/1987] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:34:18 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 11:34:18.953837 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce2fb19-3cec-4f8b-b590-96fb5bb13d55 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:18.958605 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd61edc-d8ef-4fb8-a4e3-d300a11980bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:18.959228 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd61edc-d8ef-4fb8-a4e3-d300a11980bf admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:18.959499 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd61edc-d8ef-4fb8-a4e3-d300a11980bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:18.960026 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd61edc-d8ef-4fb8-a4e3-d300a11980bf admin admin] PATH_INFO: `/v3/domains` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:18.960496 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd61edc-d8ef-4fb8-a4e3-d300a11980bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:34:18.960811 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd61edc-d8ef-4fb8-a4e3-d300a11980bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:18.962423 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd61edc-d8ef-4fb8-a4e3-d300a11980bf admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:18.974237 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 989/1988] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 24 11:34:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:34:18.978598 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616009da-3233-4d43-9723-f4bb3e285f7f service cinder] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:18.989357 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616009da-3233-4d43-9723-f4bb3e285f7f service cinder] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:18.995001 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e525d2-5596-4986-849a-c1771bcf44a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:18.995617 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e525d2-5596-4986-849a-c1771bcf44a1 admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:18.995894 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e525d2-5596-4986-849a-c1771bcf44a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:18.996180 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e525d2-5596-4986-849a-c1771bcf44a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:18.996845 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e525d2-5596-4986-849a-c1771bcf44a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:18.998798 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e525d2-5596-4986-849a-c1771bcf44a1 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:19.027604 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1000/1989] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 11:34:18 2022] POST /identity/v3/projects => generated 389 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 11:34:19.031777 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd61edc-d8ef-4fb8-a4e3-d300a11980bf admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:19.047120 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd61edc-d8ef-4fb8-a4e3-d300a11980bf admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:19.057346 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e525d2-5596-4986-849a-c1771bcf44a1 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:19.059434 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-80e525d2-5596-4986-849a-c1771bcf44a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:19.119794 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48e926e-aa24-4f81-aaca-7b3912b3382a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:19.120410 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48e926e-aa24-4f81-aaca-7b3912b3382a admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:19.120689 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48e926e-aa24-4f81-aaca-7b3912b3382a admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:19.120956 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48e926e-aa24-4f81-aaca-7b3912b3382a admin admin] PATH_INFO: `/v3/users` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:19.121574 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e525d2-5596-4986-849a-c1771bcf44a1 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:19.121684 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48e926e-aa24-4f81-aaca-7b3912b3382a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:19.123561 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48e926e-aa24-4f81-aaca-7b3912b3382a admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:19.125588 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f158beb7-2e60-4ed4-9ffb-ffe37bacb2e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92862b76ba3b4513b5dc5b5c962faac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:19.126197 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f158beb7-2e60-4ed4-9ffb-ffe37bacb2e0 service cinder] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:19.126538 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f158beb7-2e60-4ed4-9ffb-ffe37bacb2e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:19.126806 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f158beb7-2e60-4ed4-9ffb-ffe37bacb2e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:19.128708 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-f158beb7-2e60-4ed4-9ffb-ffe37bacb2e0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:19.148802 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 990/1990] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 11:34:19 2022] POST /identity/v3/users => generated 295 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:34:19.150102 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48e926e-aa24-4f81-aaca-7b3912b3382a admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:19.159695 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48e926e-aa24-4f81-aaca-7b3912b3382a admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:19.164627 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1129914e-2d48-4c8d-80d0-10da826683e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:19.165217 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1129914e-2d48-4c8d-80d0-10da826683e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:19.165494 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1129914e-2d48-4c8d-80d0-10da826683e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:19.165770 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1129914e-2d48-4c8d-80d0-10da826683e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:19.166443 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1129914e-2d48-4c8d-80d0-10da826683e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:19.168048 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1129914e-2d48-4c8d-80d0-10da826683e9 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:19.182398 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 991/1991] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:34:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:34:19.185371 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1129914e-2d48-4c8d-80d0-10da826683e9 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:19.196086 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f158beb7-2e60-4ed4-9ffb-ffe37bacb2e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:19.197598 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f158beb7-2e60-4ed4-9ffb-ffe37bacb2e0 service cinder] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:19.201369 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1129914e-2d48-4c8d-80d0-10da826683e9 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:19.207627 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1001/1992] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:34:19 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 11:34:19.209942 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbf6a3c-e642-44d5-997c-652423346249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:19.209942 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbf6a3c-e642-44d5-997c-652423346249 admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:19.210215 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbf6a3c-e642-44d5-997c-652423346249 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:19.210337 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbf6a3c-e642-44d5-997c-652423346249 admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:19.211114 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbf6a3c-e642-44d5-997c-652423346249 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:19.212682 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbf6a3c-e642-44d5-997c-652423346249 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:19.223273 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 992/1993] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:34:19 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 11:34:19.227724 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f158beb7-2e60-4ed4-9ffb-ffe37bacb2e0 service cinder] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:19.238941 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f158beb7-2e60-4ed4-9ffb-ffe37bacb2e0 service cinder] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:19.248493 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511ce806-9380-43c7-9695-272bf0b0d3ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:19.249184 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511ce806-9380-43c7-9695-272bf0b0d3ea admin admin] REQUEST_METHOD: `PUT` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:19.249465 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511ce806-9380-43c7-9695-272bf0b0d3ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:19.249742 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511ce806-9380-43c7-9695-272bf0b0d3ea admin admin] PATH_INFO: `/v3/projects/c7b13255d4334f03b86df7618ab91938/users/7e4a3164765d48be8dd495217730a82d/roles/27e3e65e24df4b86b0d3d18d3212101d` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:19.267831 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511ce806-9380-43c7-9695-272bf0b0d3ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7b13255d4334f03b86df7618ab91938, user_id=7e4a3164765d48be8dd495217730a82d, role_id=27e3e65e24df4b86b0d3d18d3212101d)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:19.271370 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511ce806-9380-43c7-9695-272bf0b0d3ea admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:19.289509 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1002/1994] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 11:34:19 2022] PUT /identity/v3/projects/c7b13255d4334f03b86df7618ab91938/users/7e4a3164765d48be8dd495217730a82d/roles/27e3e65e24df4b86b0d3d18d3212101d => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:34:19.301961 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53355630-c638-41e8-8978-957dc895ce1f None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:19.302402 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53355630-c638-41e8-8978-957dc895ce1f None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:19.302749 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53355630-c638-41e8-8978-957dc895ce1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:19.350378 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-53355630-c638-41e8-8978-957dc895ce1f None None] MFA Rules not processed for user `7e4a3164765d48be8dd495217730a82d`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:34:19.351897 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-53355630-c638-41e8-8978-957dc895ce1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:19.422675 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 993/1995] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:34:19 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:34:19.427355 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511ce806-9380-43c7-9695-272bf0b0d3ea admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:19.477024 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:19.554316 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511ce806-9380-43c7-9695-272bf0b0d3ea admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:19.567122 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6a0e8c-62ec-4c0b-8f70-30e208af516a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:19.567763 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6a0e8c-62ec-4c0b-8f70-30e208af516a admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:19.570469 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6a0e8c-62ec-4c0b-8f70-30e208af516a admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:19.572337 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6a0e8c-62ec-4c0b-8f70-30e208af516a admin admin] PATH_INFO: `/v3/projects` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:19.573497 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6a0e8c-62ec-4c0b-8f70-30e208af516a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:19.577671 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6a0e8c-62ec-4c0b-8f70-30e208af516a admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:19.662482 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1003/1996] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 11:34:19 2022] POST /identity/v3/projects => generated 389 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 11:34:19.664534 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53355630-c638-41e8-8978-957dc895ce1f None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:19.670561 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:19.679046 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53355630-c638-41e8-8978-957dc895ce1f None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:19.770766 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06e849d-02d8-4a46-b76e-7042c6b6b366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:19.771406 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06e849d-02d8-4a46-b76e-7042c6b6b366 admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:19.771743 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06e849d-02d8-4a46-b76e-7042c6b6b366 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:19.772014 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06e849d-02d8-4a46-b76e-7042c6b6b366 admin admin] PATH_INFO: `/v3/users` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:19.772651 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06e849d-02d8-4a46-b76e-7042c6b6b366 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:19.774608 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06e849d-02d8-4a46-b76e-7042c6b6b366 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:19.803947 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 994/1997] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 11:34:19 2022] POST /identity/v3/users => generated 301 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:34:19.808386 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6a0e8c-62ec-4c0b-8f70-30e208af516a admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:19.821335 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6a0e8c-62ec-4c0b-8f70-30e208af516a admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:19.826072 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f47736a-e8f0-4e1d-ba2a-e4d9ee5f1aa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:19.826885 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f47736a-e8f0-4e1d-ba2a-e4d9ee5f1aa8 admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:19.827167 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f47736a-e8f0-4e1d-ba2a-e4d9ee5f1aa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:19.827617 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f47736a-e8f0-4e1d-ba2a-e4d9ee5f1aa8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:19.828274 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f47736a-e8f0-4e1d-ba2a-e4d9ee5f1aa8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:19.829986 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f47736a-e8f0-4e1d-ba2a-e4d9ee5f1aa8 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:19.845248 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1004/1998] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:34:19 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:34:19.846450 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06e849d-02d8-4a46-b76e-7042c6b6b366 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:19.870006 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06e849d-02d8-4a46-b76e-7042c6b6b366 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:19.877373 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507640bb-5f74-4fbf-9b31-ac75f6860db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:19.878059 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507640bb-5f74-4fbf-9b31-ac75f6860db1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:19.878336 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507640bb-5f74-4fbf-9b31-ac75f6860db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:19.878674 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507640bb-5f74-4fbf-9b31-ac75f6860db1 admin admin] PATH_INFO: `/v3/projects/6d72449a620149fb86dee75a33f68f8b/users/720510a443f74e9ca54d917e4af0bfef/roles/30bb1e97257f4ca5b90c88545777317b` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:19.895788 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507640bb-5f74-4fbf-9b31-ac75f6860db1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d72449a620149fb86dee75a33f68f8b, user_id=720510a443f74e9ca54d917e4af0bfef, role_id=30bb1e97257f4ca5b90c88545777317b)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:19.899091 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507640bb-5f74-4fbf-9b31-ac75f6860db1 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:19.913933 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 995/1999] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 11:34:19 2022] PUT /identity/v3/projects/6d72449a620149fb86dee75a33f68f8b/users/720510a443f74e9ca54d917e4af0bfef/roles/30bb1e97257f4ca5b90c88545777317b => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:34:19.918180 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f47736a-e8f0-4e1d-ba2a-e4d9ee5f1aa8 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:19.928703 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f47736a-e8f0-4e1d-ba2a-e4d9ee5f1aa8 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:19.997568 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da154b65-1ae3-44aa-afb0-2f89f35178dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:19.998207 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da154b65-1ae3-44aa-afb0-2f89f35178dc admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:19.998510 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da154b65-1ae3-44aa-afb0-2f89f35178dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:19.998778 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da154b65-1ae3-44aa-afb0-2f89f35178dc admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:19.999422 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da154b65-1ae3-44aa-afb0-2f89f35178dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:20.001070 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da154b65-1ae3-44aa-afb0-2f89f35178dc admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:20.016409 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1005/2000] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:34:19 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:34:20.017475 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507640bb-5f74-4fbf-9b31-ac75f6860db1 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:20.029397 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507640bb-5f74-4fbf-9b31-ac75f6860db1 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:20.034405 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28197fbf-9870-41ad-a90e-8ccd7f223574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:20.035106 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28197fbf-9870-41ad-a90e-8ccd7f223574 admin admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:20.035385 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28197fbf-9870-41ad-a90e-8ccd7f223574 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:20.035776 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28197fbf-9870-41ad-a90e-8ccd7f223574 admin admin] PATH_INFO: `/v3/projects/6d72449a620149fb86dee75a33f68f8b/users/720510a443f74e9ca54d917e4af0bfef/roles/30bb1e97257f4ca5b90c88545777317b` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:20.038689 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28197fbf-9870-41ad-a90e-8ccd7f223574 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d72449a620149fb86dee75a33f68f8b, user_id=720510a443f74e9ca54d917e4af0bfef, role_id=30bb1e97257f4ca5b90c88545777317b)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:20.041876 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28197fbf-9870-41ad-a90e-8ccd7f223574 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:20.054324 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 996/2001] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 11:34:20 2022] PUT /identity/v3/projects/6d72449a620149fb86dee75a33f68f8b/users/720510a443f74e9ca54d917e4af0bfef/roles/30bb1e97257f4ca5b90c88545777317b => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 11:34:20.068291 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69817eb-093b-4399-9139-d7ff0ad52984 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:20.068706 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69817eb-093b-4399-9139-d7ff0ad52984 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:20.069114 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69817eb-093b-4399-9139-d7ff0ad52984 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:20.107646 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-d69817eb-093b-4399-9139-d7ff0ad52984 None None] MFA Rules not processed for user `720510a443f74e9ca54d917e4af0bfef`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:34:20.108875 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-d69817eb-093b-4399-9139-d7ff0ad52984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:20.192190 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1006/2002] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:34:20 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:34:20.217844 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28197fbf-9870-41ad-a90e-8ccd7f223574 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:20.325512 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28197fbf-9870-41ad-a90e-8ccd7f223574 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:20.330676 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d3f000-70e5-46a6-aa32-feb89e5f28ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92862b76ba3b4513b5dc5b5c962faac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:20.331487 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d3f000-70e5-46a6-aa32-feb89e5f28ab service cinder] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:20.332485 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d3f000-70e5-46a6-aa32-feb89e5f28ab service cinder] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:20.333049 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d3f000-70e5-46a6-aa32-feb89e5f28ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:20.344295 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d3f000-70e5-46a6-aa32-feb89e5f28ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:20.345809 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d3f000-70e5-46a6-aa32-feb89e5f28ab service cinder] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:20.355176 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 997/2003] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:34:20 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:34:20.539895 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69817eb-093b-4399-9139-d7ff0ad52984 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:20.572313 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:20.617412 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69817eb-093b-4399-9139-d7ff0ad52984 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:20.622577 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea808e26-e718-4ecc-ab81-f8b7277d3bc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:20.623293 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea808e26-e718-4ecc-ab81-f8b7277d3bc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:20.623643 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea808e26-e718-4ecc-ab81-f8b7277d3bc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:20.623989 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea808e26-e718-4ecc-ab81-f8b7277d3bc7 admin admin] PATH_INFO: `/v3/users/7e4a3164765d48be8dd495217730a82d` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:20.625348 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea808e26-e718-4ecc-ab81-f8b7277d3bc7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e4a3164765d48be8dd495217730a82d)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:20.627515 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea808e26-e718-4ecc-ab81-f8b7277d3bc7 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:20.683174 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-ea808e26-e718-4ecc-ab81-f8b7277d3bc7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e4a3164765d48be8dd495217730a82d'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:20.683386 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-ea808e26-e718-4ecc-ab81-f8b7277d3bc7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e4a3164765d48be8dd495217730a82d'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:20.684097 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-ea808e26-e718-4ecc-ab81-f8b7277d3bc7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e4a3164765d48be8dd495217730a82d'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:20.693294 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-ea808e26-e718-4ecc-ab81-f8b7277d3bc7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e4a3164765d48be8dd495217730a82d'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:20.703300 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-ea808e26-e718-4ecc-ab81-f8b7277d3bc7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e4a3164765d48be8dd495217730a82d'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:20.724755 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1007/2004] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 11:34:20 2022] DELETE /identity/v3/users/7e4a3164765d48be8dd495217730a82d => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:34:20.730033 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de1e9fd-5e1b-43c5-89fd-f03adcfe4b74 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:20.730476 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de1e9fd-5e1b-43c5-89fd-f03adcfe4b74 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:20.730738 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de1e9fd-5e1b-43c5-89fd-f03adcfe4b74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:20.753652 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-1de1e9fd-5e1b-43c5-89fd-f03adcfe4b74 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:34:20.755632 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-1de1e9fd-5e1b-43c5-89fd-f03adcfe4b74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:20.827065 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:20.847487 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 998/2005] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:34:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:34:20.863196 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea808e26-e718-4ecc-ab81-f8b7277d3bc7 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:20.865083 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-ea808e26-e718-4ecc-ab81-f8b7277d3bc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:20.967632 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea808e26-e718-4ecc-ab81-f8b7277d3bc7 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:20.972414 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de1e9fd-5e1b-43c5-89fd-f03adcfe4b74 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:20.973727 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab0b538-69c6-425d-93d3-54b6402c1878 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2d061d25d83443c9232218c90792d51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:20.974414 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-1de1e9fd-5e1b-43c5-89fd-f03adcfe4b74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:20.974712 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab0b538-69c6-425d-93d3-54b6402c1878 service neutron] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:20.975042 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab0b538-69c6-425d-93d3-54b6402c1878 service neutron] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:20.975312 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab0b538-69c6-425d-93d3-54b6402c1878 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:20.986972 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab0b538-69c6-425d-93d3-54b6402c1878 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:20.988497 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de1e9fd-5e1b-43c5-89fd-f03adcfe4b74 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:20.988651 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab0b538-69c6-425d-93d3-54b6402c1878 service neutron] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:20.993615 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9e5fd9-0e3d-4e64-a6ca-5a5744dacfce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:20.994821 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9e5fd9-0e3d-4e64-a6ca-5a5744dacfce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:20.995108 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9e5fd9-0e3d-4e64-a6ca-5a5744dacfce admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:20.996216 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9e5fd9-0e3d-4e64-a6ca-5a5744dacfce admin admin] PATH_INFO: `/v3/users/8f81496c097742e6be5c212613a55a51` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:20.996935 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9e5fd9-0e3d-4e64-a6ca-5a5744dacfce admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f81496c097742e6be5c212613a55a51)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:20.999112 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1008/2006] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:34:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:34:20.999263 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9e5fd9-0e3d-4e64-a6ca-5a5744dacfce admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:21.060714 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-3b9e5fd9-0e3d-4e64-a6ca-5a5744dacfce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f81496c097742e6be5c212613a55a51'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:21.061623 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-3b9e5fd9-0e3d-4e64-a6ca-5a5744dacfce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f81496c097742e6be5c212613a55a51'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:21.072105 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-3b9e5fd9-0e3d-4e64-a6ca-5a5744dacfce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f81496c097742e6be5c212613a55a51'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:21.084639 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-3b9e5fd9-0e3d-4e64-a6ca-5a5744dacfce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f81496c097742e6be5c212613a55a51'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:21.085429 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-3b9e5fd9-0e3d-4e64-a6ca-5a5744dacfce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f81496c097742e6be5c212613a55a51'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:21.122877 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 999/2007] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 11:34:20 2022] DELETE /identity/v3/users/8f81496c097742e6be5c212613a55a51 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 11:34:21.127683 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd22bbc-cd2a-4ec6-9615-80a5924274e3 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:21.127977 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd22bbc-cd2a-4ec6-9615-80a5924274e3 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:21.128251 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd22bbc-cd2a-4ec6-9615-80a5924274e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:21.147866 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-9bd22bbc-cd2a-4ec6-9615-80a5924274e3 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:34:21.149089 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-9bd22bbc-cd2a-4ec6-9615-80a5924274e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:21.198650 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:21.217935 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1009/2008] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:34:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 11:34:21.230629 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9e5fd9-0e3d-4e64-a6ca-5a5744dacfce admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:21.232239 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-3b9e5fd9-0e3d-4e64-a6ca-5a5744dacfce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:21.302377 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9e5fd9-0e3d-4e64-a6ca-5a5744dacfce admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:21.307499 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bd3bed-0723-412d-822d-e63532279e7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2d061d25d83443c9232218c90792d51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:21.308162 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bd3bed-0723-412d-822d-e63532279e7c service neutron] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:21.308454 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bd3bed-0723-412d-822d-e63532279e7c service neutron] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:21.308780 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bd3bed-0723-412d-822d-e63532279e7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:21.316958 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd22bbc-cd2a-4ec6-9615-80a5924274e3 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:21.320036 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-9bd22bbc-cd2a-4ec6-9615-80a5924274e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:21.328601 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bd3bed-0723-412d-822d-e63532279e7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:21.330395 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bd3bed-0723-412d-822d-e63532279e7c service neutron] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:21.336904 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd22bbc-cd2a-4ec6-9615-80a5924274e3 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:21.341192 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1000/2009] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:34:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:34:21.342643 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184e5f73-02e2-4528-97af-60465bb8c751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:21.343329 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184e5f73-02e2-4528-97af-60465bb8c751 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:21.343728 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184e5f73-02e2-4528-97af-60465bb8c751 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:21.343906 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184e5f73-02e2-4528-97af-60465bb8c751 admin admin] PATH_INFO: `/v3/projects/c7b13255d4334f03b86df7618ab91938` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:21.345091 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184e5f73-02e2-4528-97af-60465bb8c751 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7b13255d4334f03b86df7618ab91938)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:21.347343 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184e5f73-02e2-4528-97af-60465bb8c751 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:21.413791 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-184e5f73-02e2-4528-97af-60465bb8c751 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7b13255d4334f03b86df7618ab91938', 'request_id': 'req-184e5f73-02e2-4528-97af-60465bb8c751'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:21.421189 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-184e5f73-02e2-4528-97af-60465bb8c751 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7b13255d4334f03b86df7618ab91938', 'request_id': 'req-184e5f73-02e2-4528-97af-60465bb8c751'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:21.431566 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-184e5f73-02e2-4528-97af-60465bb8c751 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7b13255d4334f03b86df7618ab91938', 'request_id': 'req-184e5f73-02e2-4528-97af-60465bb8c751'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:21.462028 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-184e5f73-02e2-4528-97af-60465bb8c751 admin admin] The token cache is being invalidate because project c7b13255d4334f03b86df7618ab91938 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81501) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:34:21.462538 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-184e5f73-02e2-4528-97af-60465bb8c751 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:21.463630 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-184e5f73-02e2-4528-97af-60465bb8c751 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:21.469713 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1010/2010] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 11:34:21 2022] DELETE /identity/v3/projects/c7b13255d4334f03b86df7618ab91938 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:34:21.471033 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bd3bed-0723-412d-822d-e63532279e7c service neutron] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:21.490058 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bd3bed-0723-412d-822d-e63532279e7c service neutron] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:21.610699 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84707cd0-4eff-4624-ae90-f216f5d555f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:21.611400 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84707cd0-4eff-4624-ae90-f216f5d555f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:21.611760 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84707cd0-4eff-4624-ae90-f216f5d555f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:21.611989 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84707cd0-4eff-4624-ae90-f216f5d555f4 admin admin] PATH_INFO: `/v3/users/720510a443f74e9ca54d917e4af0bfef` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:21.613407 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84707cd0-4eff-4624-ae90-f216f5d555f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=720510a443f74e9ca54d917e4af0bfef)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:21.615915 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84707cd0-4eff-4624-ae90-f216f5d555f4 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:21.631829 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:21.668543 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-84707cd0-4eff-4624-ae90-f216f5d555f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '720510a443f74e9ca54d917e4af0bfef'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:21.669230 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-84707cd0-4eff-4624-ae90-f216f5d555f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '720510a443f74e9ca54d917e4af0bfef'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:21.681394 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-84707cd0-4eff-4624-ae90-f216f5d555f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '720510a443f74e9ca54d917e4af0bfef'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:21.696676 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-84707cd0-4eff-4624-ae90-f216f5d555f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '720510a443f74e9ca54d917e4af0bfef'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:21.697435 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-84707cd0-4eff-4624-ae90-f216f5d555f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '720510a443f74e9ca54d917e4af0bfef'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:21.715696 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1001/2011] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 11:34:21 2022] DELETE /identity/v3/users/720510a443f74e9ca54d917e4af0bfef => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:34:21.810181 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184e5f73-02e2-4528-97af-60465bb8c751 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:21.812377 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-184e5f73-02e2-4528-97af-60465bb8c751 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:21.837019 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184e5f73-02e2-4528-97af-60465bb8c751 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:21.901983 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9cf4f2-7a39-4cdd-94fa-3af3909dda36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:21.901983 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9cf4f2-7a39-4cdd-94fa-3af3909dda36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:21.901983 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9cf4f2-7a39-4cdd-94fa-3af3909dda36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:21.901983 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9cf4f2-7a39-4cdd-94fa-3af3909dda36 admin admin] PATH_INFO: `/v3/projects/2f9c7ef6dd1e4571927a31960b57204a` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:21.903666 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9cf4f2-7a39-4cdd-94fa-3af3909dda36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f9c7ef6dd1e4571927a31960b57204a)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:21.905904 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9cf4f2-7a39-4cdd-94fa-3af3909dda36 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:21.964596 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84707cd0-4eff-4624-ae90-f216f5d555f4 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:21.966558 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-84707cd0-4eff-4624-ae90-f216f5d555f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:21.968035 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-1a9cf4f2-7a39-4cdd-94fa-3af3909dda36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f9c7ef6dd1e4571927a31960b57204a', 'request_id': 'req-1a9cf4f2-7a39-4cdd-94fa-3af3909dda36'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:21.975363 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-1a9cf4f2-7a39-4cdd-94fa-3af3909dda36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f9c7ef6dd1e4571927a31960b57204a', 'request_id': 'req-1a9cf4f2-7a39-4cdd-94fa-3af3909dda36'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:21.981390 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84707cd0-4eff-4624-ae90-f216f5d555f4 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:21.982379 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-1a9cf4f2-7a39-4cdd-94fa-3af3909dda36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f9c7ef6dd1e4571927a31960b57204a', 'request_id': 'req-1a9cf4f2-7a39-4cdd-94fa-3af3909dda36'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:22.000652 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-1a9cf4f2-7a39-4cdd-94fa-3af3909dda36 admin admin] The token cache is being invalidate because project 2f9c7ef6dd1e4571927a31960b57204a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81501) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:34:22.001160 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-1a9cf4f2-7a39-4cdd-94fa-3af3909dda36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:22.002541 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-1a9cf4f2-7a39-4cdd-94fa-3af3909dda36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:22.008332 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1011/2012] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 11:34:21 2022] DELETE /identity/v3/projects/2f9c7ef6dd1e4571927a31960b57204a => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:34:22.009713 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9cf4f2-7a39-4cdd-94fa-3af3909dda36 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:22.012004 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-1a9cf4f2-7a39-4cdd-94fa-3af3909dda36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:22.020147 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:22.055176 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2af996f-3cd0-4dba-b582-5896942638f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:22.055886 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2af996f-3cd0-4dba-b582-5896942638f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:22.056229 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2af996f-3cd0-4dba-b582-5896942638f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:22.056426 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2af996f-3cd0-4dba-b582-5896942638f0 admin admin] PATH_INFO: `/v3/users/806a72fb5ba143ca8648d39e4f70520b` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:22.057662 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2af996f-3cd0-4dba-b582-5896942638f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=806a72fb5ba143ca8648d39e4f70520b)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:22.059967 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2af996f-3cd0-4dba-b582-5896942638f0 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:22.110414 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9cf4f2-7a39-4cdd-94fa-3af3909dda36 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:22.125518 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff73319-0bb0-418a-8b89-34899f2cb4af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:22.127336 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff73319-0bb0-418a-8b89-34899f2cb4af admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:22.127699 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff73319-0bb0-418a-8b89-34899f2cb4af admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:22.128043 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff73319-0bb0-418a-8b89-34899f2cb4af admin admin] PATH_INFO: `/v3/users/3e3f546a17524f1bbfea535ba637c0c9` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:22.130128 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff73319-0bb0-418a-8b89-34899f2cb4af admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e3f546a17524f1bbfea535ba637c0c9)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:22.132750 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff73319-0bb0-418a-8b89-34899f2cb4af admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:22.149496 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-d2af996f-3cd0-4dba-b582-5896942638f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '806a72fb5ba143ca8648d39e4f70520b'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:22.150552 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-d2af996f-3cd0-4dba-b582-5896942638f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '806a72fb5ba143ca8648d39e4f70520b'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:22.171624 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-d2af996f-3cd0-4dba-b582-5896942638f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '806a72fb5ba143ca8648d39e4f70520b'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:22.181128 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-d2af996f-3cd0-4dba-b582-5896942638f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '806a72fb5ba143ca8648d39e4f70520b'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:22.181904 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-d2af996f-3cd0-4dba-b582-5896942638f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '806a72fb5ba143ca8648d39e4f70520b'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:22.203487 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-7ff73319-0bb0-418a-8b89-34899f2cb4af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e3f546a17524f1bbfea535ba637c0c9'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:22.204571 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-7ff73319-0bb0-418a-8b89-34899f2cb4af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e3f546a17524f1bbfea535ba637c0c9'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:22.205030 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-7ff73319-0bb0-418a-8b89-34899f2cb4af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e3f546a17524f1bbfea535ba637c0c9'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:22.206081 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1002/2013] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 11:34:21 2022] DELETE /identity/v3/users/806a72fb5ba143ca8648d39e4f70520b => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 11:34:22.207021 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2af996f-3cd0-4dba-b582-5896942638f0 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:22.208362 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-d2af996f-3cd0-4dba-b582-5896942638f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:22.216912 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-7ff73319-0bb0-418a-8b89-34899f2cb4af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e3f546a17524f1bbfea535ba637c0c9'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:22.225485 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:22.229958 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-7ff73319-0bb0-418a-8b89-34899f2cb4af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e3f546a17524f1bbfea535ba637c0c9'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:22.268347 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1012/2014] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 11:34:22 2022] DELETE /identity/v3/users/3e3f546a17524f1bbfea535ba637c0c9 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:34:22.268347 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d519dc7c-8909-459d-9295-ed77472c7399 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:22.268347 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d519dc7c-8909-459d-9295-ed77472c7399 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:22.268347 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d519dc7c-8909-459d-9295-ed77472c7399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:22.295425 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-d519dc7c-8909-459d-9295-ed77472c7399 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:34:22.297989 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-d519dc7c-8909-459d-9295-ed77472c7399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:22.333477 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2af996f-3cd0-4dba-b582-5896942638f0 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:22.445699 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1013/2015] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:34:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:34:22.448408 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d519dc7c-8909-459d-9295-ed77472c7399 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:22.451077 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3072b218-5a28-4d46-9cb5-27ba9637c415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:22.451884 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-d519dc7c-8909-459d-9295-ed77472c7399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:22.452023 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3072b218-5a28-4d46-9cb5-27ba9637c415 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:22.452193 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3072b218-5a28-4d46-9cb5-27ba9637c415 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:22.452541 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3072b218-5a28-4d46-9cb5-27ba9637c415 admin admin] PATH_INFO: `/v3/projects/6d72449a620149fb86dee75a33f68f8b` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:22.459842 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3072b218-5a28-4d46-9cb5-27ba9637c415 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d72449a620149fb86dee75a33f68f8b)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:22.462044 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3072b218-5a28-4d46-9cb5-27ba9637c415 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:22.499434 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:22.521784 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-3072b218-5a28-4d46-9cb5-27ba9637c415 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d72449a620149fb86dee75a33f68f8b', 'request_id': 'req-3072b218-5a28-4d46-9cb5-27ba9637c415'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:22.532293 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-3072b218-5a28-4d46-9cb5-27ba9637c415 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d72449a620149fb86dee75a33f68f8b', 'request_id': 'req-3072b218-5a28-4d46-9cb5-27ba9637c415'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:22.539763 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-3072b218-5a28-4d46-9cb5-27ba9637c415 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d72449a620149fb86dee75a33f68f8b', 'request_id': 'req-3072b218-5a28-4d46-9cb5-27ba9637c415'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:22.541837 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d519dc7c-8909-459d-9295-ed77472c7399 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:22.562024 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-3072b218-5a28-4d46-9cb5-27ba9637c415 admin admin] The token cache is being invalidate because project 6d72449a620149fb86dee75a33f68f8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:34:22.562647 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-3072b218-5a28-4d46-9cb5-27ba9637c415 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:22.563465 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-3072b218-5a28-4d46-9cb5-27ba9637c415 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:22.576230 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1003/2016] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 11:34:22 2022] DELETE /identity/v3/projects/6d72449a620149fb86dee75a33f68f8b => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:34:22.576230 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3072b218-5a28-4d46-9cb5-27ba9637c415 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:22.576230 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-3072b218-5a28-4d46-9cb5-27ba9637c415 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:22.648792 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5093c6-eb13-4da6-bcff-c74d6c770544 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92862b76ba3b4513b5dc5b5c962faac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:22.649487 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5093c6-eb13-4da6-bcff-c74d6c770544 service cinder] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:22.649767 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5093c6-eb13-4da6-bcff-c74d6c770544 service cinder] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:22.650037 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5093c6-eb13-4da6-bcff-c74d6c770544 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:22.652031 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-fc5093c6-eb13-4da6-bcff-c74d6c770544 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:22.705549 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:22.716530 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3072b218-5a28-4d46-9cb5-27ba9637c415 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:22.724109 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323a71a8-ad69-4f75-80c8-b7c0c59b334e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2d061d25d83443c9232218c90792d51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:22.725150 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323a71a8-ad69-4f75-80c8-b7c0c59b334e service neutron] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:22.725989 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323a71a8-ad69-4f75-80c8-b7c0c59b334e service neutron] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:22.726511 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323a71a8-ad69-4f75-80c8-b7c0c59b334e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:22.735123 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-323a71a8-ad69-4f75-80c8-b7c0c59b334e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:22.777797 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5093c6-eb13-4da6-bcff-c74d6c770544 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:22.780163 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5093c6-eb13-4da6-bcff-c74d6c770544 service cinder] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:22.805108 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1014/2017] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:34:22 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:34:22.827722 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f324f883-7a85-4e6b-8c80-b1aa3ceb5dbb None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:22.828585 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f324f883-7a85-4e6b-8c80-b1aa3ceb5dbb None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:22.828585 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f324f883-7a85-4e6b-8c80-b1aa3ceb5dbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:22.868188 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323a71a8-ad69-4f75-80c8-b7c0c59b334e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:22.873424 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-f324f883-7a85-4e6b-8c80-b1aa3ceb5dbb None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:34:22.874893 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-f324f883-7a85-4e6b-8c80-b1aa3ceb5dbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:22.875076 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323a71a8-ad69-4f75-80c8-b7c0c59b334e service neutron] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:22.888167 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1015/2018] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:34:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:34:22.889312 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f324f883-7a85-4e6b-8c80-b1aa3ceb5dbb None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:22.891198 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-f324f883-7a85-4e6b-8c80-b1aa3ceb5dbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:22.910327 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f324f883-7a85-4e6b-8c80-b1aa3ceb5dbb None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:22.919750 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6207941-1239-40b2-ab4a-408180551126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:22.920528 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6207941-1239-40b2-ab4a-408180551126 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:22.920979 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6207941-1239-40b2-ab4a-408180551126 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:22.921315 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6207941-1239-40b2-ab4a-408180551126 admin admin] PATH_INFO: `/v3/projects/df1de5dd63f441e9bd32ef8c53354206` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:22.924233 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6207941-1239-40b2-ab4a-408180551126 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df1de5dd63f441e9bd32ef8c53354206)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:22.926736 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1004/2019] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:34:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:34:22.927064 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6207941-1239-40b2-ab4a-408180551126 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:22.930550 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3ff0bf-6eff-48c6-a17a-77c87493681b None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:22.930835 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3ff0bf-6eff-48c6-a17a-77c87493681b None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:22.931110 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3ff0bf-6eff-48c6-a17a-77c87493681b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:22.980335 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-6e3ff0bf-6eff-48c6-a17a-77c87493681b None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:34:22.984675 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-6e3ff0bf-6eff-48c6-a17a-77c87493681b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:23.019375 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-a6207941-1239-40b2-ab4a-408180551126 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df1de5dd63f441e9bd32ef8c53354206', 'request_id': 'req-a6207941-1239-40b2-ab4a-408180551126'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:23.039812 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-a6207941-1239-40b2-ab4a-408180551126 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df1de5dd63f441e9bd32ef8c53354206', 'request_id': 'req-a6207941-1239-40b2-ab4a-408180551126'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:23.065745 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-a6207941-1239-40b2-ab4a-408180551126 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df1de5dd63f441e9bd32ef8c53354206', 'request_id': 'req-a6207941-1239-40b2-ab4a-408180551126'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:23.091575 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-a6207941-1239-40b2-ab4a-408180551126 admin admin] The token cache is being invalidate because project df1de5dd63f441e9bd32ef8c53354206 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81501) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:34:23.092147 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-a6207941-1239-40b2-ab4a-408180551126 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:23.093107 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-a6207941-1239-40b2-ab4a-408180551126 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:23.096838 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1016/2020] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 11:34:22 2022] DELETE /identity/v3/projects/df1de5dd63f441e9bd32ef8c53354206 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:34:23.105226 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1005/2021] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:34:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:34:23.107560 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3ff0bf-6eff-48c6-a17a-77c87493681b None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:23.110127 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-6e3ff0bf-6eff-48c6-a17a-77c87493681b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:23.110320 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6207941-1239-40b2-ab4a-408180551126 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:23.131458 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6207941-1239-40b2-ab4a-408180551126 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:23.145820 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3ff0bf-6eff-48c6-a17a-77c87493681b None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:23.152135 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5f9a9c-b7ac-4f11-91e4-e44330bcd8c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:23.152779 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5f9a9c-b7ac-4f11-91e4-e44330bcd8c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:23.153061 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5f9a9c-b7ac-4f11-91e4-e44330bcd8c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:23.153329 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5f9a9c-b7ac-4f11-91e4-e44330bcd8c1 admin admin] PATH_INFO: `/v3/users/0ee15feaf6c84b01b1c81bd29d275dc9` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:23.154903 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5f9a9c-b7ac-4f11-91e4-e44330bcd8c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ee15feaf6c84b01b1c81bd29d275dc9)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:23.157857 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5f9a9c-b7ac-4f11-91e4-e44330bcd8c1 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:23.158728 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d36e05-313f-4d76-906b-52c4cfa9b01d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:23.161329 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d36e05-313f-4d76-906b-52c4cfa9b01d admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:23.162188 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d36e05-313f-4d76-906b-52c4cfa9b01d admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:23.162557 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d36e05-313f-4d76-906b-52c4cfa9b01d admin admin] PATH_INFO: `/v3/domains` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:23.163302 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d36e05-313f-4d76-906b-52c4cfa9b01d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:34:23.163659 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d36e05-313f-4d76-906b-52c4cfa9b01d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:23.165375 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d36e05-313f-4d76-906b-52c4cfa9b01d admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:23.167179 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:23.189101 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1017/2022] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 24 11:34:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:34:23.190332 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d36e05-313f-4d76-906b-52c4cfa9b01d admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:23.203800 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d36e05-313f-4d76-906b-52c4cfa9b01d admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:23.211418 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe40eca8-3176-4d87-aeb8-13d43f1a3f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:23.212499 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe40eca8-3176-4d87-aeb8-13d43f1a3f2f admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:23.213050 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe40eca8-3176-4d87-aeb8-13d43f1a3f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:23.213473 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe40eca8-3176-4d87-aeb8-13d43f1a3f2f admin admin] PATH_INFO: `/v3/projects` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:23.214346 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe40eca8-3176-4d87-aeb8-13d43f1a3f2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:23.216530 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe40eca8-3176-4d87-aeb8-13d43f1a3f2f admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:23.253132 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1018/2023] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 11:34:23 2022] POST /identity/v3/projects => generated 375 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:34:23.253651 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe40eca8-3176-4d87-aeb8-13d43f1a3f2f admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:23.253954 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-3c5f9a9c-b7ac-4f11-91e4-e44330bcd8c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ee15feaf6c84b01b1c81bd29d275dc9'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:23.255260 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-3c5f9a9c-b7ac-4f11-91e4-e44330bcd8c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ee15feaf6c84b01b1c81bd29d275dc9'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:23.256954 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-fe40eca8-3176-4d87-aeb8-13d43f1a3f2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:23.271397 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-3c5f9a9c-b7ac-4f11-91e4-e44330bcd8c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ee15feaf6c84b01b1c81bd29d275dc9'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:23.285875 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-3c5f9a9c-b7ac-4f11-91e4-e44330bcd8c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ee15feaf6c84b01b1c81bd29d275dc9'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:23.287583 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-3c5f9a9c-b7ac-4f11-91e4-e44330bcd8c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ee15feaf6c84b01b1c81bd29d275dc9'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:23.335289 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1006/2024] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 11:34:23 2022] DELETE /identity/v3/users/0ee15feaf6c84b01b1c81bd29d275dc9 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:34:23.359307 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe40eca8-3176-4d87-aeb8-13d43f1a3f2f admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:23.462942 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ee9554-d3f4-4002-ba62-6825960bbbcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:23.463585 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ee9554-d3f4-4002-ba62-6825960bbbcc admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:23.463910 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ee9554-d3f4-4002-ba62-6825960bbbcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:23.464545 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ee9554-d3f4-4002-ba62-6825960bbbcc admin admin] PATH_INFO: `/v3/users` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:23.465941 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ee9554-d3f4-4002-ba62-6825960bbbcc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:23.469077 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ee9554-d3f4-4002-ba62-6825960bbbcc admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:23.515999 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1019/2025] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 11:34:23 2022] POST /identity/v3/users => generated 288 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:34:23.520347 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5f9a9c-b7ac-4f11-91e4-e44330bcd8c1 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:23.532449 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5f9a9c-b7ac-4f11-91e4-e44330bcd8c1 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:23.538934 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c143c5-0053-4129-ba82-c2828c59d28c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:23.539698 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c143c5-0053-4129-ba82-c2828c59d28c admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:23.540089 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c143c5-0053-4129-ba82-c2828c59d28c admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:23.540429 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c143c5-0053-4129-ba82-c2828c59d28c admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:23.541198 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c143c5-0053-4129-ba82-c2828c59d28c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:23.543056 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c143c5-0053-4129-ba82-c2828c59d28c admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:23.561074 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:23.574143 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ee9554-d3f4-4002-ba62-6825960bbbcc admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:23.574693 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1007/2026] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:34:23 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:34:23.586631 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ee9554-d3f4-4002-ba62-6825960bbbcc admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:23.594612 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ab8b28-399a-4fa9-a9a1-7cb1ea8f8039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:23.595738 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ab8b28-399a-4fa9-a9a1-7cb1ea8f8039 admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:23.596909 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ab8b28-399a-4fa9-a9a1-7cb1ea8f8039 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:23.597514 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ab8b28-399a-4fa9-a9a1-7cb1ea8f8039 admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:23.598655 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ab8b28-399a-4fa9-a9a1-7cb1ea8f8039 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:23.615831 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ab8b28-399a-4fa9-a9a1-7cb1ea8f8039 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:23.638842 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1020/2027] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:34:23 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:34:23.640379 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c143c5-0053-4129-ba82-c2828c59d28c admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:23.652431 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c143c5-0053-4129-ba82-c2828c59d28c admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:23.658060 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c4ce6e-1be0-43b5-b867-3943f0aebeb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:23.658686 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c4ce6e-1be0-43b5-b867-3943f0aebeb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:23.658963 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c4ce6e-1be0-43b5-b867-3943f0aebeb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:23.659239 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c4ce6e-1be0-43b5-b867-3943f0aebeb1 admin admin] PATH_INFO: `/v3/projects/68d0b12a8ba94a85ae5aabdd042e6c99/users/93bab5941d9d4a6eba875385f0e1d3e2/roles/27e3e65e24df4b86b0d3d18d3212101d` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:23.676992 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c4ce6e-1be0-43b5-b867-3943f0aebeb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68d0b12a8ba94a85ae5aabdd042e6c99, user_id=93bab5941d9d4a6eba875385f0e1d3e2, role_id=27e3e65e24df4b86b0d3d18d3212101d)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:23.680387 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c4ce6e-1be0-43b5-b867-3943f0aebeb1 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:23.723316 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1008/2028] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 11:34:23 2022] PUT /identity/v3/projects/68d0b12a8ba94a85ae5aabdd042e6c99/users/93bab5941d9d4a6eba875385f0e1d3e2/roles/27e3e65e24df4b86b0d3d18d3212101d => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:34:23.726165 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349db01f-7aa3-4308-a2d8-2d3acf70eafa None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:23.726667 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349db01f-7aa3-4308-a2d8-2d3acf70eafa None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:23.727177 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349db01f-7aa3-4308-a2d8-2d3acf70eafa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:23.772042 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-349db01f-7aa3-4308-a2d8-2d3acf70eafa None None] MFA Rules not processed for user `93bab5941d9d4a6eba875385f0e1d3e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:34:23.772783 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-349db01f-7aa3-4308-a2d8-2d3acf70eafa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:23.845851 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c4ce6e-1be0-43b5-b867-3943f0aebeb1 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:23.848211 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-34c4ce6e-1be0-43b5-b867-3943f0aebeb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:23.864145 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:23.889118 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1021/2029] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:34:23 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:34:23.901597 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349db01f-7aa3-4308-a2d8-2d3acf70eafa None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:23.952414 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c4ce6e-1be0-43b5-b867-3943f0aebeb1 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:23.959447 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95a7d3d-513f-4cf1-a8a2-60a1c4cd0abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:23.960421 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95a7d3d-513f-4cf1-a8a2-60a1c4cd0abb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:23.961626 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95a7d3d-513f-4cf1-a8a2-60a1c4cd0abb admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:23.961626 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95a7d3d-513f-4cf1-a8a2-60a1c4cd0abb admin admin] PATH_INFO: `/v3/projects/8033d0755d1c46fe8ced1b3595a0ea5a` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:23.962928 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95a7d3d-513f-4cf1-a8a2-60a1c4cd0abb admin admin] RBAC: Authorizing `identity:delete_project(project_id=8033d0755d1c46fe8ced1b3595a0ea5a)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:23.966437 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95a7d3d-513f-4cf1-a8a2-60a1c4cd0abb admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:24.012236 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349db01f-7aa3-4308-a2d8-2d3acf70eafa None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:24.021984 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941d8305-8f71-4b71-b12e-fe866dc46453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:24.025780 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941d8305-8f71-4b71-b12e-fe866dc46453 admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:24.025780 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941d8305-8f71-4b71-b12e-fe866dc46453 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:24.025780 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941d8305-8f71-4b71-b12e-fe866dc46453 admin admin] PATH_INFO: `/v3/projects` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:24.025780 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941d8305-8f71-4b71-b12e-fe866dc46453 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:24.028475 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941d8305-8f71-4b71-b12e-fe866dc46453 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:24.044768 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-f95a7d3d-513f-4cf1-a8a2-60a1c4cd0abb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8033d0755d1c46fe8ced1b3595a0ea5a', 'request_id': 'req-f95a7d3d-513f-4cf1-a8a2-60a1c4cd0abb'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:24.058883 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-f95a7d3d-513f-4cf1-a8a2-60a1c4cd0abb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8033d0755d1c46fe8ced1b3595a0ea5a', 'request_id': 'req-f95a7d3d-513f-4cf1-a8a2-60a1c4cd0abb'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:24.070684 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-f95a7d3d-513f-4cf1-a8a2-60a1c4cd0abb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8033d0755d1c46fe8ced1b3595a0ea5a', 'request_id': 'req-f95a7d3d-513f-4cf1-a8a2-60a1c4cd0abb'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:24.091872 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1022/2030] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 11:34:23 2022] POST /identity/v3/projects => generated 375 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:34:24.097684 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941d8305-8f71-4b71-b12e-fe866dc46453 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:24.100504 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-f95a7d3d-513f-4cf1-a8a2-60a1c4cd0abb admin admin] The token cache is being invalidate because project 8033d0755d1c46fe8ced1b3595a0ea5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:34:24.101031 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-f95a7d3d-513f-4cf1-a8a2-60a1c4cd0abb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:24.101917 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-f95a7d3d-513f-4cf1-a8a2-60a1c4cd0abb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:24.106318 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-941d8305-8f71-4b71-b12e-fe866dc46453 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:24.108736 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1009/2031] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 11:34:23 2022] DELETE /identity/v3/projects/8033d0755d1c46fe8ced1b3595a0ea5a => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 11:34:24.114982 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95a7d3d-513f-4cf1-a8a2-60a1c4cd0abb admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:24.120085 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-f95a7d3d-513f-4cf1-a8a2-60a1c4cd0abb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:24.285048 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941d8305-8f71-4b71-b12e-fe866dc46453 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:24.298644 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6101afff-19fc-404d-a499-0056e7a81d8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:24.299692 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6101afff-19fc-404d-a499-0056e7a81d8d admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:24.299981 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6101afff-19fc-404d-a499-0056e7a81d8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:24.300258 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6101afff-19fc-404d-a499-0056e7a81d8d admin admin] PATH_INFO: `/v3/users` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:24.301513 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6101afff-19fc-404d-a499-0056e7a81d8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:24.303682 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6101afff-19fc-404d-a499-0056e7a81d8d admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:24.317881 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95a7d3d-513f-4cf1-a8a2-60a1c4cd0abb admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:24.326153 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ff299f-0b25-41c5-b2de-1cf9bf927864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:24.327475 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ff299f-0b25-41c5-b2de-1cf9bf927864 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:24.327859 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ff299f-0b25-41c5-b2de-1cf9bf927864 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:24.328275 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ff299f-0b25-41c5-b2de-1cf9bf927864 admin admin] PATH_INFO: `/v3/users/20b930ce74c24261afb39c89f286dffc` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:24.330217 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ff299f-0b25-41c5-b2de-1cf9bf927864 admin admin] RBAC: Authorizing `identity:delete_user(user_id=20b930ce74c24261afb39c89f286dffc)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:24.333236 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ff299f-0b25-41c5-b2de-1cf9bf927864 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:24.334184 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1023/2032] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 11:34:24 2022] POST /identity/v3/users => generated 288 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 11:34:24.335318 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6101afff-19fc-404d-a499-0056e7a81d8d admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:24.337426 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-6101afff-19fc-404d-a499-0056e7a81d8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:24.339743 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:24.353446 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6101afff-19fc-404d-a499-0056e7a81d8d admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:24.366694 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32167f9-70e4-4d6f-9513-f46c2ac6fa28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:24.367358 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32167f9-70e4-4d6f-9513-f46c2ac6fa28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:24.367815 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32167f9-70e4-4d6f-9513-f46c2ac6fa28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:24.368072 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32167f9-70e4-4d6f-9513-f46c2ac6fa28 admin admin] PATH_INFO: `/v3/projects/9dc2e0152c0748e1b4ebe2f036e65d40` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:24.370000 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32167f9-70e4-4d6f-9513-f46c2ac6fa28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9dc2e0152c0748e1b4ebe2f036e65d40)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:24.372559 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32167f9-70e4-4d6f-9513-f46c2ac6fa28 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:24.423375 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-c8ff299f-0b25-41c5-b2de-1cf9bf927864 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20b930ce74c24261afb39c89f286dffc'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:24.425524 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-c8ff299f-0b25-41c5-b2de-1cf9bf927864 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20b930ce74c24261afb39c89f286dffc'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:24.442585 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-c8ff299f-0b25-41c5-b2de-1cf9bf927864 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20b930ce74c24261afb39c89f286dffc'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:24.457407 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-f32167f9-70e4-4d6f-9513-f46c2ac6fa28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9dc2e0152c0748e1b4ebe2f036e65d40', 'request_id': 'req-f32167f9-70e4-4d6f-9513-f46c2ac6fa28'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:24.463987 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-c8ff299f-0b25-41c5-b2de-1cf9bf927864 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20b930ce74c24261afb39c89f286dffc'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:24.464731 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-c8ff299f-0b25-41c5-b2de-1cf9bf927864 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20b930ce74c24261afb39c89f286dffc'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:24.473922 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-f32167f9-70e4-4d6f-9513-f46c2ac6fa28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9dc2e0152c0748e1b4ebe2f036e65d40', 'request_id': 'req-f32167f9-70e4-4d6f-9513-f46c2ac6fa28'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:24.479044 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:24.490415 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-f32167f9-70e4-4d6f-9513-f46c2ac6fa28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9dc2e0152c0748e1b4ebe2f036e65d40', 'request_id': 'req-f32167f9-70e4-4d6f-9513-f46c2ac6fa28'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:24.492050 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1010/2033] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 11:34:24 2022] DELETE /identity/v3/users/20b930ce74c24261afb39c89f286dffc => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:34:24.493147 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ff299f-0b25-41c5-b2de-1cf9bf927864 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:24.495721 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-c8ff299f-0b25-41c5-b2de-1cf9bf927864 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:24.513791 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-f32167f9-70e4-4d6f-9513-f46c2ac6fa28 admin admin] The token cache is being invalidate because project 9dc2e0152c0748e1b4ebe2f036e65d40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81501) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:34:24.514269 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-f32167f9-70e4-4d6f-9513-f46c2ac6fa28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:24.515235 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-f32167f9-70e4-4d6f-9513-f46c2ac6fa28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:24.517107 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1024/2034] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 11:34:24 2022] DELETE /identity/v3/projects/9dc2e0152c0748e1b4ebe2f036e65d40 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:34:24.522843 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff99c14-2436-4ab0-aac9-c937f5955b1e None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:24.523173 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff99c14-2436-4ab0-aac9-c937f5955b1e None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:24.523537 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff99c14-2436-4ab0-aac9-c937f5955b1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:24.549397 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-aff99c14-2436-4ab0-aac9-c937f5955b1e None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:34:24.550641 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-aff99c14-2436-4ab0-aac9-c937f5955b1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:24.597231 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ff299f-0b25-41c5-b2de-1cf9bf927864 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:24.603450 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889a6b82-7b9b-4b00-b3ac-ee804e9ecb83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:24.604463 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889a6b82-7b9b-4b00-b3ac-ee804e9ecb83 admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:24.605000 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889a6b82-7b9b-4b00-b3ac-ee804e9ecb83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:24.605396 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889a6b82-7b9b-4b00-b3ac-ee804e9ecb83 admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:24.606291 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889a6b82-7b9b-4b00-b3ac-ee804e9ecb83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:24.608705 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889a6b82-7b9b-4b00-b3ac-ee804e9ecb83 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:24.622269 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1011/2035] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:34:24 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:34:24.626701 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889a6b82-7b9b-4b00-b3ac-ee804e9ecb83 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:24.629532 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-889a6b82-7b9b-4b00-b3ac-ee804e9ecb83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:24.635220 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1025/2036] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:34:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 11:34:24.644483 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78714539-d259-4bc3-b564-6dc946d7f241 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:24.645006 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78714539-d259-4bc3-b564-6dc946d7f241 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:24.645475 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78714539-d259-4bc3-b564-6dc946d7f241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:24.650160 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889a6b82-7b9b-4b00-b3ac-ee804e9ecb83 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:24.656421 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be50a29b-f2d2-4cff-a9d7-d9a6e23119c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:24.657178 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be50a29b-f2d2-4cff-a9d7-d9a6e23119c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:24.657711 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be50a29b-f2d2-4cff-a9d7-d9a6e23119c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:24.658091 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be50a29b-f2d2-4cff-a9d7-d9a6e23119c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:24.659066 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be50a29b-f2d2-4cff-a9d7-d9a6e23119c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:24.663032 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be50a29b-f2d2-4cff-a9d7-d9a6e23119c4 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:24.679007 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-78714539-d259-4bc3-b564-6dc946d7f241 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:34:24.679890 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1012/2037] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:34:24 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 11:34:24.680275 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-78714539-d259-4bc3-b564-6dc946d7f241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:24.685110 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be50a29b-f2d2-4cff-a9d7-d9a6e23119c4 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:24.689780 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1026/2038] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:34:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:34:24.700332 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be50a29b-f2d2-4cff-a9d7-d9a6e23119c4 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:24.703462 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78714539-d259-4bc3-b564-6dc946d7f241 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:24.705281 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21af1563-41b1-4d38-8d0f-bd235646dfd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:24.705983 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21af1563-41b1-4d38-8d0f-bd235646dfd2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:24.706266 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21af1563-41b1-4d38-8d0f-bd235646dfd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:24.706585 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21af1563-41b1-4d38-8d0f-bd235646dfd2 admin admin] PATH_INFO: `/v3/projects/0369f004380b423490733fbf8a4601a3/users/0579c0f9a5804d3183ea6b123dfb3531/roles/27e3e65e24df4b86b0d3d18d3212101d` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:24.713727 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78714539-d259-4bc3-b564-6dc946d7f241 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:24.719612 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d20ccd-c397-49ca-b807-9da882324b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:24.720484 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d20ccd-c397-49ca-b807-9da882324b67 admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:24.720760 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d20ccd-c397-49ca-b807-9da882324b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:24.721077 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d20ccd-c397-49ca-b807-9da882324b67 admin admin] PATH_INFO: `/v3/domains` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:24.721738 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d20ccd-c397-49ca-b807-9da882324b67 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:34:24.722200 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d20ccd-c397-49ca-b807-9da882324b67 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:24.723782 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d20ccd-c397-49ca-b807-9da882324b67 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:24.728313 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21af1563-41b1-4d38-8d0f-bd235646dfd2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0369f004380b423490733fbf8a4601a3, user_id=0579c0f9a5804d3183ea6b123dfb3531, role_id=27e3e65e24df4b86b0d3d18d3212101d)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:24.738718 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21af1563-41b1-4d38-8d0f-bd235646dfd2 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:24.742231 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1027/2039] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 24 11:34:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:34:24.745993 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d20ccd-c397-49ca-b807-9da882324b67 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:24.758688 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d20ccd-c397-49ca-b807-9da882324b67 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:24.770813 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1013/2040] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 11:34:24 2022] PUT /identity/v3/projects/0369f004380b423490733fbf8a4601a3/users/0579c0f9a5804d3183ea6b123dfb3531/roles/27e3e65e24df4b86b0d3d18d3212101d => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:34:24.788680 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3212e625-95ae-4b30-925a-3a5f1f26b81e None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:24.789229 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3212e625-95ae-4b30-925a-3a5f1f26b81e None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:24.790503 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3212e625-95ae-4b30-925a-3a5f1f26b81e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:24.827973 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628d07ca-c1c9-4658-8f34-1326e1435c2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:24.828656 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628d07ca-c1c9-4658-8f34-1326e1435c2b admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:24.829004 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628d07ca-c1c9-4658-8f34-1326e1435c2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:24.829211 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628d07ca-c1c9-4658-8f34-1326e1435c2b admin admin] PATH_INFO: `/v3/projects` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:24.829871 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628d07ca-c1c9-4658-8f34-1326e1435c2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:24.831038 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-3212e625-95ae-4b30-925a-3a5f1f26b81e None None] MFA Rules not processed for user `0579c0f9a5804d3183ea6b123dfb3531`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:34:24.832046 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628d07ca-c1c9-4658-8f34-1326e1435c2b admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:24.832464 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-3212e625-95ae-4b30-925a-3a5f1f26b81e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:24.878585 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1028/2041] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 11:34:24 2022] POST /identity/v3/projects => generated 369 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:34:24.881740 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628d07ca-c1c9-4658-8f34-1326e1435c2b admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:24.892772 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:24.942053 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1014/2042] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:34:24 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:34:24.943285 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3212e625-95ae-4b30-925a-3a5f1f26b81e None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:24.946845 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-3212e625-95ae-4b30-925a-3a5f1f26b81e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:24.948993 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:24.962681 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3212e625-95ae-4b30-925a-3a5f1f26b81e None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:24.964440 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628d07ca-c1c9-4658-8f34-1326e1435c2b admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:24.967725 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8859d576-af33-453b-bd4d-4ad51a7e47cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:24.968374 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8859d576-af33-453b-bd4d-4ad51a7e47cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:24.968650 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8859d576-af33-453b-bd4d-4ad51a7e47cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:24.969284 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8859d576-af33-453b-bd4d-4ad51a7e47cc admin admin] PATH_INFO: `/v3/projects/9475f716a53c4dafb871845789ea4f18` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:24.970061 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8859d576-af33-453b-bd4d-4ad51a7e47cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=9475f716a53c4dafb871845789ea4f18)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:24.970889 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d741db67-f890-4857-87e6-8164807ee66a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:24.971502 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d741db67-f890-4857-87e6-8164807ee66a admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:24.971777 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d741db67-f890-4857-87e6-8164807ee66a admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:24.972028 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8859d576-af33-453b-bd4d-4ad51a7e47cc admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:24.972123 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d741db67-f890-4857-87e6-8164807ee66a admin admin] PATH_INFO: `/v3/users` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:24.972657 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d741db67-f890-4857-87e6-8164807ee66a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:24.975321 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d741db67-f890-4857-87e6-8164807ee66a admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:25.003458 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1029/2043] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 11:34:24 2022] POST /identity/v3/users => generated 285 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 11:34:25.005764 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d741db67-f890-4857-87e6-8164807ee66a admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:25.017831 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d741db67-f890-4857-87e6-8164807ee66a admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:25.030039 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-8859d576-af33-453b-bd4d-4ad51a7e47cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9475f716a53c4dafb871845789ea4f18', 'request_id': 'req-8859d576-af33-453b-bd4d-4ad51a7e47cc'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:25.036549 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-8859d576-af33-453b-bd4d-4ad51a7e47cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9475f716a53c4dafb871845789ea4f18', 'request_id': 'req-8859d576-af33-453b-bd4d-4ad51a7e47cc'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:25.043167 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-8859d576-af33-453b-bd4d-4ad51a7e47cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9475f716a53c4dafb871845789ea4f18', 'request_id': 'req-8859d576-af33-453b-bd4d-4ad51a7e47cc'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:25.076292 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-8859d576-af33-453b-bd4d-4ad51a7e47cc admin admin] The token cache is being invalidate because project 9475f716a53c4dafb871845789ea4f18 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:34:25.082458 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-8859d576-af33-453b-bd4d-4ad51a7e47cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:25.085973 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-8859d576-af33-453b-bd4d-4ad51a7e47cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:25.086771 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78645987-f087-46b4-b0b6-b0d53f292648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:25.087632 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78645987-f087-46b4-b0b6-b0d53f292648 admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:25.087792 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78645987-f087-46b4-b0b6-b0d53f292648 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:25.088375 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78645987-f087-46b4-b0b6-b0d53f292648 admin admin] PATH_INFO: `/v3/projects` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:25.088677 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78645987-f087-46b4-b0b6-b0d53f292648 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:25.090475 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1015/2044] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 11:34:24 2022] DELETE /identity/v3/projects/9475f716a53c4dafb871845789ea4f18 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:34:25.090683 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78645987-f087-46b4-b0b6-b0d53f292648 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:25.092614 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8859d576-af33-453b-bd4d-4ad51a7e47cc admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:25.097720 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-8859d576-af33-453b-bd4d-4ad51a7e47cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:25.120607 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8859d576-af33-453b-bd4d-4ad51a7e47cc admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:25.128463 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf592557-95d4-4699-ab85-da731d4595de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:25.129718 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf592557-95d4-4699-ab85-da731d4595de admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:25.130164 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf592557-95d4-4699-ab85-da731d4595de admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:25.130671 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf592557-95d4-4699-ab85-da731d4595de admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:25.131378 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf592557-95d4-4699-ab85-da731d4595de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:25.133349 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf592557-95d4-4699-ab85-da731d4595de admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:25.158575 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1016/2045] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:34:25 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:34:25.158575 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50048455-769a-486a-8b91-8bbca2e187b6 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:25.158575 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50048455-769a-486a-8b91-8bbca2e187b6 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:25.158575 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50048455-769a-486a-8b91-8bbca2e187b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:25.161087 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1030/2046] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 11:34:25 2022] POST /identity/v3/projects => generated 373 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:34:25.164484 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78645987-f087-46b4-b0b6-b0d53f292648 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:25.187560 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-50048455-769a-486a-8b91-8bbca2e187b6 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:34:25.189293 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-50048455-769a-486a-8b91-8bbca2e187b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:25.257360 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78645987-f087-46b4-b0b6-b0d53f292648 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:25.259677 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1017/2047] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:34:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:34:25.260738 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50048455-769a-486a-8b91-8bbca2e187b6 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:25.266570 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-50048455-769a-486a-8b91-8bbca2e187b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:25.270085 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be73f723-2898-41b5-8e6d-9581ef097125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:25.270960 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be73f723-2898-41b5-8e6d-9581ef097125 admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:25.271358 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be73f723-2898-41b5-8e6d-9581ef097125 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:25.271731 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be73f723-2898-41b5-8e6d-9581ef097125 admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:25.272643 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be73f723-2898-41b5-8e6d-9581ef097125 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:25.274583 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be73f723-2898-41b5-8e6d-9581ef097125 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:25.279804 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50048455-769a-486a-8b91-8bbca2e187b6 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:25.285599 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaa96fe-7ed7-49cc-af1a-0da1961beaf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:25.286422 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaa96fe-7ed7-49cc-af1a-0da1961beaf8 admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:25.286859 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaa96fe-7ed7-49cc-af1a-0da1961beaf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:25.287154 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaa96fe-7ed7-49cc-af1a-0da1961beaf8 admin admin] PATH_INFO: `/v3/users` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:25.289536 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abaa96fe-7ed7-49cc-af1a-0da1961beaf8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:25.289666 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1031/2048] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:34:25 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:34:25.290242 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abaa96fe-7ed7-49cc-af1a-0da1961beaf8 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:25.295697 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87f7195-3b16-4133-bf8d-eee0b4d152d0 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:25.295946 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87f7195-3b16-4133-bf8d-eee0b4d152d0 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:25.296187 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87f7195-3b16-4133-bf8d-eee0b4d152d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:25.324483 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-b87f7195-3b16-4133-bf8d-eee0b4d152d0 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:34:25.325823 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-b87f7195-3b16-4133-bf8d-eee0b4d152d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:25.338159 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1032/2050] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:34:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:34:25.339104 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87f7195-3b16-4133-bf8d-eee0b4d152d0 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:25.340445 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1018/2049] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 11:34:25 2022] POST /identity/v3/users => generated 293 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:34:25.343864 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaa96fe-7ed7-49cc-af1a-0da1961beaf8 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:25.350259 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87f7195-3b16-4133-bf8d-eee0b4d152d0 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:25.357419 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1afe671-b4d7-4d91-86eb-d8850f0ddd46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:25.357811 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaa96fe-7ed7-49cc-af1a-0da1961beaf8 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:25.358298 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1afe671-b4d7-4d91-86eb-d8850f0ddd46 admin admin] REQUEST_METHOD: `PUT` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:25.358648 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1afe671-b4d7-4d91-86eb-d8850f0ddd46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:25.358926 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1afe671-b4d7-4d91-86eb-d8850f0ddd46 admin admin] PATH_INFO: `/v3/projects/cf68a46e27ed4039963d662cec2de37e/users/5ec634056e1449d5a8a09bb9f2558b1b/roles/27e3e65e24df4b86b0d3d18d3212101d` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:25.365046 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f55874-3c26-41e0-855b-82a0234c1377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:25.366664 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f55874-3c26-41e0-855b-82a0234c1377 admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:25.367154 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f55874-3c26-41e0-855b-82a0234c1377 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:25.367640 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f55874-3c26-41e0-855b-82a0234c1377 admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:25.368505 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f55874-3c26-41e0-855b-82a0234c1377 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:25.370795 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f55874-3c26-41e0-855b-82a0234c1377 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:25.375425 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1afe671-b4d7-4d91-86eb-d8850f0ddd46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf68a46e27ed4039963d662cec2de37e, user_id=5ec634056e1449d5a8a09bb9f2558b1b, role_id=27e3e65e24df4b86b0d3d18d3212101d)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:25.382390 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1afe671-b4d7-4d91-86eb-d8850f0ddd46 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:25.398243 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1019/2051] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:34:25 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:34:25.399267 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f55874-3c26-41e0-855b-82a0234c1377 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:25.400338 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1033/2052] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 11:34:25 2022] PUT /identity/v3/projects/cf68a46e27ed4039963d662cec2de37e/users/5ec634056e1449d5a8a09bb9f2558b1b/roles/27e3e65e24df4b86b0d3d18d3212101d => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:34:25.402616 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1afe671-b4d7-4d91-86eb-d8850f0ddd46 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:25.421219 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f55874-3c26-41e0-855b-82a0234c1377 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:25.447595 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:25.448721 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:25.493668 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1afe671-b4d7-4d91-86eb-d8850f0ddd46 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:25.499436 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad7b7ab-3b48-4d95-9ea9-c7b2dc34eb26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:25.500226 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad7b7ab-3b48-4d95-9ea9-c7b2dc34eb26 admin admin] REQUEST_METHOD: `PUT` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:25.500723 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad7b7ab-3b48-4d95-9ea9-c7b2dc34eb26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:25.501255 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad7b7ab-3b48-4d95-9ea9-c7b2dc34eb26 admin admin] PATH_INFO: `/v3/projects/f41bbf2d14754893bd4372f4996cfb44/users/f780bbb6f14e47459f595e8fc4d6076b/roles/30bb1e97257f4ca5b90c88545777317b` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:25.525852 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad7b7ab-3b48-4d95-9ea9-c7b2dc34eb26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f41bbf2d14754893bd4372f4996cfb44, user_id=f780bbb6f14e47459f595e8fc4d6076b, role_id=30bb1e97257f4ca5b90c88545777317b)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:25.529301 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad7b7ab-3b48-4d95-9ea9-c7b2dc34eb26 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:25.531117 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c292d74a-4e43-4cc5-bb64-8e18e5b0801b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:25.532777 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c292d74a-4e43-4cc5-bb64-8e18e5b0801b admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:25.533149 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c292d74a-4e43-4cc5-bb64-8e18e5b0801b admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:25.533561 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c292d74a-4e43-4cc5-bb64-8e18e5b0801b admin admin] PATH_INFO: `/v3/domains` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:25.534233 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c292d74a-4e43-4cc5-bb64-8e18e5b0801b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:34:25.534701 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c292d74a-4e43-4cc5-bb64-8e18e5b0801b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:25.538426 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c292d74a-4e43-4cc5-bb64-8e18e5b0801b admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:25.546342 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1034/2053] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 11:34:25 2022] PUT /identity/v3/projects/f41bbf2d14754893bd4372f4996cfb44/users/f780bbb6f14e47459f595e8fc4d6076b/roles/30bb1e97257f4ca5b90c88545777317b => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:34:25.552562 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1020/2054] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 24 11:34:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:34:25.552562 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c292d74a-4e43-4cc5-bb64-8e18e5b0801b admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:25.552824 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb944751-f2c2-4cd2-a8c8-5b801a4687d8 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:25.552824 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb944751-f2c2-4cd2-a8c8-5b801a4687d8 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:25.552824 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb944751-f2c2-4cd2-a8c8-5b801a4687d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:25.562547 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c292d74a-4e43-4cc5-bb64-8e18e5b0801b admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:25.589518 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-fb944751-f2c2-4cd2-a8c8-5b801a4687d8 None None] MFA Rules not processed for user `5ec634056e1449d5a8a09bb9f2558b1b`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:34:25.590789 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-fb944751-f2c2-4cd2-a8c8-5b801a4687d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:25.635592 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c63402-d9bc-4117-ae0a-0b0c1d5beaa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:25.636365 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c63402-d9bc-4117-ae0a-0b0c1d5beaa2 admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:25.636716 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c63402-d9bc-4117-ae0a-0b0c1d5beaa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:25.637268 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c63402-d9bc-4117-ae0a-0b0c1d5beaa2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:25.637991 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c63402-d9bc-4117-ae0a-0b0c1d5beaa2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:25.641831 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c63402-d9bc-4117-ae0a-0b0c1d5beaa2 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:25.654965 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1021/2055] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:34:25 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:34:25.655836 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c63402-d9bc-4117-ae0a-0b0c1d5beaa2 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:25.670841 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c63402-d9bc-4117-ae0a-0b0c1d5beaa2 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:25.675665 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaafc807-a95e-4303-8b14-98e43e9a3066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:25.676351 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaafc807-a95e-4303-8b14-98e43e9a3066 admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:25.676696 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaafc807-a95e-4303-8b14-98e43e9a3066 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:25.677025 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaafc807-a95e-4303-8b14-98e43e9a3066 admin admin] PATH_INFO: `/v3/projects` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:25.677729 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaafc807-a95e-4303-8b14-98e43e9a3066 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:25.679818 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaafc807-a95e-4303-8b14-98e43e9a3066 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:25.700336 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1035/2056] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:34:25 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:34:25.701193 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb944751-f2c2-4cd2-a8c8-5b801a4687d8 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:25.714780 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb944751-f2c2-4cd2-a8c8-5b801a4687d8 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:25.718252 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1022/2057] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 11:34:25 2022] POST /identity/v3/projects => generated 379 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:34:25.718252 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaafc807-a95e-4303-8b14-98e43e9a3066 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:25.719545 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-eaafc807-a95e-4303-8b14-98e43e9a3066 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:25.782912 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49230dbb-302c-47ef-9e42-2f594552c7ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:25.784037 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49230dbb-302c-47ef-9e42-2f594552c7ca admin admin] REQUEST_METHOD: `PUT` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:25.784360 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49230dbb-302c-47ef-9e42-2f594552c7ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:25.784636 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49230dbb-302c-47ef-9e42-2f594552c7ca admin admin] PATH_INFO: `/v3/projects/f41bbf2d14754893bd4372f4996cfb44/users/f780bbb6f14e47459f595e8fc4d6076b/roles/30bb1e97257f4ca5b90c88545777317b` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:25.787351 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49230dbb-302c-47ef-9e42-2f594552c7ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=f41bbf2d14754893bd4372f4996cfb44, user_id=f780bbb6f14e47459f595e8fc4d6076b, role_id=30bb1e97257f4ca5b90c88545777317b)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:25.790634 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49230dbb-302c-47ef-9e42-2f594552c7ca admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:25.812835 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1036/2058] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 11:34:25 2022] PUT /identity/v3/projects/f41bbf2d14754893bd4372f4996cfb44/users/f780bbb6f14e47459f595e8fc4d6076b/roles/30bb1e97257f4ca5b90c88545777317b => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:34:25.812835 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49230dbb-302c-47ef-9e42-2f594552c7ca admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:25.813108 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaafc807-a95e-4303-8b14-98e43e9a3066 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:25.838181 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:25.859419 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:25.880468 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f080ff-962e-485c-b100-9fc694672622 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abffba24649e49d28a01cbee51924ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:25.881117 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f080ff-962e-485c-b100-9fc694672622 service glance] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:25.881573 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f080ff-962e-485c-b100-9fc694672622 service glance] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:25.881860 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f080ff-962e-485c-b100-9fc694672622 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:25.887458 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49230dbb-302c-47ef-9e42-2f594552c7ca admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:25.893536 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e137422-bb7f-4e5b-a78b-5252089f65f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:25.894444 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e137422-bb7f-4e5b-a78b-5252089f65f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:25.894793 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e137422-bb7f-4e5b-a78b-5252089f65f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:25.895151 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e137422-bb7f-4e5b-a78b-5252089f65f6 admin admin] PATH_INFO: `/v3/users` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:25.895871 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e137422-bb7f-4e5b-a78b-5252089f65f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:25.898113 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e137422-bb7f-4e5b-a78b-5252089f65f6 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:25.926604 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1037/2059] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 11:34:25 2022] POST /identity/v3/users => generated 290 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:34:25.926604 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a740b798-a85a-4e11-b294-62e6e85ab47b None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:25.926604 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a740b798-a85a-4e11-b294-62e6e85ab47b None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:25.926604 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a740b798-a85a-4e11-b294-62e6e85ab47b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:25.955305 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f080ff-962e-485c-b100-9fc694672622 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:25.956983 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f080ff-962e-485c-b100-9fc694672622 service glance] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:25.957313 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-a740b798-a85a-4e11-b294-62e6e85ab47b None None] MFA Rules not processed for user `f780bbb6f14e47459f595e8fc4d6076b`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:34:25.958762 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-a740b798-a85a-4e11-b294-62e6e85ab47b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:25.969145 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1023/2060] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:34:25 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:34:25.969979 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f080ff-962e-485c-b100-9fc694672622 service glance] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:25.981008 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f080ff-962e-485c-b100-9fc694672622 service glance] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:25.986017 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66987c6d-8784-4f70-9215-900b5f8a1389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:25.986691 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66987c6d-8784-4f70-9215-900b5f8a1389 admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:25.986965 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66987c6d-8784-4f70-9215-900b5f8a1389 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:25.987227 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66987c6d-8784-4f70-9215-900b5f8a1389 admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:25.988053 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66987c6d-8784-4f70-9215-900b5f8a1389 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:25.989774 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66987c6d-8784-4f70-9215-900b5f8a1389 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:26.002672 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1024/2061] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:34:25 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:34:26.007128 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66987c6d-8784-4f70-9215-900b5f8a1389 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:26.020034 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66987c6d-8784-4f70-9215-900b5f8a1389 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:26.025594 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16018a7e-5c8b-4e14-9f30-3ffb40c4814b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:26.026235 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16018a7e-5c8b-4e14-9f30-3ffb40c4814b admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:26.026557 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16018a7e-5c8b-4e14-9f30-3ffb40c4814b admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:26.026824 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16018a7e-5c8b-4e14-9f30-3ffb40c4814b admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:26.027481 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16018a7e-5c8b-4e14-9f30-3ffb40c4814b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:26.029143 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16018a7e-5c8b-4e14-9f30-3ffb40c4814b admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:26.043831 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1025/2062] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:34:26 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:34:26.045583 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16018a7e-5c8b-4e14-9f30-3ffb40c4814b admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:26.050375 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1038/2063] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:34:25 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:34:26.057321 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16018a7e-5c8b-4e14-9f30-3ffb40c4814b admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:26.061809 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a740b798-a85a-4e11-b294-62e6e85ab47b None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:26.063437 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-a740b798-a85a-4e11-b294-62e6e85ab47b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:26.067039 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bbaf0b-d09e-4fe7-b9bb-5855d26e399d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:26.067771 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bbaf0b-d09e-4fe7-b9bb-5855d26e399d admin admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:26.068054 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bbaf0b-d09e-4fe7-b9bb-5855d26e399d admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:26.068330 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bbaf0b-d09e-4fe7-b9bb-5855d26e399d admin admin] PATH_INFO: `/v3/projects/330e9cffce2b4af58c1b14ea02c2d358/users/f2e42ebe0082413695e7677a6678026a/roles/27e3e65e24df4b86b0d3d18d3212101d` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:26.088864 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bbaf0b-d09e-4fe7-b9bb-5855d26e399d admin admin] RBAC: Authorizing `identity:create_grant(project_id=330e9cffce2b4af58c1b14ea02c2d358, user_id=f2e42ebe0082413695e7677a6678026a, role_id=27e3e65e24df4b86b0d3d18d3212101d)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:26.091955 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bbaf0b-d09e-4fe7-b9bb-5855d26e399d admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:26.114588 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1026/2064] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 11:34:26 2022] PUT /identity/v3/projects/330e9cffce2b4af58c1b14ea02c2d358/users/f2e42ebe0082413695e7677a6678026a/roles/27e3e65e24df4b86b0d3d18d3212101d => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 11:34:26.126330 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c5b83b-8ddf-4ae7-a547-fcdbdcc63a5e None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:26.126761 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c5b83b-8ddf-4ae7-a547-fcdbdcc63a5e None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:26.127038 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c5b83b-8ddf-4ae7-a547-fcdbdcc63a5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:26.143490 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a740b798-a85a-4e11-b294-62e6e85ab47b None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:26.156814 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-29c5b83b-8ddf-4ae7-a547-fcdbdcc63a5e None None] MFA Rules not processed for user `f2e42ebe0082413695e7677a6678026a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:34:26.158999 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-29c5b83b-8ddf-4ae7-a547-fcdbdcc63a5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:26.202274 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c805cd12-2832-46ae-803f-bbb3e1a7cdd0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92862b76ba3b4513b5dc5b5c962faac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:26.202953 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c805cd12-2832-46ae-803f-bbb3e1a7cdd0 service cinder] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:26.203233 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c805cd12-2832-46ae-803f-bbb3e1a7cdd0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:26.203498 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c805cd12-2832-46ae-803f-bbb3e1a7cdd0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:26.206555 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-c805cd12-2832-46ae-803f-bbb3e1a7cdd0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:26.232592 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:26.234469 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1027/2065] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:34:26 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:34:26.239222 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c5b83b-8ddf-4ae7-a547-fcdbdcc63a5e None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:26.266977 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:26.277851 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c805cd12-2832-46ae-803f-bbb3e1a7cdd0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:26.279560 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c805cd12-2832-46ae-803f-bbb3e1a7cdd0 service cinder] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:26.290812 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1039/2066] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:34:26 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 11:34:26.313078 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c5b83b-8ddf-4ae7-a547-fcdbdcc63a5e None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:26.320819 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f205a1-5a36-4f0c-bdab-a31b8e3528cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:26.321446 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f205a1-5a36-4f0c-bdab-a31b8e3528cb admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:26.321864 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f205a1-5a36-4f0c-bdab-a31b8e3528cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:26.322306 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f205a1-5a36-4f0c-bdab-a31b8e3528cb admin admin] PATH_INFO: `/v3/projects` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:26.323118 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f205a1-5a36-4f0c-bdab-a31b8e3528cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:26.325562 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f205a1-5a36-4f0c-bdab-a31b8e3528cb admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:26.358474 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1028/2067] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 11:34:26 2022] POST /identity/v3/projects => generated 379 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 11:34:26.362809 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c805cd12-2832-46ae-803f-bbb3e1a7cdd0 service cinder] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:26.374139 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c805cd12-2832-46ae-803f-bbb3e1a7cdd0 service cinder] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:26.448111 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5c67f4-25ca-4cd7-b043-4a6a24b3335e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:26.449027 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5c67f4-25ca-4cd7-b043-4a6a24b3335e admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:26.449545 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5c67f4-25ca-4cd7-b043-4a6a24b3335e admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:26.450033 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5c67f4-25ca-4cd7-b043-4a6a24b3335e admin admin] PATH_INFO: `/v3/users` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:26.450971 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5c67f4-25ca-4cd7-b043-4a6a24b3335e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:26.454614 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5c67f4-25ca-4cd7-b043-4a6a24b3335e admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:26.487058 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1040/2068] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 11:34:26 2022] POST /identity/v3/users => generated 290 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:34:26.491335 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f205a1-5a36-4f0c-bdab-a31b8e3528cb admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:26.505540 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f205a1-5a36-4f0c-bdab-a31b8e3528cb admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:26.510672 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcb8506-d848-4218-a085-ec900ef61527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:26.511433 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcb8506-d848-4218-a085-ec900ef61527 admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:26.511902 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcb8506-d848-4218-a085-ec900ef61527 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:26.512428 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcb8506-d848-4218-a085-ec900ef61527 admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:26.512987 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcb8506-d848-4218-a085-ec900ef61527 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:26.514934 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcb8506-d848-4218-a085-ec900ef61527 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:26.530516 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1029/2069] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:34:26 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:34:26.532127 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5c67f4-25ca-4cd7-b043-4a6a24b3335e admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:26.544066 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5c67f4-25ca-4cd7-b043-4a6a24b3335e admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:26.550493 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae1d99c-170c-49d4-b1c7-081fe02b9608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:26.551120 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae1d99c-170c-49d4-b1c7-081fe02b9608 admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:26.551395 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae1d99c-170c-49d4-b1c7-081fe02b9608 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:26.551727 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae1d99c-170c-49d4-b1c7-081fe02b9608 admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:26.552389 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae1d99c-170c-49d4-b1c7-081fe02b9608 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:26.554537 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae1d99c-170c-49d4-b1c7-081fe02b9608 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:26.574203 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1041/2070] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:34:26 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:34:26.575404 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcb8506-d848-4218-a085-ec900ef61527 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:26.589557 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcb8506-d848-4218-a085-ec900ef61527 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:26.594706 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7204694d-772b-4271-83b7-adb6b813dae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:26.595413 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7204694d-772b-4271-83b7-adb6b813dae4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:26.595693 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7204694d-772b-4271-83b7-adb6b813dae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:26.595966 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7204694d-772b-4271-83b7-adb6b813dae4 admin admin] PATH_INFO: `/v3/projects/f3b4dab3c793436598d7d2a0a77ca2c7/users/438e3b31dd6a448083198b710fb8e70e/roles/27e3e65e24df4b86b0d3d18d3212101d` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:26.614331 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7204694d-772b-4271-83b7-adb6b813dae4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3b4dab3c793436598d7d2a0a77ca2c7, user_id=438e3b31dd6a448083198b710fb8e70e, role_id=27e3e65e24df4b86b0d3d18d3212101d)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:26.617726 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7204694d-772b-4271-83b7-adb6b813dae4 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:26.633724 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1030/2071] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 11:34:26 2022] PUT /identity/v3/projects/f3b4dab3c793436598d7d2a0a77ca2c7/users/438e3b31dd6a448083198b710fb8e70e/roles/27e3e65e24df4b86b0d3d18d3212101d => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:34:26.646553 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2291bf3a-0ea9-483a-999b-9fc3644b6572 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:26.647115 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2291bf3a-0ea9-483a-999b-9fc3644b6572 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:26.647548 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2291bf3a-0ea9-483a-999b-9fc3644b6572 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:26.722547 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-2291bf3a-0ea9-483a-999b-9fc3644b6572 None None] MFA Rules not processed for user `438e3b31dd6a448083198b710fb8e70e`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:34:26.724531 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-2291bf3a-0ea9-483a-999b-9fc3644b6572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:26.876899 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7204694d-772b-4271-83b7-adb6b813dae4 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:26.884465 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1042/2072] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:34:26 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:34:26.972237 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7204694d-772b-4271-83b7-adb6b813dae4 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:26.978646 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33c8d4f-b5cd-449e-a7db-1c566a2c638a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:26.979516 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33c8d4f-b5cd-449e-a7db-1c566a2c638a admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:26.980013 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33c8d4f-b5cd-449e-a7db-1c566a2c638a admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:26.980731 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33c8d4f-b5cd-449e-a7db-1c566a2c638a admin admin] PATH_INFO: `/v3/projects` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:26.981387 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33c8d4f-b5cd-449e-a7db-1c566a2c638a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:26.984179 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33c8d4f-b5cd-449e-a7db-1c566a2c638a admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:27.028990 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1031/2073] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 11:34:26 2022] POST /identity/v3/projects => generated 379 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:34:27.033226 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2291bf3a-0ea9-483a-999b-9fc3644b6572 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:27.044228 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2291bf3a-0ea9-483a-999b-9fc3644b6572 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:27.079670 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:27.117755 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e66e2fc-b037-4353-85bf-85de81f25121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:27.117755 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e66e2fc-b037-4353-85bf-85de81f25121 admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:27.118048 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e66e2fc-b037-4353-85bf-85de81f25121 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:27.118257 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e66e2fc-b037-4353-85bf-85de81f25121 admin admin] PATH_INFO: `/v3/users` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:27.118939 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e66e2fc-b037-4353-85bf-85de81f25121 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:27.121516 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e66e2fc-b037-4353-85bf-85de81f25121 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:27.157630 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1043/2074] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 11:34:27 2022] POST /identity/v3/users => generated 296 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:34:27.161843 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33c8d4f-b5cd-449e-a7db-1c566a2c638a admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:27.174894 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33c8d4f-b5cd-449e-a7db-1c566a2c638a admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:27.181203 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486afd77-e992-440b-bba9-271fc59b7aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:27.182501 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486afd77-e992-440b-bba9-271fc59b7aa0 admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:27.182814 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486afd77-e992-440b-bba9-271fc59b7aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:27.183056 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486afd77-e992-440b-bba9-271fc59b7aa0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:27.184228 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486afd77-e992-440b-bba9-271fc59b7aa0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:27.186098 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486afd77-e992-440b-bba9-271fc59b7aa0 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:27.198831 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1032/2075] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:34:27 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 11:34:27.203642 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e66e2fc-b037-4353-85bf-85de81f25121 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:27.215497 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e66e2fc-b037-4353-85bf-85de81f25121 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:27.221470 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95f0b34-cb0c-4357-8063-84ef8ce3f8a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:27.222187 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95f0b34-cb0c-4357-8063-84ef8ce3f8a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:27.222495 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95f0b34-cb0c-4357-8063-84ef8ce3f8a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:27.222937 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95f0b34-cb0c-4357-8063-84ef8ce3f8a3 admin admin] PATH_INFO: `/v3/projects/bfbafb5631c843bdabd046b7df0b5be4/users/79dfce4a526c424d899b310d97cb3d43/roles/30bb1e97257f4ca5b90c88545777317b` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:27.242545 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95f0b34-cb0c-4357-8063-84ef8ce3f8a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfbafb5631c843bdabd046b7df0b5be4, user_id=79dfce4a526c424d899b310d97cb3d43, role_id=30bb1e97257f4ca5b90c88545777317b)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:27.245269 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95f0b34-cb0c-4357-8063-84ef8ce3f8a3 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:27.261315 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1044/2076] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 11:34:27 2022] PUT /identity/v3/projects/bfbafb5631c843bdabd046b7df0b5be4/users/79dfce4a526c424d899b310d97cb3d43/roles/30bb1e97257f4ca5b90c88545777317b => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:34:27.266118 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486afd77-e992-440b-bba9-271fc59b7aa0 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:27.279690 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486afd77-e992-440b-bba9-271fc59b7aa0 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:27.329755 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:27.345542 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d249b9b-a1b1-40c6-8b27-cca65fd25857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:27.346200 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d249b9b-a1b1-40c6-8b27-cca65fd25857 admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:27.346506 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d249b9b-a1b1-40c6-8b27-cca65fd25857 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:27.346801 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d249b9b-a1b1-40c6-8b27-cca65fd25857 admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:27.347498 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d249b9b-a1b1-40c6-8b27-cca65fd25857 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:27.349125 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d249b9b-a1b1-40c6-8b27-cca65fd25857 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:27.359358 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1033/2077] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:34:27 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:34:27.363844 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95f0b34-cb0c-4357-8063-84ef8ce3f8a3 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:27.374521 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95f0b34-cb0c-4357-8063-84ef8ce3f8a3 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:27.379981 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2097ec-c08c-4517-8801-fb9705bb5712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:27.380567 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2097ec-c08c-4517-8801-fb9705bb5712 admin admin] REQUEST_METHOD: `PUT` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:27.380843 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2097ec-c08c-4517-8801-fb9705bb5712 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:27.381112 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2097ec-c08c-4517-8801-fb9705bb5712 admin admin] PATH_INFO: `/v3/projects/bfbafb5631c843bdabd046b7df0b5be4/users/79dfce4a526c424d899b310d97cb3d43/roles/30bb1e97257f4ca5b90c88545777317b` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:27.383085 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2097ec-c08c-4517-8801-fb9705bb5712 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfbafb5631c843bdabd046b7df0b5be4, user_id=79dfce4a526c424d899b310d97cb3d43, role_id=30bb1e97257f4ca5b90c88545777317b)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:27.385754 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2097ec-c08c-4517-8801-fb9705bb5712 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:27.397879 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1045/2078] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 11:34:27 2022] PUT /identity/v3/projects/bfbafb5631c843bdabd046b7df0b5be4/users/79dfce4a526c424d899b310d97cb3d43/roles/30bb1e97257f4ca5b90c88545777317b => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:34:27.411291 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df91523e-0ff3-4ddf-a35e-ada47caca7e4 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:27.411664 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df91523e-0ff3-4ddf-a35e-ada47caca7e4 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:27.412065 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df91523e-0ff3-4ddf-a35e-ada47caca7e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:27.453325 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-df91523e-0ff3-4ddf-a35e-ada47caca7e4 None None] MFA Rules not processed for user `79dfce4a526c424d899b310d97cb3d43`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:34:27.454983 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-df91523e-0ff3-4ddf-a35e-ada47caca7e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:27.594101 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1034/2079] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:34:27 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:34:27.614313 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2097ec-c08c-4517-8801-fb9705bb5712 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:27.616435 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-db2097ec-c08c-4517-8801-fb9705bb5712 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:27.689008 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2097ec-c08c-4517-8801-fb9705bb5712 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:27.693210 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9ff455-de4c-4d30-a43c-86655c2ac156 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92862b76ba3b4513b5dc5b5c962faac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:27.693836 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9ff455-de4c-4d30-a43c-86655c2ac156 service cinder] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:27.694114 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9ff455-de4c-4d30-a43c-86655c2ac156 service cinder] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:27.694408 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9ff455-de4c-4d30-a43c-86655c2ac156 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:27.711661 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9ff455-de4c-4d30-a43c-86655c2ac156 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:27.713671 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9ff455-de4c-4d30-a43c-86655c2ac156 service cinder] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:27.730575 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1046/2080] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:34:27 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:34:27.803380 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df91523e-0ff3-4ddf-a35e-ada47caca7e4 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:27.822284 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df91523e-0ff3-4ddf-a35e-ada47caca7e4 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:27.830110 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0614e0e-5032-4251-90dc-da80928a586d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92862b76ba3b4513b5dc5b5c962faac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:27.830993 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0614e0e-5032-4251-90dc-da80928a586d service cinder] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:27.831319 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0614e0e-5032-4251-90dc-da80928a586d service cinder] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:27.841308 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0614e0e-5032-4251-90dc-da80928a586d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:27.991655 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0614e0e-5032-4251-90dc-da80928a586d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:27.994046 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0614e0e-5032-4251-90dc-da80928a586d service cinder] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:28.025242 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9ff455-de4c-4d30-a43c-86655c2ac156 service cinder] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:28.025968 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1035/2081] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:34:27 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:34:28.044112 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9ff455-de4c-4d30-a43c-86655c2ac156 service cinder] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:28.048882 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fa6230-322a-4383-890a-35b00efa213d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92862b76ba3b4513b5dc5b5c962faac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:28.049906 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fa6230-322a-4383-890a-35b00efa213d service cinder] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:28.050398 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fa6230-322a-4383-890a-35b00efa213d service cinder] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:28.050820 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fa6230-322a-4383-890a-35b00efa213d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:28.058768 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-81fa6230-322a-4383-890a-35b00efa213d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:28.196317 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fa6230-322a-4383-890a-35b00efa213d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:28.197804 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fa6230-322a-4383-890a-35b00efa213d service cinder] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:28.228792 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1047/2082] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:34:28 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 11:34:29.018095 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0614e0e-5032-4251-90dc-da80928a586d service cinder] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:29.035715 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0614e0e-5032-4251-90dc-da80928a586d service cinder] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:29.046738 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8151f95b-9ece-4058-91b0-f2059ec02b7f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92862b76ba3b4513b5dc5b5c962faac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:29.048277 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8151f95b-9ece-4058-91b0-f2059ec02b7f service cinder] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:29.049884 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8151f95b-9ece-4058-91b0-f2059ec02b7f service cinder] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:29.051890 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8151f95b-9ece-4058-91b0-f2059ec02b7f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:29.181356 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8151f95b-9ece-4058-91b0-f2059ec02b7f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:29.184166 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8151f95b-9ece-4058-91b0-f2059ec02b7f service cinder] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:29.194712 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:29.206588 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1036/2083] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:34:29 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:34:31.274109 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fa6230-322a-4383-890a-35b00efa213d service cinder] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:31.306222 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:31.345175 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fa6230-322a-4383-890a-35b00efa213d service cinder] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:31.350407 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12725e51-a8f1-4163-93b0-1f24d1c71cef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:31.351078 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12725e51-a8f1-4163-93b0-1f24d1c71cef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:31.351379 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12725e51-a8f1-4163-93b0-1f24d1c71cef admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:31.351680 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12725e51-a8f1-4163-93b0-1f24d1c71cef admin admin] PATH_INFO: `/v3/users/f2e42ebe0082413695e7677a6678026a` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:31.352996 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12725e51-a8f1-4163-93b0-1f24d1c71cef admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2e42ebe0082413695e7677a6678026a)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:31.355235 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12725e51-a8f1-4163-93b0-1f24d1c71cef admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:31.405280 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-12725e51-a8f1-4163-93b0-1f24d1c71cef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2e42ebe0082413695e7677a6678026a'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:31.405997 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-12725e51-a8f1-4163-93b0-1f24d1c71cef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2e42ebe0082413695e7677a6678026a'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:31.406646 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-12725e51-a8f1-4163-93b0-1f24d1c71cef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2e42ebe0082413695e7677a6678026a'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:31.414659 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-12725e51-a8f1-4163-93b0-1f24d1c71cef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2e42ebe0082413695e7677a6678026a'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:31.422375 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-12725e51-a8f1-4163-93b0-1f24d1c71cef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2e42ebe0082413695e7677a6678026a'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:31.440330 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1048/2084] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 11:34:31 2022] DELETE /identity/v3/users/f2e42ebe0082413695e7677a6678026a => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:34:31.445168 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63723bef-96bd-4485-bdcc-2b682f7b2d31 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:31.445681 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63723bef-96bd-4485-bdcc-2b682f7b2d31 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:31.445681 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63723bef-96bd-4485-bdcc-2b682f7b2d31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:31.466234 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-63723bef-96bd-4485-bdcc-2b682f7b2d31 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:34:31.467524 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-63723bef-96bd-4485-bdcc-2b682f7b2d31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:31.532759 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1037/2085] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:34:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:34:31.543240 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12725e51-a8f1-4163-93b0-1f24d1c71cef admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:31.544736 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-12725e51-a8f1-4163-93b0-1f24d1c71cef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:31.607507 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12725e51-a8f1-4163-93b0-1f24d1c71cef admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:31.612514 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727165fb-b9e6-4aa4-ba7c-7ebdbfbb52d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2d061d25d83443c9232218c90792d51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:31.613216 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727165fb-b9e6-4aa4-ba7c-7ebdbfbb52d1 service neutron] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:31.613502 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727165fb-b9e6-4aa4-ba7c-7ebdbfbb52d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:31.613787 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727165fb-b9e6-4aa4-ba7c-7ebdbfbb52d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:31.623359 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727165fb-b9e6-4aa4-ba7c-7ebdbfbb52d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:31.624820 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727165fb-b9e6-4aa4-ba7c-7ebdbfbb52d1 service neutron] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:31.635092 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1049/2086] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:34:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:34:31.926802 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63723bef-96bd-4485-bdcc-2b682f7b2d31 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:31.928256 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-63723bef-96bd-4485-bdcc-2b682f7b2d31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:31.942738 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63723bef-96bd-4485-bdcc-2b682f7b2d31 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:31.948796 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deb6565-a902-4d67-8d10-b9f858b89d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:31.949502 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deb6565-a902-4d67-8d10-b9f858b89d03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:31.949858 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deb6565-a902-4d67-8d10-b9f858b89d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:31.950168 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deb6565-a902-4d67-8d10-b9f858b89d03 admin admin] PATH_INFO: `/v3/projects/330e9cffce2b4af58c1b14ea02c2d358` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:31.951499 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6deb6565-a902-4d67-8d10-b9f858b89d03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=330e9cffce2b4af58c1b14ea02c2d358)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:31.953425 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6deb6565-a902-4d67-8d10-b9f858b89d03 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:32.012152 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-6deb6565-a902-4d67-8d10-b9f858b89d03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '330e9cffce2b4af58c1b14ea02c2d358', 'request_id': 'req-6deb6565-a902-4d67-8d10-b9f858b89d03'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:32.019362 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-6deb6565-a902-4d67-8d10-b9f858b89d03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '330e9cffce2b4af58c1b14ea02c2d358', 'request_id': 'req-6deb6565-a902-4d67-8d10-b9f858b89d03'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:32.040806 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-6deb6565-a902-4d67-8d10-b9f858b89d03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '330e9cffce2b4af58c1b14ea02c2d358', 'request_id': 'req-6deb6565-a902-4d67-8d10-b9f858b89d03'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:32.059453 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-6deb6565-a902-4d67-8d10-b9f858b89d03 admin admin] The token cache is being invalidate because project 330e9cffce2b4af58c1b14ea02c2d358 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:34:32.059823 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-6deb6565-a902-4d67-8d10-b9f858b89d03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:32.060718 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-6deb6565-a902-4d67-8d10-b9f858b89d03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:32.063101 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1038/2087] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 11:34:31 2022] DELETE /identity/v3/projects/330e9cffce2b4af58c1b14ea02c2d358 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:34:32.067475 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727165fb-b9e6-4aa4-ba7c-7ebdbfbb52d1 service neutron] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:32.078321 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727165fb-b9e6-4aa4-ba7c-7ebdbfbb52d1 service neutron] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:32.158018 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:32.190693 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a05d3e-f57c-4392-95d6-cec64dc95ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:32.193696 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a05d3e-f57c-4392-95d6-cec64dc95ef1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:32.193696 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a05d3e-f57c-4392-95d6-cec64dc95ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:32.193979 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a05d3e-f57c-4392-95d6-cec64dc95ef1 admin admin] PATH_INFO: `/v3/users/438e3b31dd6a448083198b710fb8e70e` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:32.197998 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a05d3e-f57c-4392-95d6-cec64dc95ef1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=438e3b31dd6a448083198b710fb8e70e)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:32.199773 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a05d3e-f57c-4392-95d6-cec64dc95ef1 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:32.269228 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-64a05d3e-f57c-4392-95d6-cec64dc95ef1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '438e3b31dd6a448083198b710fb8e70e'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:32.270741 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-64a05d3e-f57c-4392-95d6-cec64dc95ef1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '438e3b31dd6a448083198b710fb8e70e'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:32.271737 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-64a05d3e-f57c-4392-95d6-cec64dc95ef1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '438e3b31dd6a448083198b710fb8e70e'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:32.286619 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-64a05d3e-f57c-4392-95d6-cec64dc95ef1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '438e3b31dd6a448083198b710fb8e70e'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:32.301793 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-64a05d3e-f57c-4392-95d6-cec64dc95ef1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '438e3b31dd6a448083198b710fb8e70e'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:32.343160 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1050/2088] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 11:34:32 2022] DELETE /identity/v3/users/438e3b31dd6a448083198b710fb8e70e => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:34:32.649046 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deb6565-a902-4d67-8d10-b9f858b89d03 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:32.650906 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-6deb6565-a902-4d67-8d10-b9f858b89d03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:32.666350 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deb6565-a902-4d67-8d10-b9f858b89d03 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:32.751092 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e367cb-f595-4124-9560-ed907feeb8e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:32.751813 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e367cb-f595-4124-9560-ed907feeb8e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:32.752141 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e367cb-f595-4124-9560-ed907feeb8e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:32.752501 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e367cb-f595-4124-9560-ed907feeb8e7 admin admin] PATH_INFO: `/v3/projects/f3b4dab3c793436598d7d2a0a77ca2c7` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:32.753617 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e367cb-f595-4124-9560-ed907feeb8e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3b4dab3c793436598d7d2a0a77ca2c7)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:32.756100 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e367cb-f595-4124-9560-ed907feeb8e7 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:32.789477 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:32.812874 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-17e367cb-f595-4124-9560-ed907feeb8e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3b4dab3c793436598d7d2a0a77ca2c7', 'request_id': 'req-17e367cb-f595-4124-9560-ed907feeb8e7'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:32.819706 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-17e367cb-f595-4124-9560-ed907feeb8e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3b4dab3c793436598d7d2a0a77ca2c7', 'request_id': 'req-17e367cb-f595-4124-9560-ed907feeb8e7'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:32.826218 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-17e367cb-f595-4124-9560-ed907feeb8e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3b4dab3c793436598d7d2a0a77ca2c7', 'request_id': 'req-17e367cb-f595-4124-9560-ed907feeb8e7'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:32.840376 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-17e367cb-f595-4124-9560-ed907feeb8e7 admin admin] The token cache is being invalidate because project f3b4dab3c793436598d7d2a0a77ca2c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:34:32.840687 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-17e367cb-f595-4124-9560-ed907feeb8e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:32.841325 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-17e367cb-f595-4124-9560-ed907feeb8e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:32.842862 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1039/2089] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 11:34:32 2022] DELETE /identity/v3/projects/f3b4dab3c793436598d7d2a0a77ca2c7 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:34:32.847073 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a05d3e-f57c-4392-95d6-cec64dc95ef1 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:32.848632 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-64a05d3e-f57c-4392-95d6-cec64dc95ef1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:32.861531 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a05d3e-f57c-4392-95d6-cec64dc95ef1 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:32.921547 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52cfeb6-7d06-49b4-b46f-1bd451babd20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:32.922549 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52cfeb6-7d06-49b4-b46f-1bd451babd20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:32.922549 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52cfeb6-7d06-49b4-b46f-1bd451babd20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:32.922752 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52cfeb6-7d06-49b4-b46f-1bd451babd20 admin admin] PATH_INFO: `/v3/users/79dfce4a526c424d899b310d97cb3d43` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:32.924009 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52cfeb6-7d06-49b4-b46f-1bd451babd20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=79dfce4a526c424d899b310d97cb3d43)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:32.926126 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52cfeb6-7d06-49b4-b46f-1bd451babd20 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:32.979291 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-b52cfeb6-7d06-49b4-b46f-1bd451babd20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79dfce4a526c424d899b310d97cb3d43'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:32.979945 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-b52cfeb6-7d06-49b4-b46f-1bd451babd20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79dfce4a526c424d899b310d97cb3d43'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:32.980596 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-b52cfeb6-7d06-49b4-b46f-1bd451babd20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79dfce4a526c424d899b310d97cb3d43'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:32.989478 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-b52cfeb6-7d06-49b4-b46f-1bd451babd20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79dfce4a526c424d899b310d97cb3d43'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:32.997151 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-b52cfeb6-7d06-49b4-b46f-1bd451babd20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79dfce4a526c424d899b310d97cb3d43'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:33.002665 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:33.020819 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1051/2090] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 11:34:32 2022] DELETE /identity/v3/users/79dfce4a526c424d899b310d97cb3d43 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 11:34:33.367299 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e367cb-f595-4124-9560-ed907feeb8e7 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:33.368694 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52cfeb6-7d06-49b4-b46f-1bd451babd20 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:33.369704 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-17e367cb-f595-4124-9560-ed907feeb8e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:33.371926 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-b52cfeb6-7d06-49b4-b46f-1bd451babd20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:33.389983 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e367cb-f595-4124-9560-ed907feeb8e7 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:33.497759 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52cfeb6-7d06-49b4-b46f-1bd451babd20 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:33.500174 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9da66b-28ba-43b3-a309-adfcfb72a5f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:33.500939 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9da66b-28ba-43b3-a309-adfcfb72a5f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:33.501331 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9da66b-28ba-43b3-a309-adfcfb72a5f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:33.501675 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9da66b-28ba-43b3-a309-adfcfb72a5f1 admin admin] PATH_INFO: `/v3/users/93bab5941d9d4a6eba875385f0e1d3e2` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:33.503100 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9da66b-28ba-43b3-a309-adfcfb72a5f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=93bab5941d9d4a6eba875385f0e1d3e2)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:33.504842 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29ee86d-fa16-4ff8-a3a8-c74cf3695e70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:33.505643 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29ee86d-fa16-4ff8-a3a8-c74cf3695e70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:33.505943 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9da66b-28ba-43b3-a309-adfcfb72a5f1 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:33.506046 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29ee86d-fa16-4ff8-a3a8-c74cf3695e70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:33.506239 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29ee86d-fa16-4ff8-a3a8-c74cf3695e70 admin admin] PATH_INFO: `/v3/projects/bfbafb5631c843bdabd046b7df0b5be4` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:33.511142 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29ee86d-fa16-4ff8-a3a8-c74cf3695e70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bfbafb5631c843bdabd046b7df0b5be4)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:33.516832 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29ee86d-fa16-4ff8-a3a8-c74cf3695e70 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:33.571333 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-6f9da66b-28ba-43b3-a309-adfcfb72a5f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93bab5941d9d4a6eba875385f0e1d3e2'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:33.572146 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-6f9da66b-28ba-43b3-a309-adfcfb72a5f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93bab5941d9d4a6eba875385f0e1d3e2'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:33.587320 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-6f9da66b-28ba-43b3-a309-adfcfb72a5f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93bab5941d9d4a6eba875385f0e1d3e2'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:33.605280 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-6f9da66b-28ba-43b3-a309-adfcfb72a5f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93bab5941d9d4a6eba875385f0e1d3e2'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:33.606301 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-6f9da66b-28ba-43b3-a309-adfcfb72a5f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93bab5941d9d4a6eba875385f0e1d3e2'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:33.615489 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-b29ee86d-fa16-4ff8-a3a8-c74cf3695e70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bfbafb5631c843bdabd046b7df0b5be4', 'request_id': 'req-b29ee86d-fa16-4ff8-a3a8-c74cf3695e70'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:33.638022 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-b29ee86d-fa16-4ff8-a3a8-c74cf3695e70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bfbafb5631c843bdabd046b7df0b5be4', 'request_id': 'req-b29ee86d-fa16-4ff8-a3a8-c74cf3695e70'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:33.667436 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1040/2091] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 11:34:33 2022] DELETE /identity/v3/users/93bab5941d9d4a6eba875385f0e1d3e2 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:34:33.674516 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-b29ee86d-fa16-4ff8-a3a8-c74cf3695e70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bfbafb5631c843bdabd046b7df0b5be4', 'request_id': 'req-b29ee86d-fa16-4ff8-a3a8-c74cf3695e70'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:33.678759 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d59026-c1d8-4a2f-aa13-44e0a3d54681 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:33.679044 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d59026-c1d8-4a2f-aa13-44e0a3d54681 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:33.679315 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d59026-c1d8-4a2f-aa13-44e0a3d54681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:33.704221 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-b29ee86d-fa16-4ff8-a3a8-c74cf3695e70 admin admin] The token cache is being invalidate because project bfbafb5631c843bdabd046b7df0b5be4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81501) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:34:33.704684 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-b29ee86d-fa16-4ff8-a3a8-c74cf3695e70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:33.705567 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-b29ee86d-fa16-4ff8-a3a8-c74cf3695e70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:33.716984 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1052/2092] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 11:34:33 2022] DELETE /identity/v3/projects/bfbafb5631c843bdabd046b7df0b5be4 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 11:34:33.720031 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-92d59026-c1d8-4a2f-aa13-44e0a3d54681 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:34:33.721728 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-92d59026-c1d8-4a2f-aa13-44e0a3d54681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:33.724849 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac4ade5-c5ce-4713-af66-e05d56b86f64 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:33.725144 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac4ade5-c5ce-4713-af66-e05d56b86f64 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:33.725417 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac4ade5-c5ce-4713-af66-e05d56b86f64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:33.754641 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-7ac4ade5-c5ce-4713-af66-e05d56b86f64 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:34:33.757987 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:33.758634 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-7ac4ade5-c5ce-4713-af66-e05d56b86f64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:33.838075 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1041/2093] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:34:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:34:33.848489 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d59026-c1d8-4a2f-aa13-44e0a3d54681 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:33.849921 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-92d59026-c1d8-4a2f-aa13-44e0a3d54681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:33.866409 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1053/2094] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:34:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 11:34:33.874588 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a074e4f5-99e7-4f98-8f09-5c8d88edab11 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:33.874588 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a074e4f5-99e7-4f98-8f09-5c8d88edab11 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:33.874588 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a074e4f5-99e7-4f98-8f09-5c8d88edab11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:33.906347 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-a074e4f5-99e7-4f98-8f09-5c8d88edab11 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:34:33.908540 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-a074e4f5-99e7-4f98-8f09-5c8d88edab11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:33.918322 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1054/2095] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:34:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 11:34:33.922961 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a074e4f5-99e7-4f98-8f09-5c8d88edab11 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:33.933439 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d59026-c1d8-4a2f-aa13-44e0a3d54681 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:33.935249 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a074e4f5-99e7-4f98-8f09-5c8d88edab11 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:33.937107 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518f23eb-c514-4a3c-8e00-2792d9177f14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2d061d25d83443c9232218c90792d51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:33.937736 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518f23eb-c514-4a3c-8e00-2792d9177f14 service neutron] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:33.938014 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518f23eb-c514-4a3c-8e00-2792d9177f14 service neutron] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:33.938282 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518f23eb-c514-4a3c-8e00-2792d9177f14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:33.941482 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9aa1dc-8b0a-44fa-a908-4213d0adac63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:33.942301 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9aa1dc-8b0a-44fa-a908-4213d0adac63 admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:33.942876 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9aa1dc-8b0a-44fa-a908-4213d0adac63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:33.943302 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9aa1dc-8b0a-44fa-a908-4213d0adac63 admin admin] PATH_INFO: `/v3/domains` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:33.946262 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9aa1dc-8b0a-44fa-a908-4213d0adac63 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:34:33.946989 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9aa1dc-8b0a-44fa-a908-4213d0adac63 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:33.949802 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518f23eb-c514-4a3c-8e00-2792d9177f14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:33.949939 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9aa1dc-8b0a-44fa-a908-4213d0adac63 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:33.952111 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518f23eb-c514-4a3c-8e00-2792d9177f14 service neutron] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:33.953990 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:33.968998 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1055/2097] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 24 11:34:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:34:33.969215 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1042/2097] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:34:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 11:34:33.974249 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9aa1dc-8b0a-44fa-a908-4213d0adac63 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:33.990865 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9aa1dc-8b0a-44fa-a908-4213d0adac63 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:34.010248 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec4e787-ab99-4ea8-86d1-3fb093f29404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:34.011337 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec4e787-ab99-4ea8-86d1-3fb093f29404 admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:34.011712 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec4e787-ab99-4ea8-86d1-3fb093f29404 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:34.012058 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec4e787-ab99-4ea8-86d1-3fb093f29404 admin admin] PATH_INFO: `/v3/projects` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:34.012919 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec4e787-ab99-4ea8-86d1-3fb093f29404 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:34.015362 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec4e787-ab99-4ea8-86d1-3fb093f29404 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:34.058809 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1056/2098] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 11:34:33 2022] POST /identity/v3/projects => generated 371 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 11:34:34.063288 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518f23eb-c514-4a3c-8e00-2792d9177f14 service neutron] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:34.075452 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518f23eb-c514-4a3c-8e00-2792d9177f14 service neutron] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:34.174063 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db07d6e-5131-4ea0-9150-d19b26c86152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:34.174722 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db07d6e-5131-4ea0-9150-d19b26c86152 admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:34.175004 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db07d6e-5131-4ea0-9150-d19b26c86152 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:34.175277 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db07d6e-5131-4ea0-9150-d19b26c86152 admin admin] PATH_INFO: `/v3/users` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:34.175909 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db07d6e-5131-4ea0-9150-d19b26c86152 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:34.177855 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db07d6e-5131-4ea0-9150-d19b26c86152 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:34.203479 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1043/2099] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 11:34:34 2022] POST /identity/v3/users => generated 286 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:34:34.207563 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec4e787-ab99-4ea8-86d1-3fb093f29404 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:34.220645 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec4e787-ab99-4ea8-86d1-3fb093f29404 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:34.235303 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb31fd8-b33f-4a19-bc66-d49d28a6e3f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:34.237335 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb31fd8-b33f-4a19-bc66-d49d28a6e3f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:34.237627 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb31fd8-b33f-4a19-bc66-d49d28a6e3f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:34.237901 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb31fd8-b33f-4a19-bc66-d49d28a6e3f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:34.238737 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb31fd8-b33f-4a19-bc66-d49d28a6e3f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:34.240604 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb31fd8-b33f-4a19-bc66-d49d28a6e3f2 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:34.252131 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1057/2100] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:34:34 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 11:34:34.256420 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db07d6e-5131-4ea0-9150-d19b26c86152 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:34.268124 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db07d6e-5131-4ea0-9150-d19b26c86152 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:34.273751 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f2eb41-958f-41c5-bac5-8773463ae9a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:34.274762 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f2eb41-958f-41c5-bac5-8773463ae9a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:34.275189 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f2eb41-958f-41c5-bac5-8773463ae9a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:34.275608 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f2eb41-958f-41c5-bac5-8773463ae9a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:34.276407 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f2eb41-958f-41c5-bac5-8773463ae9a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:34.279359 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f2eb41-958f-41c5-bac5-8773463ae9a2 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:34.292486 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1044/2101] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:34:34 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 11:34:34.296894 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb31fd8-b33f-4a19-bc66-d49d28a6e3f2 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:34.311243 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb31fd8-b33f-4a19-bc66-d49d28a6e3f2 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:34.320125 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4444614-fb2c-481e-84d8-8de406721b4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:34.321480 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4444614-fb2c-481e-84d8-8de406721b4b admin admin] REQUEST_METHOD: `PUT` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:34.321905 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4444614-fb2c-481e-84d8-8de406721b4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:34.322325 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4444614-fb2c-481e-84d8-8de406721b4b admin admin] PATH_INFO: `/v3/projects/e688ad4dcbf74937850b53954675a9e0/users/07e50eea391b40d6b5b90ae436558450/roles/27e3e65e24df4b86b0d3d18d3212101d` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:34.326349 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f2eb41-958f-41c5-bac5-8773463ae9a2 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:34.328553 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-a2f2eb41-958f-41c5-bac5-8773463ae9a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:34.357449 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f2eb41-958f-41c5-bac5-8773463ae9a2 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:34.357680 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4444614-fb2c-481e-84d8-8de406721b4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e688ad4dcbf74937850b53954675a9e0, user_id=07e50eea391b40d6b5b90ae436558450, role_id=27e3e65e24df4b86b0d3d18d3212101d)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:34.360876 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4444614-fb2c-481e-84d8-8de406721b4b admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:34.362988 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67582686-eab4-4833-8572-6c0774f6afff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:34.363651 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67582686-eab4-4833-8572-6c0774f6afff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:34.364058 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67582686-eab4-4833-8572-6c0774f6afff admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:34.364354 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67582686-eab4-4833-8572-6c0774f6afff admin admin] PATH_INFO: `/v3/projects/68d0b12a8ba94a85ae5aabdd042e6c99` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:34.366599 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67582686-eab4-4833-8572-6c0774f6afff admin admin] RBAC: Authorizing `identity:delete_project(project_id=68d0b12a8ba94a85ae5aabdd042e6c99)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:34.369038 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67582686-eab4-4833-8572-6c0774f6afff admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:34.380281 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1058/2102] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 11:34:34 2022] PUT /identity/v3/projects/e688ad4dcbf74937850b53954675a9e0/users/07e50eea391b40d6b5b90ae436558450/roles/27e3e65e24df4b86b0d3d18d3212101d => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:34:34.385922 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb301852-9a5a-4af8-9a78-1bd3d373ffee None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:34.388022 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb301852-9a5a-4af8-9a78-1bd3d373ffee None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:34.388583 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb301852-9a5a-4af8-9a78-1bd3d373ffee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:34.443761 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-eb301852-9a5a-4af8-9a78-1bd3d373ffee None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:34:34.445543 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-eb301852-9a5a-4af8-9a78-1bd3d373ffee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:34.482193 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-67582686-eab4-4833-8572-6c0774f6afff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68d0b12a8ba94a85ae5aabdd042e6c99', 'request_id': 'req-67582686-eab4-4833-8572-6c0774f6afff'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:34.484750 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:34.498982 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-67582686-eab4-4833-8572-6c0774f6afff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68d0b12a8ba94a85ae5aabdd042e6c99', 'request_id': 'req-67582686-eab4-4833-8572-6c0774f6afff'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:34.511857 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-67582686-eab4-4833-8572-6c0774f6afff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68d0b12a8ba94a85ae5aabdd042e6c99', 'request_id': 'req-67582686-eab4-4833-8572-6c0774f6afff'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:34.527836 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-67582686-eab4-4833-8572-6c0774f6afff admin admin] The token cache is being invalidate because project 68d0b12a8ba94a85ae5aabdd042e6c99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:34:34.528015 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-67582686-eab4-4833-8572-6c0774f6afff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:34.528947 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-67582686-eab4-4833-8572-6c0774f6afff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:34.533766 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1045/2103] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 11:34:34 2022] DELETE /identity/v3/projects/68d0b12a8ba94a85ae5aabdd042e6c99 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:34:34.535732 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67582686-eab4-4833-8572-6c0774f6afff admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:34.537037 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-67582686-eab4-4833-8572-6c0774f6afff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:34.537491 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1059/2104] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:34:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:34:34.547608 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb301852-9a5a-4af8-9a78-1bd3d373ffee None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:34.549076 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-eb301852-9a5a-4af8-9a78-1bd3d373ffee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:34.620952 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb301852-9a5a-4af8-9a78-1bd3d373ffee None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:34.622063 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67582686-eab4-4833-8572-6c0774f6afff admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:34.632616 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418a4e20-3550-4c74-9213-01e7bc650009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:34.633267 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418a4e20-3550-4c74-9213-01e7bc650009 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:34.633551 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418a4e20-3550-4c74-9213-01e7bc650009 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:34.633818 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418a4e20-3550-4c74-9213-01e7bc650009 admin admin] PATH_INFO: `/v3/users/0579c0f9a5804d3183ea6b123dfb3531` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:34.635165 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418a4e20-3550-4c74-9213-01e7bc650009 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0579c0f9a5804d3183ea6b123dfb3531)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:34.637138 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418a4e20-3550-4c74-9213-01e7bc650009 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:34.691153 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1394c6eb-6ce8-4712-8dce-e10dfca389ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2d061d25d83443c9232218c90792d51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:34.691966 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1394c6eb-6ce8-4712-8dce-e10dfca389ce service neutron] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:34.692276 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1394c6eb-6ce8-4712-8dce-e10dfca389ce service neutron] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:34.692800 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1394c6eb-6ce8-4712-8dce-e10dfca389ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:34.695558 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-1394c6eb-6ce8-4712-8dce-e10dfca389ce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:34.715022 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1394c6eb-6ce8-4712-8dce-e10dfca389ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:34.716683 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1394c6eb-6ce8-4712-8dce-e10dfca389ce service neutron] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:34.722682 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:34.736342 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1060/2105] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:34:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 11:34:34.759473 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-418a4e20-3550-4c74-9213-01e7bc650009 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0579c0f9a5804d3183ea6b123dfb3531'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:34.760647 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-418a4e20-3550-4c74-9213-01e7bc650009 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0579c0f9a5804d3183ea6b123dfb3531'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:34.777603 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-418a4e20-3550-4c74-9213-01e7bc650009 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0579c0f9a5804d3183ea6b123dfb3531'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:34.793105 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-418a4e20-3550-4c74-9213-01e7bc650009 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0579c0f9a5804d3183ea6b123dfb3531'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:34.799518 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-418a4e20-3550-4c74-9213-01e7bc650009 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0579c0f9a5804d3183ea6b123dfb3531'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:34.825052 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1046/2106] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 11:34:34 2022] DELETE /identity/v3/users/0579c0f9a5804d3183ea6b123dfb3531 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 11:34:35.548818 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1394c6eb-6ce8-4712-8dce-e10dfca389ce service neutron] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:35.559979 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1394c6eb-6ce8-4712-8dce-e10dfca389ce service neutron] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:35.663656 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac62fb1-9245-46bc-ace1-0c1910be835a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:35.664576 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac62fb1-9245-46bc-ace1-0c1910be835a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:35.665033 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac62fb1-9245-46bc-ace1-0c1910be835a admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:35.665439 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac62fb1-9245-46bc-ace1-0c1910be835a admin admin] PATH_INFO: `/v3/projects/0369f004380b423490733fbf8a4601a3` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:35.666849 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac62fb1-9245-46bc-ace1-0c1910be835a admin admin] RBAC: Authorizing `identity:delete_project(project_id=0369f004380b423490733fbf8a4601a3)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:35.668937 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac62fb1-9245-46bc-ace1-0c1910be835a admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:35.730759 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-2ac62fb1-9245-46bc-ace1-0c1910be835a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0369f004380b423490733fbf8a4601a3', 'request_id': 'req-2ac62fb1-9245-46bc-ace1-0c1910be835a'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:35.740046 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-2ac62fb1-9245-46bc-ace1-0c1910be835a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0369f004380b423490733fbf8a4601a3', 'request_id': 'req-2ac62fb1-9245-46bc-ace1-0c1910be835a'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:35.756437 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-2ac62fb1-9245-46bc-ace1-0c1910be835a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0369f004380b423490733fbf8a4601a3', 'request_id': 'req-2ac62fb1-9245-46bc-ace1-0c1910be835a'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:35.782731 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-2ac62fb1-9245-46bc-ace1-0c1910be835a admin admin] The token cache is being invalidate because project 0369f004380b423490733fbf8a4601a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81501) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:34:35.783065 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-2ac62fb1-9245-46bc-ace1-0c1910be835a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:35.783919 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-2ac62fb1-9245-46bc-ace1-0c1910be835a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:35.785766 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1061/2107] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 11:34:35 2022] DELETE /identity/v3/projects/0369f004380b423490733fbf8a4601a3 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:34:35.791329 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418a4e20-3550-4c74-9213-01e7bc650009 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:35.796015 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-418a4e20-3550-4c74-9213-01e7bc650009 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:35.814064 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418a4e20-3550-4c74-9213-01e7bc650009 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:35.892421 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:35.906899 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293a4392-2d20-45fc-bcc7-9a5a610d5e48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:35.909165 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293a4392-2d20-45fc-bcc7-9a5a610d5e48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:35.909724 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293a4392-2d20-45fc-bcc7-9a5a610d5e48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:35.910845 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293a4392-2d20-45fc-bcc7-9a5a610d5e48 admin admin] PATH_INFO: `/v3/users/f780bbb6f14e47459f595e8fc4d6076b` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:35.912405 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293a4392-2d20-45fc-bcc7-9a5a610d5e48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f780bbb6f14e47459f595e8fc4d6076b)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:35.914726 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293a4392-2d20-45fc-bcc7-9a5a610d5e48 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:36.004708 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-293a4392-2d20-45fc-bcc7-9a5a610d5e48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f780bbb6f14e47459f595e8fc4d6076b'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:36.005403 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-293a4392-2d20-45fc-bcc7-9a5a610d5e48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f780bbb6f14e47459f595e8fc4d6076b'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:36.020948 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-293a4392-2d20-45fc-bcc7-9a5a610d5e48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f780bbb6f14e47459f595e8fc4d6076b'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:36.045394 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-293a4392-2d20-45fc-bcc7-9a5a610d5e48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f780bbb6f14e47459f595e8fc4d6076b'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:36.046033 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-293a4392-2d20-45fc-bcc7-9a5a610d5e48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f780bbb6f14e47459f595e8fc4d6076b'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:36.083468 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1047/2108] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 11:34:35 2022] DELETE /identity/v3/users/f780bbb6f14e47459f595e8fc4d6076b => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:34:36.963812 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac62fb1-9245-46bc-ace1-0c1910be835a admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:36.965293 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-2ac62fb1-9245-46bc-ace1-0c1910be835a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:36.996254 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac62fb1-9245-46bc-ace1-0c1910be835a admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:37.095280 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca139779-105f-4841-96d6-b0d94f41d350 None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:37.095862 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca139779-105f-4841-96d6-b0d94f41d350 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:37.096753 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca139779-105f-4841-96d6-b0d94f41d350 None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:37.099280 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1048/2109] 10.222.0.27 () {54 vars in 921 bytes} [Wed Aug 24 11:34:37 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 11:34:37.117444 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14794540-d963-45e1-934c-10ebdc10453c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:37.118336 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14794540-d963-45e1-934c-10ebdc10453c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:37.118822 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14794540-d963-45e1-934c-10ebdc10453c admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:37.119209 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14794540-d963-45e1-934c-10ebdc10453c admin admin] PATH_INFO: `/v3/projects/f41bbf2d14754893bd4372f4996cfb44` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:37.120602 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14794540-d963-45e1-934c-10ebdc10453c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f41bbf2d14754893bd4372f4996cfb44)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:37.122696 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14794540-d963-45e1-934c-10ebdc10453c admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:37.156000 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48e9158-0aa2-41f6-9ad3-67189e6fd7e3 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:37.156423 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48e9158-0aa2-41f6-9ad3-67189e6fd7e3 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:37.156663 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48e9158-0aa2-41f6-9ad3-67189e6fd7e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:37.188780 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:37.194830 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-d48e9158-0aa2-41f6-9ad3-67189e6fd7e3 None None] MFA Rules not processed for user `ad45431e70ff48a9b90905a97d473d81`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:34:37.196689 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-d48e9158-0aa2-41f6-9ad3-67189e6fd7e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:37.247570 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-14794540-d963-45e1-934c-10ebdc10453c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f41bbf2d14754893bd4372f4996cfb44', 'request_id': 'req-14794540-d963-45e1-934c-10ebdc10453c'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:37.257287 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-14794540-d963-45e1-934c-10ebdc10453c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f41bbf2d14754893bd4372f4996cfb44', 'request_id': 'req-14794540-d963-45e1-934c-10ebdc10453c'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:37.271054 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-14794540-d963-45e1-934c-10ebdc10453c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f41bbf2d14754893bd4372f4996cfb44', 'request_id': 'req-14794540-d963-45e1-934c-10ebdc10453c'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:37.300307 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-14794540-d963-45e1-934c-10ebdc10453c admin admin] The token cache is being invalidate because project f41bbf2d14754893bd4372f4996cfb44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81501) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:34:37.300720 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-14794540-d963-45e1-934c-10ebdc10453c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:37.301473 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-14794540-d963-45e1-934c-10ebdc10453c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:37.306656 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1062/2110] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 11:34:36 2022] DELETE /identity/v3/projects/f41bbf2d14754893bd4372f4996cfb44 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:34:37.309107 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14794540-d963-45e1-934c-10ebdc10453c admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:37.310702 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-14794540-d963-45e1-934c-10ebdc10453c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:37.335732 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1049/2111] 10.222.0.27 () {58 vars in 1018 bytes} [Wed Aug 24 11:34:37 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 11:34:37.337372 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88f72ad-f407-40b3-bb24-cc1255781117 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:37.337834 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88f72ad-f407-40b3-bb24-cc1255781117 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:37.338284 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88f72ad-f407-40b3-bb24-cc1255781117 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:37.374552 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-a88f72ad-f407-40b3-bb24-cc1255781117 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:34:37.376086 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-a88f72ad-f407-40b3-bb24-cc1255781117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:37.382301 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14794540-d963-45e1-934c-10ebdc10453c admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:37.387338 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1050/2112] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:34:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:34:37.388301 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88f72ad-f407-40b3-bb24-cc1255781117 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:37.389707 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-a88f72ad-f407-40b3-bb24-cc1255781117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:37.390551 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d712357b-8e09-4d8f-aac9-aa57fa60e0b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:37.391260 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d712357b-8e09-4d8f-aac9-aa57fa60e0b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:37.391547 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d712357b-8e09-4d8f-aac9-aa57fa60e0b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:37.391830 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d712357b-8e09-4d8f-aac9-aa57fa60e0b9 admin admin] PATH_INFO: `/v3/users/83a80b36a7d64f1c95cc7e772acf38e2` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:37.393406 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d712357b-8e09-4d8f-aac9-aa57fa60e0b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=83a80b36a7d64f1c95cc7e772acf38e2)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:37.395797 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d712357b-8e09-4d8f-aac9-aa57fa60e0b9 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:37.407119 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88f72ad-f407-40b3-bb24-cc1255781117 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:37.414033 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a337400-d2c8-456a-b47b-fb05b5df17aa service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad45431e70ff48a9b90905a97d473d81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:37.415470 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a337400-d2c8-456a-b47b-fb05b5df17aa service placement] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:37.415885 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a337400-d2c8-456a-b47b-fb05b5df17aa service placement] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:37.416295 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a337400-d2c8-456a-b47b-fb05b5df17aa service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:37.429519 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a337400-d2c8-456a-b47b-fb05b5df17aa service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:37.431222 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a337400-d2c8-456a-b47b-fb05b5df17aa service placement] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:37.454947 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1051/2113] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:34:37 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:34:37.475191 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-d712357b-8e09-4d8f-aac9-aa57fa60e0b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83a80b36a7d64f1c95cc7e772acf38e2'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:37.475926 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-d712357b-8e09-4d8f-aac9-aa57fa60e0b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83a80b36a7d64f1c95cc7e772acf38e2'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:37.476715 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-d712357b-8e09-4d8f-aac9-aa57fa60e0b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83a80b36a7d64f1c95cc7e772acf38e2'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:37.478683 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ed1753-bc25-43a0-8c14-6e40ad5b6bc6 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:37.479896 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ed1753-bc25-43a0-8c14-6e40ad5b6bc6 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:37.480351 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ed1753-bc25-43a0-8c14-6e40ad5b6bc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:37.494321 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-d712357b-8e09-4d8f-aac9-aa57fa60e0b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83a80b36a7d64f1c95cc7e772acf38e2'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:37.515067 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-d712357b-8e09-4d8f-aac9-aa57fa60e0b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83a80b36a7d64f1c95cc7e772acf38e2'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:37.526433 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-86ed1753-bc25-43a0-8c14-6e40ad5b6bc6 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:34:37.528498 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-86ed1753-bc25-43a0-8c14-6e40ad5b6bc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:37.553296 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1052/2114] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:34:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:34:37.559440 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ed1753-bc25-43a0-8c14-6e40ad5b6bc6 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:37.576425 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ed1753-bc25-43a0-8c14-6e40ad5b6bc6 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:37.581536 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09b2bea-878e-4dcf-838b-911d7e0f8272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:37.582163 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09b2bea-878e-4dcf-838b-911d7e0f8272 admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:37.582634 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09b2bea-878e-4dcf-838b-911d7e0f8272 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:37.583068 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09b2bea-878e-4dcf-838b-911d7e0f8272 admin admin] PATH_INFO: `/v3/domains` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:37.584039 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09b2bea-878e-4dcf-838b-911d7e0f8272 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:34:37.584485 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09b2bea-878e-4dcf-838b-911d7e0f8272 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:37.586327 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09b2bea-878e-4dcf-838b-911d7e0f8272 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:37.593990 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1063/2115] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 11:34:37 2022] DELETE /identity/v3/users/83a80b36a7d64f1c95cc7e772acf38e2 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:34:37.603834 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1053/2116] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 24 11:34:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:34:37.610210 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d712357b-8e09-4d8f-aac9-aa57fa60e0b9 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:37.667479 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:37.692682 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d712357b-8e09-4d8f-aac9-aa57fa60e0b9 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:37.697885 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb852ca-c653-4733-9548-32400ce97e32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:37.698755 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb852ca-c653-4733-9548-32400ce97e32 admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:37.699087 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb852ca-c653-4733-9548-32400ce97e32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:37.699423 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb852ca-c653-4733-9548-32400ce97e32 admin admin] PATH_INFO: `/v3/projects` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:37.700097 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb852ca-c653-4733-9548-32400ce97e32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:37.703171 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb852ca-c653-4733-9548-32400ce97e32 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:37.757235 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1064/2117] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 11:34:37 2022] POST /identity/v3/projects => generated 375 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 11:34:37.758401 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09b2bea-878e-4dcf-838b-911d7e0f8272 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:37.771210 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09b2bea-878e-4dcf-838b-911d7e0f8272 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:37.825628 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:37.860030 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b798383d-a01a-4461-b692-edc68d74fd7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:37.860764 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b798383d-a01a-4461-b692-edc68d74fd7b admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:37.861138 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b798383d-a01a-4461-b692-edc68d74fd7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:37.861615 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b798383d-a01a-4461-b692-edc68d74fd7b admin admin] PATH_INFO: `/v3/users` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:37.862382 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b798383d-a01a-4461-b692-edc68d74fd7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:37.864459 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b798383d-a01a-4461-b692-edc68d74fd7b admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:37.892649 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1054/2118] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 11:34:37 2022] POST /identity/v3/users => generated 288 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:34:37.897037 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb852ca-c653-4733-9548-32400ce97e32 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:37.903126 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b798383d-a01a-4461-b692-edc68d74fd7b admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:37.909262 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-b798383d-a01a-4461-b692-edc68d74fd7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:37.912238 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb852ca-c653-4733-9548-32400ce97e32 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:37.925667 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b10536-ac39-4adf-bc12-90a2be079dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:37.926308 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b10536-ac39-4adf-bc12-90a2be079dab admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:37.926614 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b10536-ac39-4adf-bc12-90a2be079dab admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:37.926890 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b10536-ac39-4adf-bc12-90a2be079dab admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:37.927123 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b798383d-a01a-4461-b692-edc68d74fd7b admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:37.932597 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b10536-ac39-4adf-bc12-90a2be079dab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:37.932896 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51175f1f-0f3f-4782-8b0e-c65fc1e8d01b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:37.933578 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51175f1f-0f3f-4782-8b0e-c65fc1e8d01b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:37.933863 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51175f1f-0f3f-4782-8b0e-c65fc1e8d01b admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:37.934164 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51175f1f-0f3f-4782-8b0e-c65fc1e8d01b admin admin] PATH_INFO: `/v3/projects/b6fdd897eaa14182b8cdc89f56fac227` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:37.935505 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51175f1f-0f3f-4782-8b0e-c65fc1e8d01b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6fdd897eaa14182b8cdc89f56fac227)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:37.939243 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51175f1f-0f3f-4782-8b0e-c65fc1e8d01b admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:37.949663 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b10536-ac39-4adf-bc12-90a2be079dab admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:37.985182 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1065/2119] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:34:37 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:34:37.987075 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b10536-ac39-4adf-bc12-90a2be079dab admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:38.005515 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b10536-ac39-4adf-bc12-90a2be079dab admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:38.014025 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18fca58-79bc-42ca-b838-3c41e5ec4e15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:38.016906 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18fca58-79bc-42ca-b838-3c41e5ec4e15 admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:38.017361 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18fca58-79bc-42ca-b838-3c41e5ec4e15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:38.017966 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18fca58-79bc-42ca-b838-3c41e5ec4e15 admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:38.020020 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18fca58-79bc-42ca-b838-3c41e5ec4e15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:38.022092 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18fca58-79bc-42ca-b838-3c41e5ec4e15 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:38.028019 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-51175f1f-0f3f-4782-8b0e-c65fc1e8d01b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6fdd897eaa14182b8cdc89f56fac227', 'request_id': 'req-51175f1f-0f3f-4782-8b0e-c65fc1e8d01b'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:38.038463 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1066/2120] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:34:37 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:34:38.038719 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-51175f1f-0f3f-4782-8b0e-c65fc1e8d01b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6fdd897eaa14182b8cdc89f56fac227', 'request_id': 'req-51175f1f-0f3f-4782-8b0e-c65fc1e8d01b'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:38.040174 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18fca58-79bc-42ca-b838-3c41e5ec4e15 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:38.049512 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-51175f1f-0f3f-4782-8b0e-c65fc1e8d01b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6fdd897eaa14182b8cdc89f56fac227', 'request_id': 'req-51175f1f-0f3f-4782-8b0e-c65fc1e8d01b'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:38.052150 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18fca58-79bc-42ca-b838-3c41e5ec4e15 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:38.072675 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-51175f1f-0f3f-4782-8b0e-c65fc1e8d01b admin admin] The token cache is being invalidate because project b6fdd897eaa14182b8cdc89f56fac227 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:34:38.073401 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-51175f1f-0f3f-4782-8b0e-c65fc1e8d01b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:38.075153 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-51175f1f-0f3f-4782-8b0e-c65fc1e8d01b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:38.078472 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1055/2121] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 11:34:37 2022] DELETE /identity/v3/projects/b6fdd897eaa14182b8cdc89f56fac227 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 11:34:38.087970 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103eadae-d9b3-4232-9377-bc5e8798a137 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:38.088262 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103eadae-d9b3-4232-9377-bc5e8798a137 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:38.088712 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103eadae-d9b3-4232-9377-bc5e8798a137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:38.118444 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-103eadae-d9b3-4232-9377-bc5e8798a137 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:34:38.120184 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-103eadae-d9b3-4232-9377-bc5e8798a137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:38.169527 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6de3af-e378-44fa-858b-616ee4503f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:38.170276 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6de3af-e378-44fa-858b-616ee4503f42 admin admin] REQUEST_METHOD: `PUT` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:38.170755 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6de3af-e378-44fa-858b-616ee4503f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:38.171196 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6de3af-e378-44fa-858b-616ee4503f42 admin admin] PATH_INFO: `/v3/projects/336f2ec2761045cd84ed195b2c59341b/users/fa47206f489e4ef6ae0e3368c7bb03ae/roles/27e3e65e24df4b86b0d3d18d3212101d` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:38.200349 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6de3af-e378-44fa-858b-616ee4503f42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=336f2ec2761045cd84ed195b2c59341b, user_id=fa47206f489e4ef6ae0e3368c7bb03ae, role_id=27e3e65e24df4b86b0d3d18d3212101d)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:38.204124 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6de3af-e378-44fa-858b-616ee4503f42 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:38.255588 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1067/2122] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 11:34:38 2022] PUT /identity/v3/projects/336f2ec2761045cd84ed195b2c59341b/users/fa47206f489e4ef6ae0e3368c7bb03ae/roles/27e3e65e24df4b86b0d3d18d3212101d => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:34:38.274111 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50a41a5-afa7-4822-8c56-54a5b3364d77 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:38.279943 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50a41a5-afa7-4822-8c56-54a5b3364d77 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:38.280480 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50a41a5-afa7-4822-8c56-54a5b3364d77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:38.300887 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1056/2123] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:34:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:34:38.302931 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5322bdf6-fa58-4f4a-a6d1-de748a44cb9d None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:38.303455 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5322bdf6-fa58-4f4a-a6d1-de748a44cb9d None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:38.303712 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5322bdf6-fa58-4f4a-a6d1-de748a44cb9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:38.346567 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-5322bdf6-fa58-4f4a-a6d1-de748a44cb9d None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:34:38.346567 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-5322bdf6-fa58-4f4a-a6d1-de748a44cb9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:38.362452 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-e50a41a5-afa7-4822-8c56-54a5b3364d77 None None] MFA Rules not processed for user `fa47206f489e4ef6ae0e3368c7bb03ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:34:38.363815 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-e50a41a5-afa7-4822-8c56-54a5b3364d77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:38.412205 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:38.455647 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1057/2124] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:34:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:34:38.460240 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5322bdf6-fa58-4f4a-a6d1-de748a44cb9d None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:38.470516 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1068/2125] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:34:38 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:34:38.470789 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5322bdf6-fa58-4f4a-a6d1-de748a44cb9d None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:38.476504 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb207b4-a4de-4fcd-b507-f0858cea39bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:38.477208 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb207b4-a4de-4fcd-b507-f0858cea39bb admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:38.477592 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb207b4-a4de-4fcd-b507-f0858cea39bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:38.477966 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb207b4-a4de-4fcd-b507-f0858cea39bb admin admin] PATH_INFO: `/v3/domains` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:38.478733 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb207b4-a4de-4fcd-b507-f0858cea39bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:34:38.479196 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb207b4-a4de-4fcd-b507-f0858cea39bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:38.480979 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb207b4-a4de-4fcd-b507-f0858cea39bb admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:38.487359 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50a41a5-afa7-4822-8c56-54a5b3364d77 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:38.489365 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-e50a41a5-afa7-4822-8c56-54a5b3364d77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:38.507472 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:38.520808 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1058/2126] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 24 11:34:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:34:38.525081 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb207b4-a4de-4fcd-b507-f0858cea39bb admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:38.544009 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb207b4-a4de-4fcd-b507-f0858cea39bb admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:38.552243 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6c8914-819a-4586-9854-9ca5ceb83540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:38.553458 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6c8914-819a-4586-9854-9ca5ceb83540 admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:38.553745 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6c8914-819a-4586-9854-9ca5ceb83540 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:38.555961 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6c8914-819a-4586-9854-9ca5ceb83540 admin admin] PATH_INFO: `/v3/projects` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:38.556689 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6c8914-819a-4586-9854-9ca5ceb83540 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:38.559266 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6c8914-819a-4586-9854-9ca5ceb83540 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:38.565917 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50a41a5-afa7-4822-8c56-54a5b3364d77 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:38.571944 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b47ac83-549b-467c-8dc7-63132b6f4129 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92862b76ba3b4513b5dc5b5c962faac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:38.572732 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b47ac83-549b-467c-8dc7-63132b6f4129 service cinder] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:38.573016 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b47ac83-549b-467c-8dc7-63132b6f4129 service cinder] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:38.573291 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b47ac83-549b-467c-8dc7-63132b6f4129 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:38.585849 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b47ac83-549b-467c-8dc7-63132b6f4129 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:38.587549 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b47ac83-549b-467c-8dc7-63132b6f4129 service cinder] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:38.598404 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1059/2127] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 11:34:38 2022] POST /identity/v3/projects => generated 375 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 11:34:38.599570 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1069/2128] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:34:38 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:34:38.602826 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6c8914-819a-4586-9854-9ca5ceb83540 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:38.709225 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6c8914-819a-4586-9854-9ca5ceb83540 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:38.715480 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7731c888-af4d-41af-8c2e-2c6586496d5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:38.716131 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7731c888-af4d-41af-8c2e-2c6586496d5f admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:38.716411 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7731c888-af4d-41af-8c2e-2c6586496d5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:38.716681 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7731c888-af4d-41af-8c2e-2c6586496d5f admin admin] PATH_INFO: `/v3/users` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:38.717324 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7731c888-af4d-41af-8c2e-2c6586496d5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:38.719703 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7731c888-af4d-41af-8c2e-2c6586496d5f admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:38.755180 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1060/2129] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 11:34:38 2022] POST /identity/v3/users => generated 288 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 11:34:38.759987 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b47ac83-549b-467c-8dc7-63132b6f4129 service cinder] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:38.781307 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b47ac83-549b-467c-8dc7-63132b6f4129 service cinder] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:38.786561 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3363fc6-c875-4599-91c8-2aec3a82d86b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:38.787204 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3363fc6-c875-4599-91c8-2aec3a82d86b admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:38.787490 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3363fc6-c875-4599-91c8-2aec3a82d86b admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:38.787785 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3363fc6-c875-4599-91c8-2aec3a82d86b admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:38.788415 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3363fc6-c875-4599-91c8-2aec3a82d86b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:38.793280 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3363fc6-c875-4599-91c8-2aec3a82d86b admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:38.811731 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1070/2130] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:34:38 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:34:38.813038 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7731c888-af4d-41af-8c2e-2c6586496d5f admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:38.824940 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7731c888-af4d-41af-8c2e-2c6586496d5f admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:38.841395 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0680a4-fc80-4948-8bbb-b62abd8abf8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:38.842039 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0680a4-fc80-4948-8bbb-b62abd8abf8b admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:38.843642 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0680a4-fc80-4948-8bbb-b62abd8abf8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:38.843642 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0680a4-fc80-4948-8bbb-b62abd8abf8b admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:38.843642 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0680a4-fc80-4948-8bbb-b62abd8abf8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:38.847853 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0680a4-fc80-4948-8bbb-b62abd8abf8b admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:38.866757 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1061/2131] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:34:38 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:34:38.870860 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3363fc6-c875-4599-91c8-2aec3a82d86b admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:38.885180 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3363fc6-c875-4599-91c8-2aec3a82d86b admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:38.891842 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4782198e-63ce-4fd5-a83d-21b317910bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:38.892764 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4782198e-63ce-4fd5-a83d-21b317910bee admin admin] REQUEST_METHOD: `PUT` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:38.893185 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4782198e-63ce-4fd5-a83d-21b317910bee admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:38.893569 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4782198e-63ce-4fd5-a83d-21b317910bee admin admin] PATH_INFO: `/v3/projects/3311e3111ed54eb6917dd0c8872b1089/users/d908050afb6e420ba36bfd5f4d59b50a/roles/27e3e65e24df4b86b0d3d18d3212101d` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:38.918113 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4782198e-63ce-4fd5-a83d-21b317910bee admin admin] RBAC: Authorizing `identity:create_grant(project_id=3311e3111ed54eb6917dd0c8872b1089, user_id=d908050afb6e420ba36bfd5f4d59b50a, role_id=27e3e65e24df4b86b0d3d18d3212101d)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:38.921823 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4782198e-63ce-4fd5-a83d-21b317910bee admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:38.944653 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1071/2132] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 11:34:38 2022] PUT /identity/v3/projects/3311e3111ed54eb6917dd0c8872b1089/users/d908050afb6e420ba36bfd5f4d59b50a/roles/27e3e65e24df4b86b0d3d18d3212101d => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:34:38.949855 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb80baad-9bfb-43bf-8386-cc9eea48e792 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:38.950576 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb80baad-9bfb-43bf-8386-cc9eea48e792 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:38.951279 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb80baad-9bfb-43bf-8386-cc9eea48e792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:38.979719 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-cb80baad-9bfb-43bf-8386-cc9eea48e792 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:34:38.982078 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-cb80baad-9bfb-43bf-8386-cc9eea48e792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:39.125609 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1062/2133] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:34:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 11:34:39.136702 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4782198e-63ce-4fd5-a83d-21b317910bee admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:39.138519 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-4782198e-63ce-4fd5-a83d-21b317910bee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:39.202190 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4782198e-63ce-4fd5-a83d-21b317910bee admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:39.206839 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4fdaab-3f57-4ee2-ad8b-9564225b864c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2d061d25d83443c9232218c90792d51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:39.207927 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4fdaab-3f57-4ee2-ad8b-9564225b864c service neutron] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:39.208280 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4fdaab-3f57-4ee2-ad8b-9564225b864c service neutron] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:39.208628 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4fdaab-3f57-4ee2-ad8b-9564225b864c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:39.224319 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4fdaab-3f57-4ee2-ad8b-9564225b864c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:39.225561 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4fdaab-3f57-4ee2-ad8b-9564225b864c service neutron] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:39.237273 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1072/2134] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:34:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:34:40.199286 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde22db7-33ce-461f-96f0-1798101cda7d None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:40.199825 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde22db7-33ce-461f-96f0-1798101cda7d None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:40.199825 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde22db7-33ce-461f-96f0-1798101cda7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:40.223337 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-dde22db7-33ce-461f-96f0-1798101cda7d None None] MFA Rules not processed for user `fa47206f489e4ef6ae0e3368c7bb03ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:34:40.224829 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-dde22db7-33ce-461f-96f0-1798101cda7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:40.274406 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:40.349934 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1063/2135] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:34:40 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:34:41.904628 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15499692-a75a-4ff2-825e-e90008549d5d None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:41.905135 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15499692-a75a-4ff2-825e-e90008549d5d None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:41.907171 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15499692-a75a-4ff2-825e-e90008549d5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:41.942716 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-15499692-a75a-4ff2-825e-e90008549d5d None None] MFA Rules not processed for user `07e50eea391b40d6b5b90ae436558450`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:34:41.944226 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-15499692-a75a-4ff2-825e-e90008549d5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:42.055004 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1073/2136] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:34:41 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:34:42.060011 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde22db7-33ce-461f-96f0-1798101cda7d None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:42.061897 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-dde22db7-33ce-461f-96f0-1798101cda7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:42.087899 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde22db7-33ce-461f-96f0-1798101cda7d None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:42.097433 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443f4f6a-f58f-475d-a972-9e0b4d911d02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:42.098073 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443f4f6a-f58f-475d-a972-9e0b4d911d02 admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:42.109854 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443f4f6a-f58f-475d-a972-9e0b4d911d02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:42.110213 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443f4f6a-f58f-475d-a972-9e0b4d911d02 admin admin] PATH_INFO: `/v3/projects` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:42.120780 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443f4f6a-f58f-475d-a972-9e0b4d911d02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:42.122794 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443f4f6a-f58f-475d-a972-9e0b4d911d02 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:42.184172 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1064/2137] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 11:34:42 2022] POST /identity/v3/projects => generated 371 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:34:42.188431 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15499692-a75a-4ff2-825e-e90008549d5d None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:42.200685 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15499692-a75a-4ff2-825e-e90008549d5d None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:42.214478 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:42.410660 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2937a71-be98-47a9-b588-d15de130d4e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:42.411317 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2937a71-be98-47a9-b588-d15de130d4e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:42.411585 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2937a71-be98-47a9-b588-d15de130d4e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:42.411853 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2937a71-be98-47a9-b588-d15de130d4e6 admin admin] PATH_INFO: `/v3/users` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:42.412510 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2937a71-be98-47a9-b588-d15de130d4e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:42.414508 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2937a71-be98-47a9-b588-d15de130d4e6 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:42.489839 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1074/2138] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 11:34:42 2022] POST /identity/v3/users => generated 292 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 11:34:42.493216 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443f4f6a-f58f-475d-a972-9e0b4d911d02 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:42.510671 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443f4f6a-f58f-475d-a972-9e0b4d911d02 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:42.531076 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0860fac8-1d0e-4aa4-81f5-1d09f88c1a67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:42.532137 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0860fac8-1d0e-4aa4-81f5-1d09f88c1a67 admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:42.532630 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0860fac8-1d0e-4aa4-81f5-1d09f88c1a67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:42.533169 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0860fac8-1d0e-4aa4-81f5-1d09f88c1a67 admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:42.534252 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0860fac8-1d0e-4aa4-81f5-1d09f88c1a67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:42.541751 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0860fac8-1d0e-4aa4-81f5-1d09f88c1a67 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:42.568611 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1065/2139] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:34:42 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:34:42.578243 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2937a71-be98-47a9-b588-d15de130d4e6 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:42.601418 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2937a71-be98-47a9-b588-d15de130d4e6 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:42.620786 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a144f5-0c0c-4571-9417-3c2d4f8ae639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:42.623252 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a144f5-0c0c-4571-9417-3c2d4f8ae639 admin admin] REQUEST_METHOD: `PUT` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:42.625354 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a144f5-0c0c-4571-9417-3c2d4f8ae639 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:42.629999 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a144f5-0c0c-4571-9417-3c2d4f8ae639 admin admin] PATH_INFO: `/v3/projects/9d5d17a51bef43eaa2201df54608f7bd/users/f43d2b82d63b4a3da1cb907f9ecd9747/roles/30bb1e97257f4ca5b90c88545777317b` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:42.724326 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a144f5-0c0c-4571-9417-3c2d4f8ae639 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d5d17a51bef43eaa2201df54608f7bd, user_id=f43d2b82d63b4a3da1cb907f9ecd9747, role_id=30bb1e97257f4ca5b90c88545777317b)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:42.728536 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a144f5-0c0c-4571-9417-3c2d4f8ae639 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:42.769358 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1075/2140] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 11:34:42 2022] PUT /identity/v3/projects/9d5d17a51bef43eaa2201df54608f7bd/users/f43d2b82d63b4a3da1cb907f9ecd9747/roles/30bb1e97257f4ca5b90c88545777317b => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:34:42.773248 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0860fac8-1d0e-4aa4-81f5-1d09f88c1a67 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:42.811630 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0860fac8-1d0e-4aa4-81f5-1d09f88c1a67 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:43.105980 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afed580b-f5c3-4aa8-8356-8262456ced51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:43.108163 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afed580b-f5c3-4aa8-8356-8262456ced51 admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:43.108762 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afed580b-f5c3-4aa8-8356-8262456ced51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:43.109352 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afed580b-f5c3-4aa8-8356-8262456ced51 admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:43.110635 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afed580b-f5c3-4aa8-8356-8262456ced51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:43.113449 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afed580b-f5c3-4aa8-8356-8262456ced51 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:43.150824 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1066/2141] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:34:42 2022] GET /identity/v3/roles => generated 1420 bytes in 378 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:34:43.154974 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a144f5-0c0c-4571-9417-3c2d4f8ae639 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:43.168471 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a144f5-0c0c-4571-9417-3c2d4f8ae639 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:43.173788 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c913a22-186f-491e-a71c-541140516c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:43.174763 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c913a22-186f-491e-a71c-541140516c10 admin admin] REQUEST_METHOD: `PUT` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:43.175112 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c913a22-186f-491e-a71c-541140516c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:43.175476 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c913a22-186f-491e-a71c-541140516c10 admin admin] PATH_INFO: `/v3/projects/9d5d17a51bef43eaa2201df54608f7bd/users/f43d2b82d63b4a3da1cb907f9ecd9747/roles/30bb1e97257f4ca5b90c88545777317b` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:43.177767 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c913a22-186f-491e-a71c-541140516c10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d5d17a51bef43eaa2201df54608f7bd, user_id=f43d2b82d63b4a3da1cb907f9ecd9747, role_id=30bb1e97257f4ca5b90c88545777317b)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:43.180810 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c913a22-186f-491e-a71c-541140516c10 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:43.226206 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1076/2142] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 11:34:43 2022] PUT /identity/v3/projects/9d5d17a51bef43eaa2201df54608f7bd/users/f43d2b82d63b4a3da1cb907f9ecd9747/roles/30bb1e97257f4ca5b90c88545777317b => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:34:46.818652 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72c37a7-2b04-492a-aba6-61e6f47223dd None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:46.819664 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72c37a7-2b04-492a-aba6-61e6f47223dd None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:46.820134 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72c37a7-2b04-492a-aba6-61e6f47223dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:46.860211 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-c72c37a7-2b04-492a-aba6-61e6f47223dd None None] MFA Rules not processed for user `d908050afb6e420ba36bfd5f4d59b50a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:34:46.861904 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-c72c37a7-2b04-492a-aba6-61e6f47223dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:46.956472 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1067/2143] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:34:46 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:34:46.973511 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c913a22-186f-491e-a71c-541140516c10 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:46.976151 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-3c913a22-186f-491e-a71c-541140516c10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:47.090603 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c913a22-186f-491e-a71c-541140516c10 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:47.102123 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cedd32-856e-45f5-bc96-ba65adc40647 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '282ec32864d046b2bea170f6a3845cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:47.103062 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cedd32-856e-45f5-bc96-ba65adc40647 service nova] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:47.103542 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cedd32-856e-45f5-bc96-ba65adc40647 service nova] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:47.104034 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cedd32-856e-45f5-bc96-ba65adc40647 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:47.134155 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cedd32-856e-45f5-bc96-ba65adc40647 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:47.136629 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cedd32-856e-45f5-bc96-ba65adc40647 service nova] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:47.161021 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1077/2144] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:34:46 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:34:50.843154 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72c37a7-2b04-492a-aba6-61e6f47223dd None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:50.844670 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-c72c37a7-2b04-492a-aba6-61e6f47223dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:50.916333 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:51.014966 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72c37a7-2b04-492a-aba6-61e6f47223dd None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:51.038558 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a176da4c-f39d-4ce2-b32a-a0d11a1a19cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:51.039551 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a176da4c-f39d-4ce2-b32a-a0d11a1a19cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:51.039974 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a176da4c-f39d-4ce2-b32a-a0d11a1a19cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:51.040395 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a176da4c-f39d-4ce2-b32a-a0d11a1a19cb admin admin] PATH_INFO: `/v3/users/aaf2b888c0604550a2baac76c5ca93d7` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:51.042006 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a176da4c-f39d-4ce2-b32a-a0d11a1a19cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=aaf2b888c0604550a2baac76c5ca93d7)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:51.044501 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a176da4c-f39d-4ce2-b32a-a0d11a1a19cb admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:51.162344 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-a176da4c-f39d-4ce2-b32a-a0d11a1a19cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aaf2b888c0604550a2baac76c5ca93d7'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:51.163073 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-a176da4c-f39d-4ce2-b32a-a0d11a1a19cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aaf2b888c0604550a2baac76c5ca93d7'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:51.194819 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-a176da4c-f39d-4ce2-b32a-a0d11a1a19cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aaf2b888c0604550a2baac76c5ca93d7'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:51.220640 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-a176da4c-f39d-4ce2-b32a-a0d11a1a19cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aaf2b888c0604550a2baac76c5ca93d7'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:51.222745 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-a176da4c-f39d-4ce2-b32a-a0d11a1a19cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aaf2b888c0604550a2baac76c5ca93d7'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:51.289070 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1068/2145] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 11:34:50 2022] DELETE /identity/v3/users/aaf2b888c0604550a2baac76c5ca93d7 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:34:51.605136 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cedd32-856e-45f5-bc96-ba65adc40647 service nova] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:51.629334 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cedd32-856e-45f5-bc96-ba65adc40647 service nova] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:51.685318 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998b5d8f-9c04-4fab-8113-d50abd5511b4 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:51.685930 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998b5d8f-9c04-4fab-8113-d50abd5511b4 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:51.686436 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998b5d8f-9c04-4fab-8113-d50abd5511b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:51.708992 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-998b5d8f-9c04-4fab-8113-d50abd5511b4 None None] MFA Rules not processed for user `d908050afb6e420ba36bfd5f4d59b50a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:34:51.710687 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-998b5d8f-9c04-4fab-8113-d50abd5511b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:51.759843 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:51.778589 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dff4f9-0247-4a65-a134-232bffd19aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:51.779344 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dff4f9-0247-4a65-a134-232bffd19aab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:51.779681 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dff4f9-0247-4a65-a134-232bffd19aab admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:51.780454 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dff4f9-0247-4a65-a134-232bffd19aab admin admin] PATH_INFO: `/v3/projects/2e0359e63f6743f0864b1b54489579f5` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:51.782981 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dff4f9-0247-4a65-a134-232bffd19aab admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e0359e63f6743f0864b1b54489579f5)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:51.787054 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1069/2146] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:34:51 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:34:51.787741 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dff4f9-0247-4a65-a134-232bffd19aab admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:51.856769 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-03dff4f9-0247-4a65-a134-232bffd19aab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e0359e63f6743f0864b1b54489579f5', 'request_id': 'req-03dff4f9-0247-4a65-a134-232bffd19aab'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:51.865983 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-03dff4f9-0247-4a65-a134-232bffd19aab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e0359e63f6743f0864b1b54489579f5', 'request_id': 'req-03dff4f9-0247-4a65-a134-232bffd19aab'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:51.875877 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-03dff4f9-0247-4a65-a134-232bffd19aab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e0359e63f6743f0864b1b54489579f5', 'request_id': 'req-03dff4f9-0247-4a65-a134-232bffd19aab'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:51.908744 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-03dff4f9-0247-4a65-a134-232bffd19aab admin admin] The token cache is being invalidate because project 2e0359e63f6743f0864b1b54489579f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81501) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:34:51.909022 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-03dff4f9-0247-4a65-a134-232bffd19aab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:51.909692 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-03dff4f9-0247-4a65-a134-232bffd19aab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:51.913355 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1078/2147] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 11:34:51 2022] DELETE /identity/v3/projects/2e0359e63f6743f0864b1b54489579f5 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:34:51.917199 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998b5d8f-9c04-4fab-8113-d50abd5511b4 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:51.918698 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-998b5d8f-9c04-4fab-8113-d50abd5511b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:51.940848 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998b5d8f-9c04-4fab-8113-d50abd5511b4 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:52.037272 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:52.054751 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18d878f-cc36-4937-9749-1886c4b882d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:52.055941 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18d878f-cc36-4937-9749-1886c4b882d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:52.056326 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18d878f-cc36-4937-9749-1886c4b882d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:52.056744 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18d878f-cc36-4937-9749-1886c4b882d4 admin admin] PATH_INFO: `/v3/users/1422693644304d41ab67eddd6641baaf` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:52.058064 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18d878f-cc36-4937-9749-1886c4b882d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1422693644304d41ab67eddd6641baaf)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:52.060748 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18d878f-cc36-4937-9749-1886c4b882d4 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:52.162012 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-d18d878f-cc36-4937-9749-1886c4b882d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1422693644304d41ab67eddd6641baaf'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:52.163226 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-d18d878f-cc36-4937-9749-1886c4b882d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1422693644304d41ab67eddd6641baaf'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:52.177381 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-d18d878f-cc36-4937-9749-1886c4b882d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1422693644304d41ab67eddd6641baaf'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:52.188142 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-d18d878f-cc36-4937-9749-1886c4b882d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1422693644304d41ab67eddd6641baaf'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:52.190265 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-d18d878f-cc36-4937-9749-1886c4b882d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1422693644304d41ab67eddd6641baaf'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:52.215907 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1070/2148] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 11:34:51 2022] DELETE /identity/v3/users/1422693644304d41ab67eddd6641baaf => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:34:52.966813 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dff4f9-0247-4a65-a134-232bffd19aab admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:52.968535 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-03dff4f9-0247-4a65-a134-232bffd19aab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:53.004719 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dff4f9-0247-4a65-a134-232bffd19aab admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:53.130201 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912bd527-58c7-4756-98de-ced78ae63d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:53.131463 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912bd527-58c7-4756-98de-ced78ae63d5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:53.131850 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912bd527-58c7-4756-98de-ced78ae63d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:53.132220 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912bd527-58c7-4756-98de-ced78ae63d5b admin admin] PATH_INFO: `/v3/projects/565e681d9c6e4ad99db252183fdcbbef` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:53.134127 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912bd527-58c7-4756-98de-ced78ae63d5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=565e681d9c6e4ad99db252183fdcbbef)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:53.136312 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912bd527-58c7-4756-98de-ced78ae63d5b admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:53.238771 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-912bd527-58c7-4756-98de-ced78ae63d5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '565e681d9c6e4ad99db252183fdcbbef', 'request_id': 'req-912bd527-58c7-4756-98de-ced78ae63d5b'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:53.272953 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-912bd527-58c7-4756-98de-ced78ae63d5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '565e681d9c6e4ad99db252183fdcbbef', 'request_id': 'req-912bd527-58c7-4756-98de-ced78ae63d5b'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:53.297664 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-912bd527-58c7-4756-98de-ced78ae63d5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '565e681d9c6e4ad99db252183fdcbbef', 'request_id': 'req-912bd527-58c7-4756-98de-ced78ae63d5b'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:53.325421 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-912bd527-58c7-4756-98de-ced78ae63d5b admin admin] The token cache is being invalidate because project 565e681d9c6e4ad99db252183fdcbbef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81501) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:34:53.325714 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-912bd527-58c7-4756-98de-ced78ae63d5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:53.326521 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-912bd527-58c7-4756-98de-ced78ae63d5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:53.330758 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1079/2149] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 11:34:52 2022] DELETE /identity/v3/projects/565e681d9c6e4ad99db252183fdcbbef => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:34:53.333989 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180bf92f-8a0b-402f-8e1d-93426dde51e6 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:53.334483 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180bf92f-8a0b-402f-8e1d-93426dde51e6 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:53.334729 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180bf92f-8a0b-402f-8e1d-93426dde51e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:53.417327 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-180bf92f-8a0b-402f-8e1d-93426dde51e6 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:34:53.419532 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-180bf92f-8a0b-402f-8e1d-93426dde51e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:53.478067 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5f84bb-3db2-40b4-80a0-2e9e6fcf7047 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:53.478480 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5f84bb-3db2-40b4-80a0-2e9e6fcf7047 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:53.478852 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5f84bb-3db2-40b4-80a0-2e9e6fcf7047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:53.522174 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:53.547313 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-cb5f84bb-3db2-40b4-80a0-2e9e6fcf7047 None None] MFA Rules not processed for user `f43d2b82d63b4a3da1cb907f9ecd9747`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:34:53.551263 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-cb5f84bb-3db2-40b4-80a0-2e9e6fcf7047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:53.572288 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1071/2150] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:34:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:34:53.582651 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbbbd07-955c-436b-8c0e-de16b0eed978 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:53.584175 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbbbd07-955c-436b-8c0e-de16b0eed978 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:53.585310 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbbbd07-955c-436b-8c0e-de16b0eed978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:53.655434 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-3fbbbd07-955c-436b-8c0e-de16b0eed978 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:34:53.657408 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-3fbbbd07-955c-436b-8c0e-de16b0eed978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:53.676875 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1072/2151] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:34:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:34:53.683667 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbbbd07-955c-436b-8c0e-de16b0eed978 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:53.704078 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbbbd07-955c-436b-8c0e-de16b0eed978 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:53.710069 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda5be14-783c-431d-959c-21c5eab72caa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:53.710278 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda5be14-783c-431d-959c-21c5eab72caa admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:53.710609 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda5be14-783c-431d-959c-21c5eab72caa admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:53.710874 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda5be14-783c-431d-959c-21c5eab72caa admin admin] PATH_INFO: `/v3/domains` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:53.711535 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda5be14-783c-431d-959c-21c5eab72caa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:34:53.711832 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda5be14-783c-431d-959c-21c5eab72caa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:53.716907 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda5be14-783c-431d-959c-21c5eab72caa admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:53.750021 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1080/2152] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:34:53 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:34:53.758554 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5f84bb-3db2-40b4-80a0-2e9e6fcf7047 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:53.760210 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-cb5f84bb-3db2-40b4-80a0-2e9e6fcf7047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:53.788383 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1073/2153] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 24 11:34:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:34:53.800823 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda5be14-783c-431d-959c-21c5eab72caa admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:53.848516 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda5be14-783c-431d-959c-21c5eab72caa admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:53.875442 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69542ff-d5c4-4ece-8100-8364b7f9c2e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:53.877354 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69542ff-d5c4-4ece-8100-8364b7f9c2e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:53.879422 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69542ff-d5c4-4ece-8100-8364b7f9c2e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:53.879801 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69542ff-d5c4-4ece-8100-8364b7f9c2e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:53.880380 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69542ff-d5c4-4ece-8100-8364b7f9c2e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:53.886695 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69542ff-d5c4-4ece-8100-8364b7f9c2e3 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:53.947507 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5f84bb-3db2-40b4-80a0-2e9e6fcf7047 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:53.956846 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73029dc0-ebe8-4e7d-93da-837cd09d3bdc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '282ec32864d046b2bea170f6a3845cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:53.957591 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73029dc0-ebe8-4e7d-93da-837cd09d3bdc service nova] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:53.958456 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73029dc0-ebe8-4e7d-93da-837cd09d3bdc service nova] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:53.958456 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73029dc0-ebe8-4e7d-93da-837cd09d3bdc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:53.962742 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-73029dc0-ebe8-4e7d-93da-837cd09d3bdc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:53.963656 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1074/2154] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 11:34:53 2022] POST /identity/v3/projects => generated 385 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:34:53.967944 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69542ff-d5c4-4ece-8100-8364b7f9c2e3 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:54.058208 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:54.085364 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73029dc0-ebe8-4e7d-93da-837cd09d3bdc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:54.087782 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73029dc0-ebe8-4e7d-93da-837cd09d3bdc service nova] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:54.113461 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1081/2155] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:34:53 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 11:34:54.135289 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69542ff-d5c4-4ece-8100-8364b7f9c2e3 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:54.150393 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e905073-e052-450f-82e1-26775081914d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:54.151107 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e905073-e052-450f-82e1-26775081914d admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:54.151757 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e905073-e052-450f-82e1-26775081914d admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:54.151918 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e905073-e052-450f-82e1-26775081914d admin admin] PATH_INFO: `/v3/users` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:54.152663 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e905073-e052-450f-82e1-26775081914d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:54.154743 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e905073-e052-450f-82e1-26775081914d admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:54.199787 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1075/2156] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 11:34:53 2022] POST /identity/v3/users => generated 293 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 11:34:54.201490 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73029dc0-ebe8-4e7d-93da-837cd09d3bdc service nova] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:54.216927 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73029dc0-ebe8-4e7d-93da-837cd09d3bdc service nova] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:54.233260 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd11e058-cce1-4868-b283-c69ff409af76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:54.233963 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd11e058-cce1-4868-b283-c69ff409af76 admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:54.234236 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd11e058-cce1-4868-b283-c69ff409af76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:54.234537 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd11e058-cce1-4868-b283-c69ff409af76 admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:54.235214 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd11e058-cce1-4868-b283-c69ff409af76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:54.236873 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd11e058-cce1-4868-b283-c69ff409af76 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:54.269550 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1082/2157] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:34:54 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:34:54.273668 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e905073-e052-450f-82e1-26775081914d admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:54.286087 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e905073-e052-450f-82e1-26775081914d admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:54.292338 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff9151c-66e5-460a-9790-d191d33ca622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:54.293358 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff9151c-66e5-460a-9790-d191d33ca622 admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:54.293728 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff9151c-66e5-460a-9790-d191d33ca622 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:54.293969 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff9151c-66e5-460a-9790-d191d33ca622 admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:54.294782 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff9151c-66e5-460a-9790-d191d33ca622 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:54.296625 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff9151c-66e5-460a-9790-d191d33ca622 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:54.320867 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1076/2158] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:34:54 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:34:54.325739 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd11e058-cce1-4868-b283-c69ff409af76 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:54.348482 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd11e058-cce1-4868-b283-c69ff409af76 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:54.356614 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba42b1a-a924-4ef5-8855-519ae5ae8bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:54.357471 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba42b1a-a924-4ef5-8855-519ae5ae8bf1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:54.357748 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba42b1a-a924-4ef5-8855-519ae5ae8bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:54.358103 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba42b1a-a924-4ef5-8855-519ae5ae8bf1 admin admin] PATH_INFO: `/v3/projects/ef14801486ce40a496aa593d4abb7ab9/users/3952dc69807f43d3b3a17626111041a9/roles/27e3e65e24df4b86b0d3d18d3212101d` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:54.380413 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba42b1a-a924-4ef5-8855-519ae5ae8bf1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef14801486ce40a496aa593d4abb7ab9, user_id=3952dc69807f43d3b3a17626111041a9, role_id=27e3e65e24df4b86b0d3d18d3212101d)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:54.383717 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba42b1a-a924-4ef5-8855-519ae5ae8bf1 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:54.394029 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:54.402398 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1083/2159] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 11:34:54 2022] PUT /identity/v3/projects/ef14801486ce40a496aa593d4abb7ab9/users/3952dc69807f43d3b3a17626111041a9/roles/27e3e65e24df4b86b0d3d18d3212101d => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:34:54.413226 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89824c43-148e-4406-8881-94c3e02b424f None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:54.413785 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89824c43-148e-4406-8881-94c3e02b424f None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:54.413785 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89824c43-148e-4406-8881-94c3e02b424f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:54.458946 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-89824c43-148e-4406-8881-94c3e02b424f None None] MFA Rules not processed for user `3952dc69807f43d3b3a17626111041a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:34:54.460982 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-89824c43-148e-4406-8881-94c3e02b424f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:54.581588 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba42b1a-a924-4ef5-8855-519ae5ae8bf1 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:54.592307 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1077/2160] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:34:54 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:34:54.708022 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba42b1a-a924-4ef5-8855-519ae5ae8bf1 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:54.724416 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2123840-c58b-4fc7-bd63-b4cb11da26a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:54.725204 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2123840-c58b-4fc7-bd63-b4cb11da26a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:54.725476 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2123840-c58b-4fc7-bd63-b4cb11da26a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:54.725753 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2123840-c58b-4fc7-bd63-b4cb11da26a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:54.726417 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2123840-c58b-4fc7-bd63-b4cb11da26a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:54.728402 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2123840-c58b-4fc7-bd63-b4cb11da26a2 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:54.792779 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1084/2161] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 11:34:54 2022] POST /identity/v3/projects => generated 383 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:34:54.801080 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89824c43-148e-4406-8881-94c3e02b424f None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:54.815578 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89824c43-148e-4406-8881-94c3e02b424f None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:54.966529 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c40347b-7da8-4102-9a28-eed924e7ce1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:54.967167 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c40347b-7da8-4102-9a28-eed924e7ce1a admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:54.967491 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c40347b-7da8-4102-9a28-eed924e7ce1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:54.967764 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c40347b-7da8-4102-9a28-eed924e7ce1a admin admin] PATH_INFO: `/v3/users` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:54.968402 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c40347b-7da8-4102-9a28-eed924e7ce1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:54.974936 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c40347b-7da8-4102-9a28-eed924e7ce1a admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:55.018773 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1078/2162] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 11:34:54 2022] POST /identity/v3/users => generated 298 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:34:55.023201 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2123840-c58b-4fc7-bd63-b4cb11da26a2 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:55.039624 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2123840-c58b-4fc7-bd63-b4cb11da26a2 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:55.051714 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98a4e31-ccef-4e73-aa50-7008484c5c3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:55.053798 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98a4e31-ccef-4e73-aa50-7008484c5c3f admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:55.055307 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98a4e31-ccef-4e73-aa50-7008484c5c3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:55.056514 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98a4e31-ccef-4e73-aa50-7008484c5c3f admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:55.057286 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98a4e31-ccef-4e73-aa50-7008484c5c3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:55.072472 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98a4e31-ccef-4e73-aa50-7008484c5c3f admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:55.099137 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1085/2163] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:34:55 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:34:55.103404 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c40347b-7da8-4102-9a28-eed924e7ce1a admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:55.119988 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c40347b-7da8-4102-9a28-eed924e7ce1a admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:55.137581 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6088d19-3e87-4396-9504-1db8ee7ac936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:55.137778 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6088d19-3e87-4396-9504-1db8ee7ac936 admin admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:55.139030 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6088d19-3e87-4396-9504-1db8ee7ac936 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:55.139916 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6088d19-3e87-4396-9504-1db8ee7ac936 admin admin] PATH_INFO: `/v3/projects/3ad65e96de77496d94ef3bad98517052/users/d5bfeb0cd6484fda93382d7e020e0ff7/roles/30bb1e97257f4ca5b90c88545777317b` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:55.216824 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6088d19-3e87-4396-9504-1db8ee7ac936 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ad65e96de77496d94ef3bad98517052, user_id=d5bfeb0cd6484fda93382d7e020e0ff7, role_id=30bb1e97257f4ca5b90c88545777317b)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:55.226756 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6088d19-3e87-4396-9504-1db8ee7ac936 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:55.258695 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1079/2164] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 11:34:55 2022] PUT /identity/v3/projects/3ad65e96de77496d94ef3bad98517052/users/d5bfeb0cd6484fda93382d7e020e0ff7/roles/30bb1e97257f4ca5b90c88545777317b => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:34:55.263047 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98a4e31-ccef-4e73-aa50-7008484c5c3f admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:55.275969 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98a4e31-ccef-4e73-aa50-7008484c5c3f admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:55.376457 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c600abbf-132b-420f-a62d-8c49d6b1aed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:55.377211 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c600abbf-132b-420f-a62d-8c49d6b1aed8 admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:55.377514 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c600abbf-132b-420f-a62d-8c49d6b1aed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:55.377784 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c600abbf-132b-420f-a62d-8c49d6b1aed8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:55.379081 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c600abbf-132b-420f-a62d-8c49d6b1aed8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:55.381254 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c600abbf-132b-420f-a62d-8c49d6b1aed8 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:55.398407 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1086/2165] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:34:55 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:34:55.400473 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6088d19-3e87-4396-9504-1db8ee7ac936 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:55.409576 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:55.414132 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6088d19-3e87-4396-9504-1db8ee7ac936 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:55.420745 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b55f47-f7fd-459f-961b-9a44d822895b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:55.421440 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b55f47-f7fd-459f-961b-9a44d822895b admin admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:55.421717 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b55f47-f7fd-459f-961b-9a44d822895b admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:55.422045 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b55f47-f7fd-459f-961b-9a44d822895b admin admin] PATH_INFO: `/v3/projects/3ad65e96de77496d94ef3bad98517052/users/d5bfeb0cd6484fda93382d7e020e0ff7/roles/30bb1e97257f4ca5b90c88545777317b` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:55.427158 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b55f47-f7fd-459f-961b-9a44d822895b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ad65e96de77496d94ef3bad98517052, user_id=d5bfeb0cd6484fda93382d7e020e0ff7, role_id=30bb1e97257f4ca5b90c88545777317b)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:55.432685 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b55f47-f7fd-459f-961b-9a44d822895b admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:55.446139 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1080/2166] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 11:34:55 2022] PUT /identity/v3/projects/3ad65e96de77496d94ef3bad98517052/users/d5bfeb0cd6484fda93382d7e020e0ff7/roles/30bb1e97257f4ca5b90c88545777317b => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:34:55.458321 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f4c71f-a5c8-4591-a8c3-83420e0a0f9f None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:55.459143 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f4c71f-a5c8-4591-a8c3-83420e0a0f9f None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:55.459424 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f4c71f-a5c8-4591-a8c3-83420e0a0f9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:55.522962 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-d3f4c71f-a5c8-4591-a8c3-83420e0a0f9f None None] MFA Rules not processed for user `d5bfeb0cd6484fda93382d7e020e0ff7`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:34:55.526385 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-d3f4c71f-a5c8-4591-a8c3-83420e0a0f9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:55.677192 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:55.699453 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1087/2167] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:34:55 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:34:55.716541 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b55f47-f7fd-459f-961b-9a44d822895b admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:55.720998 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-b8b55f47-f7fd-459f-961b-9a44d822895b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:55.827634 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b55f47-f7fd-459f-961b-9a44d822895b admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:55.831797 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737cf937-10b3-4a75-8474-78e80af9cc3e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92862b76ba3b4513b5dc5b5c962faac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:55.833352 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737cf937-10b3-4a75-8474-78e80af9cc3e service cinder] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:55.833886 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737cf937-10b3-4a75-8474-78e80af9cc3e service cinder] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:55.834453 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737cf937-10b3-4a75-8474-78e80af9cc3e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:55.908916 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737cf937-10b3-4a75-8474-78e80af9cc3e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:55.910832 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737cf937-10b3-4a75-8474-78e80af9cc3e service cinder] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:55.925628 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1081/2168] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:34:55 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:34:56.035171 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1850c33-3a42-4480-93b4-3621193446ad None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:56.035454 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1850c33-3a42-4480-93b4-3621193446ad None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:56.036616 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1850c33-3a42-4480-93b4-3621193446ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:56.077211 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-d1850c33-3a42-4480-93b4-3621193446ad None None] MFA Rules not processed for user `07e50eea391b40d6b5b90ae436558450`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:34:56.078653 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-d1850c33-3a42-4480-93b4-3621193446ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:56.195285 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1088/2169] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:34:56 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:34:56.715276 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737cf937-10b3-4a75-8474-78e80af9cc3e service cinder] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:56.716846 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-737cf937-10b3-4a75-8474-78e80af9cc3e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:56.876823 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737cf937-10b3-4a75-8474-78e80af9cc3e service cinder] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:56.882860 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e448b6-597b-4918-b7e6-a29781bd6f10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:56.883578 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e448b6-597b-4918-b7e6-a29781bd6f10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:56.883907 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e448b6-597b-4918-b7e6-a29781bd6f10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:56.884367 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e448b6-597b-4918-b7e6-a29781bd6f10 admin admin] PATH_INFO: `/v3/users/5ec634056e1449d5a8a09bb9f2558b1b` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:56.885837 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e448b6-597b-4918-b7e6-a29781bd6f10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ec634056e1449d5a8a09bb9f2558b1b)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:56.888577 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e448b6-597b-4918-b7e6-a29781bd6f10 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:56.993427 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-d0e448b6-597b-4918-b7e6-a29781bd6f10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ec634056e1449d5a8a09bb9f2558b1b'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:56.994617 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-d0e448b6-597b-4918-b7e6-a29781bd6f10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ec634056e1449d5a8a09bb9f2558b1b'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:56.997761 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:57.009079 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-d0e448b6-597b-4918-b7e6-a29781bd6f10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ec634056e1449d5a8a09bb9f2558b1b'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:57.018912 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-d0e448b6-597b-4918-b7e6-a29781bd6f10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ec634056e1449d5a8a09bb9f2558b1b'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:57.019665 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-d0e448b6-597b-4918-b7e6-a29781bd6f10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ec634056e1449d5a8a09bb9f2558b1b'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:57.057187 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1082/2170] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 11:34:56 2022] DELETE /identity/v3/users/5ec634056e1449d5a8a09bb9f2558b1b => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:34:57.059084 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6a6621-6ad7-4e0d-83d9-bfeb0f6a7ee4 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:57.059403 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6a6621-6ad7-4e0d-83d9-bfeb0f6a7ee4 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:57.059680 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6a6621-6ad7-4e0d-83d9-bfeb0f6a7ee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:57.083575 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-7e6a6621-6ad7-4e0d-83d9-bfeb0f6a7ee4 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:34:57.088328 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-7e6a6621-6ad7-4e0d-83d9-bfeb0f6a7ee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:57.209143 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1089/2171] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:34:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:34:57.220979 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e448b6-597b-4918-b7e6-a29781bd6f10 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:57.222634 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-d0e448b6-597b-4918-b7e6-a29781bd6f10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:57.348910 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e448b6-597b-4918-b7e6-a29781bd6f10 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:57.357413 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15be55d1-e55a-4c93-9fec-8a3daf4a03a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2d061d25d83443c9232218c90792d51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:57.360053 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15be55d1-e55a-4c93-9fec-8a3daf4a03a7 service neutron] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:57.360330 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15be55d1-e55a-4c93-9fec-8a3daf4a03a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:57.360656 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15be55d1-e55a-4c93-9fec-8a3daf4a03a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:57.372398 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15be55d1-e55a-4c93-9fec-8a3daf4a03a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:57.374495 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15be55d1-e55a-4c93-9fec-8a3daf4a03a7 service neutron] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:57.391349 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1083/2172] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:34:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 11:34:57.852868 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6a6621-6ad7-4e0d-83d9-bfeb0f6a7ee4 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:57.854605 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-7e6a6621-6ad7-4e0d-83d9-bfeb0f6a7ee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:57.878979 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6a6621-6ad7-4e0d-83d9-bfeb0f6a7ee4 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:57.888714 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8143ec94-19aa-4c44-be44-2b15965d993b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:57.889793 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8143ec94-19aa-4c44-be44-2b15965d993b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:57.890246 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8143ec94-19aa-4c44-be44-2b15965d993b admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:57.890718 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8143ec94-19aa-4c44-be44-2b15965d993b admin admin] PATH_INFO: `/v3/projects/cf68a46e27ed4039963d662cec2de37e` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:57.892700 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8143ec94-19aa-4c44-be44-2b15965d993b admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf68a46e27ed4039963d662cec2de37e)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:57.896219 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8143ec94-19aa-4c44-be44-2b15965d993b admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:58.041976 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-8143ec94-19aa-4c44-be44-2b15965d993b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf68a46e27ed4039963d662cec2de37e', 'request_id': 'req-8143ec94-19aa-4c44-be44-2b15965d993b'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:58.071317 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-8143ec94-19aa-4c44-be44-2b15965d993b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf68a46e27ed4039963d662cec2de37e', 'request_id': 'req-8143ec94-19aa-4c44-be44-2b15965d993b'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:58.071317 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-8143ec94-19aa-4c44-be44-2b15965d993b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf68a46e27ed4039963d662cec2de37e', 'request_id': 'req-8143ec94-19aa-4c44-be44-2b15965d993b'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:58.116434 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-8143ec94-19aa-4c44-be44-2b15965d993b admin admin] The token cache is being invalidate because project cf68a46e27ed4039963d662cec2de37e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81501) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:34:58.116434 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-8143ec94-19aa-4c44-be44-2b15965d993b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:58.116925 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-8143ec94-19aa-4c44-be44-2b15965d993b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:34:58.139537 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1090/2173] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 11:34:57 2022] DELETE /identity/v3/projects/cf68a46e27ed4039963d662cec2de37e => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:35:01.127669 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15be55d1-e55a-4c93-9fec-8a3daf4a03a7 service neutron] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:35:01.129941 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-15be55d1-e55a-4c93-9fec-8a3daf4a03a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:35:01.194817 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15be55d1-e55a-4c93-9fec-8a3daf4a03a7 service neutron] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:35:01.298795 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44da789e-db10-4eb5-a3b9-7737a211af69 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92862b76ba3b4513b5dc5b5c962faac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:35:01.299388 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44da789e-db10-4eb5-a3b9-7737a211af69 service cinder] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:35:01.299664 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44da789e-db10-4eb5-a3b9-7737a211af69 service cinder] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:35:01.299956 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44da789e-db10-4eb5-a3b9-7737a211af69 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:35:01.301734 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-44da789e-db10-4eb5-a3b9-7737a211af69 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:35:01.355656 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:INSERT=1,keystone:DELETE=3,keystone:SELECT=96 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:35:01.391662 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44da789e-db10-4eb5-a3b9-7737a211af69 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:35:01.393596 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44da789e-db10-4eb5-a3b9-7737a211af69 service cinder] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:35:01.413434 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1084/2174] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:35:01 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:35:05.876084 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b4dbe6-fab6-4590-aa99-8317f86fdda9 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:35:05.876613 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b4dbe6-fab6-4590-aa99-8317f86fdda9 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:35:05.876613 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b4dbe6-fab6-4590-aa99-8317f86fdda9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:35:05.897038 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-09b4dbe6-fab6-4590-aa99-8317f86fdda9 None None] MFA Rules not processed for user `a5915030f01941fc89f92228ff57c7f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:35:05.898261 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-09b4dbe6-fab6-4590-aa99-8317f86fdda9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:35:05.921384 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:35:05.963807 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1091/2175] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Aug 24 11:35:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:35:06.007030 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44da789e-db10-4eb5-a3b9-7737a211af69 service cinder] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:35:06.008591 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-44da789e-db10-4eb5-a3b9-7737a211af69 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:35:06.078935 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44da789e-db10-4eb5-a3b9-7737a211af69 service cinder] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:35:06.084394 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdd2294-3d95-46e5-8549-21d4a1dbe6d9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1069558c085449f9e4c9f06013b2a85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:35:06.085000 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdd2294-3d95-46e5-8549-21d4a1dbe6d9 service swift] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:35:06.085381 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdd2294-3d95-46e5-8549-21d4a1dbe6d9 service swift] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:35:06.085549 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdd2294-3d95-46e5-8549-21d4a1dbe6d9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:35:06.096355 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdd2294-3d95-46e5-8549-21d4a1dbe6d9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:35:06.098342 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdd2294-3d95-46e5-8549-21d4a1dbe6d9 service swift] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:35:06.107907 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1085/2176] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Aug 24 11:35:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 11:35:06.405297 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b4dbe6-fab6-4590-aa99-8317f86fdda9 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:35:06.407712 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-09b4dbe6-fab6-4590-aa99-8317f86fdda9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:35:06.492727 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b4dbe6-fab6-4590-aa99-8317f86fdda9 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:35:06.497884 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0ea70d-3c34-4169-a8b8-6b0c641361e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:35:06.498787 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0ea70d-3c34-4169-a8b8-6b0c641361e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:35:06.499165 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0ea70d-3c34-4169-a8b8-6b0c641361e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:35:06.499545 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0ea70d-3c34-4169-a8b8-6b0c641361e5 admin admin] PATH_INFO: `/v3/users/3952dc69807f43d3b3a17626111041a9` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:35:06.501031 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0ea70d-3c34-4169-a8b8-6b0c641361e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3952dc69807f43d3b3a17626111041a9)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:35:06.503551 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0ea70d-3c34-4169-a8b8-6b0c641361e5 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:35:06.552945 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-7c0ea70d-3c34-4169-a8b8-6b0c641361e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3952dc69807f43d3b3a17626111041a9'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:35:06.553604 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-7c0ea70d-3c34-4169-a8b8-6b0c641361e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3952dc69807f43d3b3a17626111041a9'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:35:06.554272 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-7c0ea70d-3c34-4169-a8b8-6b0c641361e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3952dc69807f43d3b3a17626111041a9'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:35:06.562002 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-7c0ea70d-3c34-4169-a8b8-6b0c641361e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3952dc69807f43d3b3a17626111041a9'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:35:06.569926 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-7c0ea70d-3c34-4169-a8b8-6b0c641361e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3952dc69807f43d3b3a17626111041a9'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:35:06.587798 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1092/2177] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 11:35:06 2022] DELETE /identity/v3/users/3952dc69807f43d3b3a17626111041a9 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:35:06.592428 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7338bf-663d-4760-8ac5-27cd4468a7cf None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:35:06.592709 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7338bf-663d-4760-8ac5-27cd4468a7cf None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:35:06.593006 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7338bf-663d-4760-8ac5-27cd4468a7cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:35:06.612048 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-3a7338bf-663d-4760-8ac5-27cd4468a7cf None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:35:06.613250 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-3a7338bf-663d-4760-8ac5-27cd4468a7cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:35:06.672055 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaeb190-3324-46ec-b7a4-8df060f3a9e8 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:35:06.672326 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaeb190-3324-46ec-b7a4-8df060f3a9e8 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:35:06.672581 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaeb190-3324-46ec-b7a4-8df060f3a9e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:35:06.691047 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1086/2178] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:35:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:35:06.692737 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-6aaeb190-3324-46ec-b7a4-8df060f3a9e8 None None] MFA Rules not processed for user `a5915030f01941fc89f92228ff57c7f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:35:06.693994 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-6aaeb190-3324-46ec-b7a4-8df060f3a9e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:35:06.701414 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7338bf-663d-4760-8ac5-27cd4468a7cf None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:35:06.702885 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-3a7338bf-663d-4760-8ac5-27cd4468a7cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:35:06.738122 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:35:06.754989 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1093/2179] 10.222.0.27 () {58 vars in 967 bytes} [Wed Aug 24 11:35:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:35:06.768336 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaeb190-3324-46ec-b7a4-8df060f3a9e8 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:35:06.768580 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7338bf-663d-4760-8ac5-27cd4468a7cf None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:35:06.769892 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-6aaeb190-3324-46ec-b7a4-8df060f3a9e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:35:06.772286 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e2ff07-5daa-4faa-a7ad-9a304792a902 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2d061d25d83443c9232218c90792d51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:35:06.772912 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e2ff07-5daa-4faa-a7ad-9a304792a902 service neutron] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:35:06.773188 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e2ff07-5daa-4faa-a7ad-9a304792a902 service neutron] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:35:06.773463 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e2ff07-5daa-4faa-a7ad-9a304792a902 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:35:06.782816 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e2ff07-5daa-4faa-a7ad-9a304792a902 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:35:06.784276 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e2ff07-5daa-4faa-a7ad-9a304792a902 service neutron] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:35:06.794291 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1087/2180] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:35:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 11:35:06.845710 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaeb190-3324-46ec-b7a4-8df060f3a9e8 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:35:06.852085 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41a3610-e74a-4fc0-8596-5d55447f9aba service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1069558c085449f9e4c9f06013b2a85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:35:06.852846 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41a3610-e74a-4fc0-8596-5d55447f9aba service swift] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:35:06.853068 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41a3610-e74a-4fc0-8596-5d55447f9aba service swift] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:35:06.853487 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41a3610-e74a-4fc0-8596-5d55447f9aba service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:35:06.863244 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41a3610-e74a-4fc0-8596-5d55447f9aba service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:35:06.865090 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41a3610-e74a-4fc0-8596-5d55447f9aba service swift] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:35:06.874649 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1094/2181] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Aug 24 11:35:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 24 11:35:07.128888 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f61863-8093-4d6e-a3c7-16311f83110b None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:35:07.129375 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f61863-8093-4d6e-a3c7-16311f83110b None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:35:07.129452 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f61863-8093-4d6e-a3c7-16311f83110b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:35:07.145459 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:35:07.152179 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-18f61863-8093-4d6e-a3c7-16311f83110b None None] MFA Rules not processed for user `a5915030f01941fc89f92228ff57c7f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:35:07.153818 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-18f61863-8093-4d6e-a3c7-16311f83110b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:35:07.162402 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1088/2182] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Aug 24 11:35:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:35:07.176018 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41a3610-e74a-4fc0-8596-5d55447f9aba service swift] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:35:07.177798 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-b41a3610-e74a-4fc0-8596-5d55447f9aba service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:35:07.189064 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f61863-8093-4d6e-a3c7-16311f83110b None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:35:07.201568 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41a3610-e74a-4fc0-8596-5d55447f9aba service swift] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:35:07.204856 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f61863-8093-4d6e-a3c7-16311f83110b None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:35:07.210957 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2311a1c5-f959-4887-96f9-d2e06578be93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:35:07.211894 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2311a1c5-f959-4887-96f9-d2e06578be93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:35:07.212281 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45dc97d-1595-4ec3-9de4-39e6c8513141 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1069558c085449f9e4c9f06013b2a85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:35:07.212414 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2311a1c5-f959-4887-96f9-d2e06578be93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:35:07.212745 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2311a1c5-f959-4887-96f9-d2e06578be93 admin admin] PATH_INFO: `/v3/projects/ef14801486ce40a496aa593d4abb7ab9` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:35:07.213706 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45dc97d-1595-4ec3-9de4-39e6c8513141 service swift] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:35:07.214110 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45dc97d-1595-4ec3-9de4-39e6c8513141 service swift] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:35:07.214318 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2311a1c5-f959-4887-96f9-d2e06578be93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef14801486ce40a496aa593d4abb7ab9)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:35:07.214441 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45dc97d-1595-4ec3-9de4-39e6c8513141 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:35:07.217727 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2311a1c5-f959-4887-96f9-d2e06578be93 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:35:07.225247 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45dc97d-1595-4ec3-9de4-39e6c8513141 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:35:07.226935 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45dc97d-1595-4ec3-9de4-39e6c8513141 service swift] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:35:07.237988 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1089/2183] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Aug 24 11:35:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 11:35:07.272080 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-2311a1c5-f959-4887-96f9-d2e06578be93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef14801486ce40a496aa593d4abb7ab9', 'request_id': 'req-2311a1c5-f959-4887-96f9-d2e06578be93'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:35:07.279427 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-2311a1c5-f959-4887-96f9-d2e06578be93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef14801486ce40a496aa593d4abb7ab9', 'request_id': 'req-2311a1c5-f959-4887-96f9-d2e06578be93'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:35:07.285206 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-2311a1c5-f959-4887-96f9-d2e06578be93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef14801486ce40a496aa593d4abb7ab9', 'request_id': 'req-2311a1c5-f959-4887-96f9-d2e06578be93'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:35:07.300459 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-2311a1c5-f959-4887-96f9-d2e06578be93 admin admin] The token cache is being invalidate because project ef14801486ce40a496aa593d4abb7ab9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81501) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:35:07.300744 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-2311a1c5-f959-4887-96f9-d2e06578be93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:35:07.301394 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-2311a1c5-f959-4887-96f9-d2e06578be93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:35:07.302914 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1095/2184] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 11:35:07 2022] DELETE /identity/v3/projects/ef14801486ce40a496aa593d4abb7ab9 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:35:07.307098 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45dc97d-1595-4ec3-9de4-39e6c8513141 service swift] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:35:07.318138 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45dc97d-1595-4ec3-9de4-39e6c8513141 service swift] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:35:07.385160 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a98fbcb-620e-4f18-99d4-f7af96773813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:35:07.385787 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a98fbcb-620e-4f18-99d4-f7af96773813 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:35:07.386087 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a98fbcb-620e-4f18-99d4-f7af96773813 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:35:07.386378 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a98fbcb-620e-4f18-99d4-f7af96773813 admin admin] PATH_INFO: `/v3/users/d5bfeb0cd6484fda93382d7e020e0ff7` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:35:07.387556 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a98fbcb-620e-4f18-99d4-f7af96773813 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5bfeb0cd6484fda93382d7e020e0ff7)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:35:07.389490 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a98fbcb-620e-4f18-99d4-f7af96773813 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:35:07.439190 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-0a98fbcb-620e-4f18-99d4-f7af96773813 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5bfeb0cd6484fda93382d7e020e0ff7'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:35:07.439550 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-0a98fbcb-620e-4f18-99d4-f7af96773813 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5bfeb0cd6484fda93382d7e020e0ff7'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:35:07.448583 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-0a98fbcb-620e-4f18-99d4-f7af96773813 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5bfeb0cd6484fda93382d7e020e0ff7'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:35:07.456554 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-0a98fbcb-620e-4f18-99d4-f7af96773813 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5bfeb0cd6484fda93382d7e020e0ff7'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:35:07.462828 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-0a98fbcb-620e-4f18-99d4-f7af96773813 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5bfeb0cd6484fda93382d7e020e0ff7'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:35:07.487850 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1090/2185] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 11:35:07 2022] DELETE /identity/v3/users/d5bfeb0cd6484fda93382d7e020e0ff7 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 11:35:07.621570 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a263c1-7679-47bc-acf2-a5552480f8ce None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:35:07.621570 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a263c1-7679-47bc-acf2-a5552480f8ce None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:35:07.621827 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a263c1-7679-47bc-acf2-a5552480f8ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:35:07.643498 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-95a263c1-7679-47bc-acf2-a5552480f8ce None None] MFA Rules not processed for user `a5915030f01941fc89f92228ff57c7f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:35:07.644859 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-95a263c1-7679-47bc-acf2-a5552480f8ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:35:07.729841 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1096/2186] 10.222.0.27 () {58 vars in 967 bytes} [Wed Aug 24 11:35:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:35:07.742738 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a98fbcb-620e-4f18-99d4-f7af96773813 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:35:07.744194 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-0a98fbcb-620e-4f18-99d4-f7af96773813 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:35:07.832875 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a98fbcb-620e-4f18-99d4-f7af96773813 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:35:07.838902 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6dd11a-a077-4c98-a01a-a83667d0e0eb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1069558c085449f9e4c9f06013b2a85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:35:07.839548 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6dd11a-a077-4c98-a01a-a83667d0e0eb service swift] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:35:07.839825 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6dd11a-a077-4c98-a01a-a83667d0e0eb service swift] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:35:07.840091 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6dd11a-a077-4c98-a01a-a83667d0e0eb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:35:07.848344 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:35:07.851989 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6dd11a-a077-4c98-a01a-a83667d0e0eb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:35:07.853320 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6dd11a-a077-4c98-a01a-a83667d0e0eb service swift] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:35:07.866193 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1091/2187] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Aug 24 11:35:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 11:35:07.886634 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a263c1-7679-47bc-acf2-a5552480f8ce None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:35:07.889721 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-95a263c1-7679-47bc-acf2-a5552480f8ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:35:07.904102 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:35:07.990385 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a263c1-7679-47bc-acf2-a5552480f8ce None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:35:07.996419 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c102651-2bf9-4988-8541-5208ff158e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:35:07.996697 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c102651-2bf9-4988-8541-5208ff158e5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:35:07.996988 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c102651-2bf9-4988-8541-5208ff158e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:35:07.997269 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c102651-2bf9-4988-8541-5208ff158e5a admin admin] PATH_INFO: `/v3/projects/3ad65e96de77496d94ef3bad98517052` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:35:07.998460 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c102651-2bf9-4988-8541-5208ff158e5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ad65e96de77496d94ef3bad98517052)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:35:08.000438 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c102651-2bf9-4988-8541-5208ff158e5a admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:35:08.059678 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-2c102651-2bf9-4988-8541-5208ff158e5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ad65e96de77496d94ef3bad98517052', 'request_id': 'req-2c102651-2bf9-4988-8541-5208ff158e5a'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:35:08.071827 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-2c102651-2bf9-4988-8541-5208ff158e5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ad65e96de77496d94ef3bad98517052', 'request_id': 'req-2c102651-2bf9-4988-8541-5208ff158e5a'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:35:08.080454 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-2c102651-2bf9-4988-8541-5208ff158e5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ad65e96de77496d94ef3bad98517052', 'request_id': 'req-2c102651-2bf9-4988-8541-5208ff158e5a'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:35:08.117410 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-2c102651-2bf9-4988-8541-5208ff158e5a admin admin] The token cache is being invalidate because project 3ad65e96de77496d94ef3bad98517052 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81501) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:35:08.122471 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-2c102651-2bf9-4988-8541-5208ff158e5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:35:08.124223 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-2c102651-2bf9-4988-8541-5208ff158e5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:35:08.133237 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1097/2188] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 11:35:07 2022] DELETE /identity/v3/projects/3ad65e96de77496d94ef3bad98517052 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:35:08.134633 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadf5b7c-ee00-447e-a5f8-fa09ae0084ea None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:35:08.135038 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadf5b7c-ee00-447e-a5f8-fa09ae0084ea None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:35:08.135219 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadf5b7c-ee00-447e-a5f8-fa09ae0084ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:35:08.158892 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-dadf5b7c-ee00-447e-a5f8-fa09ae0084ea None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:35:08.160193 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-dadf5b7c-ee00-447e-a5f8-fa09ae0084ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:35:08.300953 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1092/2189] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:35:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:35:08.310826 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ef0e4e-06c7-4df7-ab3a-17ef199ac800 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:35:08.311368 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ef0e4e-06c7-4df7-ab3a-17ef199ac800 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:35:08.311541 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ef0e4e-06c7-4df7-ab3a-17ef199ac800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:35:08.334390 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-33ef0e4e-06c7-4df7-ab3a-17ef199ac800 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:35:08.335740 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-33ef0e4e-06c7-4df7-ab3a-17ef199ac800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:35:08.354808 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1098/2190] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:35:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:35:08.360040 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadf5b7c-ee00-447e-a5f8-fa09ae0084ea None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:35:08.375075 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadf5b7c-ee00-447e-a5f8-fa09ae0084ea None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:35:08.380177 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fb91e9-ab44-4cdf-85bd-47d921ee596f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:35:08.380791 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fb91e9-ab44-4cdf-85bd-47d921ee596f admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:35:08.381065 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fb91e9-ab44-4cdf-85bd-47d921ee596f admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:35:08.381331 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fb91e9-ab44-4cdf-85bd-47d921ee596f admin admin] PATH_INFO: `/v3/domains` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:35:08.381983 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fb91e9-ab44-4cdf-85bd-47d921ee596f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:35:08.382279 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fb91e9-ab44-4cdf-85bd-47d921ee596f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:35:08.383933 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fb91e9-ab44-4cdf-85bd-47d921ee596f admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:35:08.401232 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1093/2191] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 24 11:35:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:35:08.412219 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ef0e4e-06c7-4df7-ab3a-17ef199ac800 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:35:08.434561 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ef0e4e-06c7-4df7-ab3a-17ef199ac800 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:35:08.434561 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553e2270-b2c6-4b24-9c21-ca948e0bcaa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:35:08.434561 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553e2270-b2c6-4b24-9c21-ca948e0bcaa6 admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:35:08.434561 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553e2270-b2c6-4b24-9c21-ca948e0bcaa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:35:08.434902 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553e2270-b2c6-4b24-9c21-ca948e0bcaa6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:35:08.434902 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553e2270-b2c6-4b24-9c21-ca948e0bcaa6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:35:08.434902 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553e2270-b2c6-4b24-9c21-ca948e0bcaa6 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:35:08.470709 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1099/2192] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 11:35:08 2022] POST /identity/v3/projects => generated 373 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:35:08.471493 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fb91e9-ab44-4cdf-85bd-47d921ee596f admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:35:08.487147 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fb91e9-ab44-4cdf-85bd-47d921ee596f admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:35:08.568900 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691018d6-d139-44fd-8eb4-8948b13b98d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:35:08.569732 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691018d6-d139-44fd-8eb4-8948b13b98d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:35:08.570143 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691018d6-d139-44fd-8eb4-8948b13b98d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:35:08.570485 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691018d6-d139-44fd-8eb4-8948b13b98d0 admin admin] PATH_INFO: `/v3/users` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:35:08.571180 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691018d6-d139-44fd-8eb4-8948b13b98d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:35:08.573541 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691018d6-d139-44fd-8eb4-8948b13b98d0 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:35:08.615197 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553e2270-b2c6-4b24-9c21-ca948e0bcaa6 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:35:08.624779 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1094/2193] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 11:35:08 2022] POST /identity/v3/users => generated 287 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:35:08.630682 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553e2270-b2c6-4b24-9c21-ca948e0bcaa6 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:35:08.636280 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a612778-f01b-4a65-a58e-b72e52fe2187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:35:08.637025 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a612778-f01b-4a65-a58e-b72e52fe2187 admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:35:08.637368 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a612778-f01b-4a65-a58e-b72e52fe2187 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:35:08.637780 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a612778-f01b-4a65-a58e-b72e52fe2187 admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:35:08.638554 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a612778-f01b-4a65-a58e-b72e52fe2187 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:35:08.640663 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a612778-f01b-4a65-a58e-b72e52fe2187 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:35:08.655496 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1100/2194] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:35:08 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:35:08.659711 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691018d6-d139-44fd-8eb4-8948b13b98d0 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:35:08.674230 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691018d6-d139-44fd-8eb4-8948b13b98d0 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:35:08.682632 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dc832c-1753-45ef-b350-31188739aa8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:35:08.683319 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dc832c-1753-45ef-b350-31188739aa8a admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:35:08.683597 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dc832c-1753-45ef-b350-31188739aa8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:35:08.683866 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dc832c-1753-45ef-b350-31188739aa8a admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:35:08.684932 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dc832c-1753-45ef-b350-31188739aa8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:35:08.686608 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dc832c-1753-45ef-b350-31188739aa8a admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:35:08.702259 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1095/2195] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:35:08 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:35:08.707557 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a612778-f01b-4a65-a58e-b72e52fe2187 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:35:08.723381 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a612778-f01b-4a65-a58e-b72e52fe2187 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:35:08.730913 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a662b7f-5771-423c-b90a-c8bd0f11c0d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:35:08.731892 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a662b7f-5771-423c-b90a-c8bd0f11c0d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:35:08.732460 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a662b7f-5771-423c-b90a-c8bd0f11c0d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:35:08.732924 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a662b7f-5771-423c-b90a-c8bd0f11c0d6 admin admin] PATH_INFO: `/v3/projects/c0e05d65e5634f7e8c587d0711e606ee/users/71ec829d8a8844bf99d067bd5644bab6/roles/27e3e65e24df4b86b0d3d18d3212101d` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:35:08.751345 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a662b7f-5771-423c-b90a-c8bd0f11c0d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0e05d65e5634f7e8c587d0711e606ee, user_id=71ec829d8a8844bf99d067bd5644bab6, role_id=27e3e65e24df4b86b0d3d18d3212101d)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:35:08.754679 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a662b7f-5771-423c-b90a-c8bd0f11c0d6 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:35:08.790457 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1101/2196] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 11:35:08 2022] PUT /identity/v3/projects/c0e05d65e5634f7e8c587d0711e606ee/users/71ec829d8a8844bf99d067bd5644bab6/roles/27e3e65e24df4b86b0d3d18d3212101d => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:35:08.801893 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663b5a93-894a-4308-8327-5631c222fd29 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:35:08.802176 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663b5a93-894a-4308-8327-5631c222fd29 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:35:08.802489 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663b5a93-894a-4308-8327-5631c222fd29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:35:08.845746 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-663b5a93-894a-4308-8327-5631c222fd29 None None] MFA Rules not processed for user `71ec829d8a8844bf99d067bd5644bab6`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:35:08.847512 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-663b5a93-894a-4308-8327-5631c222fd29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:35:08.918315 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:35:08.951012 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1096/2197] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:35:08 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:35:08.962864 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a662b7f-5771-423c-b90a-c8bd0f11c0d6 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:35:08.971386 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-0a662b7f-5771-423c-b90a-c8bd0f11c0d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:35:09.023383 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:35:09.049668 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a662b7f-5771-423c-b90a-c8bd0f11c0d6 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:35:09.053644 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d975d8-19f0-41bf-ad63-5e2406e04f5b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92862b76ba3b4513b5dc5b5c962faac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:35:09.054349 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d975d8-19f0-41bf-ad63-5e2406e04f5b service cinder] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:35:09.054745 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d975d8-19f0-41bf-ad63-5e2406e04f5b service cinder] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:35:09.055086 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d975d8-19f0-41bf-ad63-5e2406e04f5b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:35:09.068573 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d975d8-19f0-41bf-ad63-5e2406e04f5b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:35:09.070046 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d975d8-19f0-41bf-ad63-5e2406e04f5b service cinder] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:35:09.080017 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1102/2198] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:35:08 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:35:09.109015 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663b5a93-894a-4308-8327-5631c222fd29 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:35:09.213321 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663b5a93-894a-4308-8327-5631c222fd29 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:35:09.218156 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74a0c2b-4439-4b61-997c-7f1fa9530324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:35:09.218933 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74a0c2b-4439-4b61-997c-7f1fa9530324 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:35:09.219283 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74a0c2b-4439-4b61-997c-7f1fa9530324 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:35:09.219679 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74a0c2b-4439-4b61-997c-7f1fa9530324 admin admin] PATH_INFO: `/v3/users/71ec829d8a8844bf99d067bd5644bab6` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:35:09.220936 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74a0c2b-4439-4b61-997c-7f1fa9530324 admin admin] RBAC: Authorizing `identity:delete_user(user_id=71ec829d8a8844bf99d067bd5644bab6)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:35:09.223081 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74a0c2b-4439-4b61-997c-7f1fa9530324 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:35:09.282990 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-b74a0c2b-4439-4b61-997c-7f1fa9530324 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71ec829d8a8844bf99d067bd5644bab6'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:35:09.283990 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-b74a0c2b-4439-4b61-997c-7f1fa9530324 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71ec829d8a8844bf99d067bd5644bab6'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:35:09.292497 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-b74a0c2b-4439-4b61-997c-7f1fa9530324 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71ec829d8a8844bf99d067bd5644bab6'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:35:09.300873 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-b74a0c2b-4439-4b61-997c-7f1fa9530324 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71ec829d8a8844bf99d067bd5644bab6'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:35:09.301701 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-b74a0c2b-4439-4b61-997c-7f1fa9530324 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71ec829d8a8844bf99d067bd5644bab6'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:35:09.321403 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1097/2199] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 11:35:09 2022] DELETE /identity/v3/users/71ec829d8a8844bf99d067bd5644bab6 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:35:09.326261 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf8cf8c-fd21-44f4-b94d-d4dcdb1a10b2 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:35:09.326851 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf8cf8c-fd21-44f4-b94d-d4dcdb1a10b2 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:35:09.326851 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf8cf8c-fd21-44f4-b94d-d4dcdb1a10b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:35:09.347872 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-6bf8cf8c-fd21-44f4-b94d-d4dcdb1a10b2 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:35:09.349135 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-6bf8cf8c-fd21-44f4-b94d-d4dcdb1a10b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:35:09.416303 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1103/2200] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:35:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:35:09.428278 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74a0c2b-4439-4b61-997c-7f1fa9530324 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:35:09.430177 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-b74a0c2b-4439-4b61-997c-7f1fa9530324 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:35:09.497183 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74a0c2b-4439-4b61-997c-7f1fa9530324 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:35:09.501191 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700b6e91-d2e1-4ef0-80c6-bc5c2f991fdd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2d061d25d83443c9232218c90792d51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:35:09.501848 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700b6e91-d2e1-4ef0-80c6-bc5c2f991fdd service neutron] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:35:09.502191 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700b6e91-d2e1-4ef0-80c6-bc5c2f991fdd service neutron] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:35:09.502511 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700b6e91-d2e1-4ef0-80c6-bc5c2f991fdd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:35:09.512616 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700b6e91-d2e1-4ef0-80c6-bc5c2f991fdd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:35:09.514108 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700b6e91-d2e1-4ef0-80c6-bc5c2f991fdd service neutron] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:35:09.524357 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1098/2201] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:35:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:35:10.020420 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf8cf8c-fd21-44f4-b94d-d4dcdb1a10b2 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:35:10.022118 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-6bf8cf8c-fd21-44f4-b94d-d4dcdb1a10b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:35:10.035193 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf8cf8c-fd21-44f4-b94d-d4dcdb1a10b2 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:35:10.040302 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dca7ad-4d1b-438a-a787-598d7a7d909c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:35:10.040946 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dca7ad-4d1b-438a-a787-598d7a7d909c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:35:10.041334 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dca7ad-4d1b-438a-a787-598d7a7d909c admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:35:10.041617 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dca7ad-4d1b-438a-a787-598d7a7d909c admin admin] PATH_INFO: `/v3/projects/c0e05d65e5634f7e8c587d0711e606ee` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:35:10.043097 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dca7ad-4d1b-438a-a787-598d7a7d909c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0e05d65e5634f7e8c587d0711e606ee)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:35:10.045293 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dca7ad-4d1b-438a-a787-598d7a7d909c admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:35:10.109301 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-05dca7ad-4d1b-438a-a787-598d7a7d909c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0e05d65e5634f7e8c587d0711e606ee', 'request_id': 'req-05dca7ad-4d1b-438a-a787-598d7a7d909c'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:35:10.117590 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-05dca7ad-4d1b-438a-a787-598d7a7d909c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0e05d65e5634f7e8c587d0711e606ee', 'request_id': 'req-05dca7ad-4d1b-438a-a787-598d7a7d909c'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:35:10.124634 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-05dca7ad-4d1b-438a-a787-598d7a7d909c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0e05d65e5634f7e8c587d0711e606ee', 'request_id': 'req-05dca7ad-4d1b-438a-a787-598d7a7d909c'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:35:10.141761 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-05dca7ad-4d1b-438a-a787-598d7a7d909c admin admin] The token cache is being invalidate because project c0e05d65e5634f7e8c587d0711e606ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81501) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:35:10.142155 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-05dca7ad-4d1b-438a-a787-598d7a7d909c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:35:10.143044 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-05dca7ad-4d1b-438a-a787-598d7a7d909c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:35:10.153612 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1104/2202] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 11:35:10 2022] DELETE /identity/v3/projects/c0e05d65e5634f7e8c587d0711e606ee => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:35:10.158911 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d237d11e-31c1-4f2f-9801-875a5d9ab288 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:35:10.159197 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d237d11e-31c1-4f2f-9801-875a5d9ab288 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:35:10.159485 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d237d11e-31c1-4f2f-9801-875a5d9ab288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:35:10.182870 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-d237d11e-31c1-4f2f-9801-875a5d9ab288 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:35:10.184746 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-d237d11e-31c1-4f2f-9801-875a5d9ab288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:35:10.194552 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:35:10.241170 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dca7ad-4d1b-438a-a787-598d7a7d909c admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:35:10.242865 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-05dca7ad-4d1b-438a-a787-598d7a7d909c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:35:10.273452 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1099/2203] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:35:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:35:10.284548 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804ffc2c-67e2-405e-96a8-418d710998a6 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:35:10.285113 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804ffc2c-67e2-405e-96a8-418d710998a6 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:35:10.285809 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804ffc2c-67e2-405e-96a8-418d710998a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:35:10.322567 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-804ffc2c-67e2-405e-96a8-418d710998a6 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:35:10.323778 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-804ffc2c-67e2-405e-96a8-418d710998a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:35:10.336572 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1100/2204] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:35:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:35:10.337702 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804ffc2c-67e2-405e-96a8-418d710998a6 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:35:10.347982 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804ffc2c-67e2-405e-96a8-418d710998a6 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:35:10.352913 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f152c45-2009-46db-ac19-cea133959c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:35:10.353542 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f152c45-2009-46db-ac19-cea133959c3d admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:35:10.353814 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f152c45-2009-46db-ac19-cea133959c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:35:10.354086 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f152c45-2009-46db-ac19-cea133959c3d admin admin] PATH_INFO: `/v3/domains` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:35:10.354795 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f152c45-2009-46db-ac19-cea133959c3d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:35:10.355097 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f152c45-2009-46db-ac19-cea133959c3d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:35:10.355550 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dca7ad-4d1b-438a-a787-598d7a7d909c admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:35:10.356784 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f152c45-2009-46db-ac19-cea133959c3d admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:35:10.366321 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f6bda6-53e8-4c6b-9ef7-51880cd427a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:35:10.367032 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f6bda6-53e8-4c6b-9ef7-51880cd427a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:35:10.367307 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f6bda6-53e8-4c6b-9ef7-51880cd427a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:35:10.367576 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f6bda6-53e8-4c6b-9ef7-51880cd427a5 admin admin] PATH_INFO: `/v3/users/fa47206f489e4ef6ae0e3368c7bb03ae` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:35:10.368821 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f6bda6-53e8-4c6b-9ef7-51880cd427a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa47206f489e4ef6ae0e3368c7bb03ae)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:35:10.371071 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f6bda6-53e8-4c6b-9ef7-51880cd427a5 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:35:10.374736 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:35:10.376522 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1101/2205] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 24 11:35:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:35:10.381920 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f152c45-2009-46db-ac19-cea133959c3d admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:35:10.401479 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f152c45-2009-46db-ac19-cea133959c3d admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:35:10.411454 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9424633e-6ebd-4dcc-965c-bef390abdc33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:35:10.412457 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9424633e-6ebd-4dcc-965c-bef390abdc33 admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:35:10.413099 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9424633e-6ebd-4dcc-965c-bef390abdc33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:35:10.413449 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9424633e-6ebd-4dcc-965c-bef390abdc33 admin admin] PATH_INFO: `/v3/projects` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:35:10.414314 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9424633e-6ebd-4dcc-965c-bef390abdc33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:35:10.416911 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9424633e-6ebd-4dcc-965c-bef390abdc33 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:35:10.448296 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-a2f6bda6-53e8-4c6b-9ef7-51880cd427a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa47206f489e4ef6ae0e3368c7bb03ae'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:35:10.450602 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-a2f6bda6-53e8-4c6b-9ef7-51880cd427a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa47206f489e4ef6ae0e3368c7bb03ae'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:35:10.452055 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-a2f6bda6-53e8-4c6b-9ef7-51880cd427a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa47206f489e4ef6ae0e3368c7bb03ae'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:35:10.466410 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1102/2206] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 11:35:10 2022] POST /identity/v3/projects => generated 359 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:35:10.469127 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9424633e-6ebd-4dcc-965c-bef390abdc33 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:35:10.470173 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-a2f6bda6-53e8-4c6b-9ef7-51880cd427a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa47206f489e4ef6ae0e3368c7bb03ae'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:35:10.473196 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-9424633e-6ebd-4dcc-965c-bef390abdc33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:35:10.490894 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-a2f6bda6-53e8-4c6b-9ef7-51880cd427a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa47206f489e4ef6ae0e3368c7bb03ae'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:35:10.531984 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1105/2207] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 11:35:10 2022] DELETE /identity/v3/users/fa47206f489e4ef6ae0e3368c7bb03ae => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 11:35:10.534184 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0371fa6-5528-4586-89a0-e75f88b72df1 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:35:10.534657 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0371fa6-5528-4586-89a0-e75f88b72df1 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:35:10.535163 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0371fa6-5528-4586-89a0-e75f88b72df1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:35:10.563774 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-f0371fa6-5528-4586-89a0-e75f88b72df1 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:35:10.566016 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-f0371fa6-5528-4586-89a0-e75f88b72df1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:35:10.568388 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9424633e-6ebd-4dcc-965c-bef390abdc33 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:35:10.650875 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab7745f-e35e-4100-b5be-03612b98875d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:35:10.650875 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab7745f-e35e-4100-b5be-03612b98875d admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:35:10.650875 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab7745f-e35e-4100-b5be-03612b98875d admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:35:10.650875 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab7745f-e35e-4100-b5be-03612b98875d admin admin] PATH_INFO: `/v3/users` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:35:10.651308 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab7745f-e35e-4100-b5be-03612b98875d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:35:10.652144 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1106/2208] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:35:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:35:10.652527 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab7745f-e35e-4100-b5be-03612b98875d admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:35:10.658514 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0371fa6-5528-4586-89a0-e75f88b72df1 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:35:10.660153 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-f0371fa6-5528-4586-89a0-e75f88b72df1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:35:10.682398 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1103/2209] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 11:35:10 2022] POST /identity/v3/users => generated 280 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 11:35:10.684772 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab7745f-e35e-4100-b5be-03612b98875d admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:35:10.696293 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab7745f-e35e-4100-b5be-03612b98875d admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:35:10.706065 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62347b6-bed4-4032-ad0e-7c94f4fb376b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:35:10.706748 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62347b6-bed4-4032-ad0e-7c94f4fb376b admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:35:10.707023 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62347b6-bed4-4032-ad0e-7c94f4fb376b admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:35:10.707290 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62347b6-bed4-4032-ad0e-7c94f4fb376b admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:35:10.707941 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62347b6-bed4-4032-ad0e-7c94f4fb376b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:35:10.709562 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62347b6-bed4-4032-ad0e-7c94f4fb376b admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:35:10.712171 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:35:10.736670 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1104/2210] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:35:10 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:35:10.742566 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62347b6-bed4-4032-ad0e-7c94f4fb376b admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:35:10.749761 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0371fa6-5528-4586-89a0-e75f88b72df1 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:35:10.754311 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db631f5a-a388-49ef-820c-66cfc2ff239a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2d061d25d83443c9232218c90792d51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:35:10.755191 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db631f5a-a388-49ef-820c-66cfc2ff239a service neutron] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:35:10.755986 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db631f5a-a388-49ef-820c-66cfc2ff239a service neutron] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:35:10.756099 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db631f5a-a388-49ef-820c-66cfc2ff239a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:35:10.761436 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62347b6-bed4-4032-ad0e-7c94f4fb376b admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:35:10.773472 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db631f5a-a388-49ef-820c-66cfc2ff239a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:35:10.775614 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db631f5a-a388-49ef-820c-66cfc2ff239a service neutron] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:35:10.779021 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26f24c1-b169-46c9-8230-37ad752687e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:35:10.779666 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26f24c1-b169-46c9-8230-37ad752687e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:35:10.779956 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26f24c1-b169-46c9-8230-37ad752687e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:35:10.780210 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26f24c1-b169-46c9-8230-37ad752687e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:35:10.780881 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26f24c1-b169-46c9-8230-37ad752687e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:35:10.782924 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26f24c1-b169-46c9-8230-37ad752687e2 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:35:10.789554 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1107/2211] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:35:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:35:10.810669 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1105/2212] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:35:10 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:35:10.820548 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db631f5a-a388-49ef-820c-66cfc2ff239a service neutron] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:35:10.844581 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db631f5a-a388-49ef-820c-66cfc2ff239a service neutron] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:35:10.861436 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0300d12a-f2b5-46c5-82d7-c4528b526991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:35:10.862571 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0300d12a-f2b5-46c5-82d7-c4528b526991 admin admin] REQUEST_METHOD: `PUT` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:35:10.863053 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0300d12a-f2b5-46c5-82d7-c4528b526991 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:35:10.863526 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0300d12a-f2b5-46c5-82d7-c4528b526991 admin admin] PATH_INFO: `/v3/projects/c88497bf710d4ad18b80ddf810626f6a/users/c01600e9c46d4eb9a67c8e2070a11a9b/roles/27e3e65e24df4b86b0d3d18d3212101d` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:35:10.894460 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0300d12a-f2b5-46c5-82d7-c4528b526991 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c88497bf710d4ad18b80ddf810626f6a, user_id=c01600e9c46d4eb9a67c8e2070a11a9b, role_id=27e3e65e24df4b86b0d3d18d3212101d)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:35:10.897154 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0300d12a-f2b5-46c5-82d7-c4528b526991 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:35:10.910636 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:35:10.916151 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1108/2213] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 11:35:10 2022] PUT /identity/v3/projects/c88497bf710d4ad18b80ddf810626f6a/users/c01600e9c46d4eb9a67c8e2070a11a9b/roles/27e3e65e24df4b86b0d3d18d3212101d => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:35:10.928236 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1259a67f-9275-4aba-a83d-8ee804ff779b None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:35:10.928926 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1259a67f-9275-4aba-a83d-8ee804ff779b None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:35:10.929319 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1259a67f-9275-4aba-a83d-8ee804ff779b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:35:10.962099 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-1259a67f-9275-4aba-a83d-8ee804ff779b None None] MFA Rules not processed for user `c01600e9c46d4eb9a67c8e2070a11a9b`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:35:10.963368 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-1259a67f-9275-4aba-a83d-8ee804ff779b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:35:11.027617 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0300d12a-f2b5-46c5-82d7-c4528b526991 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:35:11.029829 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-0300d12a-f2b5-46c5-82d7-c4528b526991 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:35:11.079624 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1106/2214] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:35:10 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 11:35:11.109449 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0300d12a-f2b5-46c5-82d7-c4528b526991 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:35:11.115212 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3849d3-393e-4c62-906c-3a980388aeb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:35:11.115870 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3849d3-393e-4c62-906c-3a980388aeb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:35:11.116145 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3849d3-393e-4c62-906c-3a980388aeb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:35:11.116474 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3849d3-393e-4c62-906c-3a980388aeb0 admin admin] PATH_INFO: `/v3/projects/336f2ec2761045cd84ed195b2c59341b` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:35:11.118316 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3849d3-393e-4c62-906c-3a980388aeb0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=336f2ec2761045cd84ed195b2c59341b)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:35:11.120402 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3849d3-393e-4c62-906c-3a980388aeb0 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:35:11.123901 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1259a67f-9275-4aba-a83d-8ee804ff779b None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:35:11.125391 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-1259a67f-9275-4aba-a83d-8ee804ff779b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:35:11.202444 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-1f3849d3-393e-4c62-906c-3a980388aeb0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '336f2ec2761045cd84ed195b2c59341b', 'request_id': 'req-1f3849d3-393e-4c62-906c-3a980388aeb0'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:35:11.209359 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-1f3849d3-393e-4c62-906c-3a980388aeb0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '336f2ec2761045cd84ed195b2c59341b', 'request_id': 'req-1f3849d3-393e-4c62-906c-3a980388aeb0'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:35:11.216208 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1259a67f-9275-4aba-a83d-8ee804ff779b None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:35:11.216871 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-1f3849d3-393e-4c62-906c-3a980388aeb0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '336f2ec2761045cd84ed195b2c59341b', 'request_id': 'req-1f3849d3-393e-4c62-906c-3a980388aeb0'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:35:11.233817 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-1f3849d3-393e-4c62-906c-3a980388aeb0 admin admin] The token cache is being invalidate because project 336f2ec2761045cd84ed195b2c59341b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81501) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:35:11.234089 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-1f3849d3-393e-4c62-906c-3a980388aeb0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:35:11.234803 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-1f3849d3-393e-4c62-906c-3a980388aeb0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:35:11.236558 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1109/2215] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 11:35:11 2022] DELETE /identity/v3/projects/336f2ec2761045cd84ed195b2c59341b => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:35:11.241182 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e90967-641a-4a5c-a18f-12ebe8dbbad8 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:35:11.241598 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e90967-641a-4a5c-a18f-12ebe8dbbad8 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:35:11.241757 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e90967-641a-4a5c-a18f-12ebe8dbbad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:35:11.263222 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-42e90967-641a-4a5c-a18f-12ebe8dbbad8 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:35:11.264381 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-42e90967-641a-4a5c-a18f-12ebe8dbbad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:35:11.276634 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87162ad8-4626-4067-af69-6a6016c729a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92862b76ba3b4513b5dc5b5c962faac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:35:11.277248 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87162ad8-4626-4067-af69-6a6016c729a7 service cinder] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:35:11.277528 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87162ad8-4626-4067-af69-6a6016c729a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:35:11.277795 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87162ad8-4626-4067-af69-6a6016c729a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:35:11.279679 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-87162ad8-4626-4067-af69-6a6016c729a7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:35:11.329629 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1110/2216] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:35:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 11:35:11.331461 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:35:11.337195 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f17007-6e3f-4853-b041-711fd1bcfbc1 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:35:11.337480 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f17007-6e3f-4853-b041-711fd1bcfbc1 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:35:11.337756 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f17007-6e3f-4853-b041-711fd1bcfbc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:35:11.352031 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87162ad8-4626-4067-af69-6a6016c729a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:35:11.354437 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87162ad8-4626-4067-af69-6a6016c729a7 service cinder] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:35:11.358869 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-a9f17007-6e3f-4853-b041-711fd1bcfbc1 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:35:11.360167 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-a9f17007-6e3f-4853-b041-711fd1bcfbc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:35:11.366883 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1107/2217] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:35:11 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 11:35:11.371843 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1111/2218] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:35:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 11:35:11.376348 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87162ad8-4626-4067-af69-6a6016c729a7 service cinder] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:35:11.383985 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f17007-6e3f-4853-b041-711fd1bcfbc1 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:35:11.385896 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-a9f17007-6e3f-4853-b041-711fd1bcfbc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:35:11.388927 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87162ad8-4626-4067-af69-6a6016c729a7 service cinder] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:35:11.393878 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cc408b-af30-41f2-b716-e531480bffab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:35:11.394701 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cc408b-af30-41f2-b716-e531480bffab admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:35:11.395042 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cc408b-af30-41f2-b716-e531480bffab admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:35:11.395392 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cc408b-af30-41f2-b716-e531480bffab admin admin] PATH_INFO: `/v3/domains` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:35:11.396079 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cc408b-af30-41f2-b716-e531480bffab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:35:11.396398 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cc408b-af30-41f2-b716-e531480bffab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:35:11.398013 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cc408b-af30-41f2-b716-e531480bffab admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:35:11.399548 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f17007-6e3f-4853-b041-711fd1bcfbc1 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:35:11.406659 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d578773-422b-4829-a92b-9ac802fb101e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:35:11.407424 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d578773-422b-4829-a92b-9ac802fb101e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:35:11.407702 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d578773-422b-4829-a92b-9ac802fb101e admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:35:11.407972 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d578773-422b-4829-a92b-9ac802fb101e admin admin] PATH_INFO: `/v3/users/c01600e9c46d4eb9a67c8e2070a11a9b` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:35:11.409126 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d578773-422b-4829-a92b-9ac802fb101e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c01600e9c46d4eb9a67c8e2070a11a9b)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:35:11.411097 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d578773-422b-4829-a92b-9ac802fb101e admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:35:11.413810 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1108/2219] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 24 11:35:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:35:11.418008 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cc408b-af30-41f2-b716-e531480bffab admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:35:11.430028 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cc408b-af30-41f2-b716-e531480bffab admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:35:11.435673 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d22544-187a-49cc-946d-7ba1aa66f9a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:35:11.436794 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:35:11.437106 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d22544-187a-49cc-946d-7ba1aa66f9a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:35:11.437924 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d22544-187a-49cc-946d-7ba1aa66f9a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:35:11.438615 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d22544-187a-49cc-946d-7ba1aa66f9a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:35:11.439481 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d22544-187a-49cc-946d-7ba1aa66f9a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:35:11.442333 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d22544-187a-49cc-946d-7ba1aa66f9a6 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:35:11.469147 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-0d578773-422b-4829-a92b-9ac802fb101e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c01600e9c46d4eb9a67c8e2070a11a9b'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:35:11.470472 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-0d578773-422b-4829-a92b-9ac802fb101e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c01600e9c46d4eb9a67c8e2070a11a9b'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:35:11.471393 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-0d578773-422b-4829-a92b-9ac802fb101e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c01600e9c46d4eb9a67c8e2070a11a9b'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:35:11.473642 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1109/2220] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 11:35:11 2022] POST /identity/v3/projects => generated 383 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 11:35:11.478602 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d22544-187a-49cc-946d-7ba1aa66f9a6 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:35:11.481119 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-84d22544-187a-49cc-946d-7ba1aa66f9a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:35:11.483767 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-0d578773-422b-4829-a92b-9ac802fb101e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c01600e9c46d4eb9a67c8e2070a11a9b'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:35:11.494338 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-0d578773-422b-4829-a92b-9ac802fb101e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c01600e9c46d4eb9a67c8e2070a11a9b'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:35:11.514302 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1112/2221] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 11:35:11 2022] DELETE /identity/v3/users/c01600e9c46d4eb9a67c8e2070a11a9b => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:35:11.518678 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294a8d61-576c-46b5-930d-265b05bf1c66 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:35:11.519066 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294a8d61-576c-46b5-930d-265b05bf1c66 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:35:11.519451 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294a8d61-576c-46b5-930d-265b05bf1c66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:35:11.539760 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-294a8d61-576c-46b5-930d-265b05bf1c66 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:35:11.541083 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-294a8d61-576c-46b5-930d-265b05bf1c66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:35:11.570789 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d22544-187a-49cc-946d-7ba1aa66f9a6 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:35:11.619609 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1113/2222] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:35:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 11:35:11.641736 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294a8d61-576c-46b5-930d-265b05bf1c66 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:35:11.643358 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-294a8d61-576c-46b5-930d-265b05bf1c66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:35:11.650898 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80e3a01-8ca0-488a-aefe-66a78bfb8d3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:35:11.652062 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80e3a01-8ca0-488a-aefe-66a78bfb8d3a admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:35:11.652611 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80e3a01-8ca0-488a-aefe-66a78bfb8d3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:35:11.653123 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80e3a01-8ca0-488a-aefe-66a78bfb8d3a admin admin] PATH_INFO: `/v3/users` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:35:11.654139 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80e3a01-8ca0-488a-aefe-66a78bfb8d3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:35:11.657201 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80e3a01-8ca0-488a-aefe-66a78bfb8d3a admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:35:11.686532 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1110/2223] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 11:35:11 2022] POST /identity/v3/users => generated 292 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:35:11.689427 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80e3a01-8ca0-488a-aefe-66a78bfb8d3a admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:35:11.700435 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80e3a01-8ca0-488a-aefe-66a78bfb8d3a admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:35:11.705990 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da31419-a13b-4543-b2ab-7bd28832defe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:35:11.706856 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da31419-a13b-4543-b2ab-7bd28832defe admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:35:11.707130 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da31419-a13b-4543-b2ab-7bd28832defe admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:35:11.707408 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da31419-a13b-4543-b2ab-7bd28832defe admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:35:11.708064 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da31419-a13b-4543-b2ab-7bd28832defe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:35:11.709816 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da31419-a13b-4543-b2ab-7bd28832defe admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:35:11.721656 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1111/2224] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:35:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:35:11.725027 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294a8d61-576c-46b5-930d-265b05bf1c66 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:35:11.725544 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da31419-a13b-4543-b2ab-7bd28832defe admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:35:11.728901 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c771b5c3-a516-4022-ad88-11cdebf466cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2d061d25d83443c9232218c90792d51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:35:11.729536 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c771b5c3-a516-4022-ad88-11cdebf466cd service neutron] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:35:11.729812 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c771b5c3-a516-4022-ad88-11cdebf466cd service neutron] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:35:11.730082 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c771b5c3-a516-4022-ad88-11cdebf466cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:35:11.735394 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da31419-a13b-4543-b2ab-7bd28832defe admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:35:11.739620 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c771b5c3-a516-4022-ad88-11cdebf466cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:35:11.740156 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3efb20-909e-4316-8d0b-699fbf08bdcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:35:11.740765 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3efb20-909e-4316-8d0b-699fbf08bdcd admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:35:11.741061 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3efb20-909e-4316-8d0b-699fbf08bdcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:35:11.741168 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c771b5c3-a516-4022-ad88-11cdebf466cd service neutron] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:35:11.741322 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3efb20-909e-4316-8d0b-699fbf08bdcd admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:35:11.742167 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3efb20-909e-4316-8d0b-699fbf08bdcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:35:11.743800 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3efb20-909e-4316-8d0b-699fbf08bdcd admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:35:11.751020 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1114/2225] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:35:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 11:35:11.756620 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1112/2226] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:35:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 11:35:11.760731 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c771b5c3-a516-4022-ad88-11cdebf466cd service neutron] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:35:11.770420 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c771b5c3-a516-4022-ad88-11cdebf466cd service neutron] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:35:11.775109 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd0053a-91d5-47a3-bd7a-cf9b42c742ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:35:11.775755 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd0053a-91d5-47a3-bd7a-cf9b42c742ad admin admin] REQUEST_METHOD: `PUT` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:35:11.776004 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd0053a-91d5-47a3-bd7a-cf9b42c742ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:35:11.776275 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd0053a-91d5-47a3-bd7a-cf9b42c742ad admin admin] PATH_INFO: `/v3/projects/f68989e15a6345dea2233637178502c1/users/c437b4066eb24573aec1a504cd838264/roles/27e3e65e24df4b86b0d3d18d3212101d` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:35:11.795868 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd0053a-91d5-47a3-bd7a-cf9b42c742ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=f68989e15a6345dea2233637178502c1, user_id=c437b4066eb24573aec1a504cd838264, role_id=27e3e65e24df4b86b0d3d18d3212101d)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:35:11.798623 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd0053a-91d5-47a3-bd7a-cf9b42c742ad admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:35:11.815124 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1115/2227] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 11:35:11 2022] PUT /identity/v3/projects/f68989e15a6345dea2233637178502c1/users/c437b4066eb24573aec1a504cd838264/roles/27e3e65e24df4b86b0d3d18d3212101d => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 11:35:11.820348 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b9c815-9c32-4981-a783-cadf09b71213 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:35:11.820733 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b9c815-9c32-4981-a783-cadf09b71213 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:35:11.820916 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b9c815-9c32-4981-a783-cadf09b71213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:35:11.840820 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-a4b9c815-9c32-4981-a783-cadf09b71213 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:35:11.842040 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-a4b9c815-9c32-4981-a783-cadf09b71213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:35:11.864652 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:35:11.907010 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1113/2228] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:35:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:35:11.917408 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd0053a-91d5-47a3-bd7a-cf9b42c742ad admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:35:11.918879 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-7fd0053a-91d5-47a3-bd7a-cf9b42c742ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:35:11.938698 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:DELETE=8,keystone:SELECT=90,keystone:INSERT=2 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:35:11.982054 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd0053a-91d5-47a3-bd7a-cf9b42c742ad admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:35:11.986282 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c13a110-fb5d-4e5f-b1df-34929665bf6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2d061d25d83443c9232218c90792d51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:35:11.986936 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c13a110-fb5d-4e5f-b1df-34929665bf6a service neutron] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:35:11.987213 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c13a110-fb5d-4e5f-b1df-34929665bf6a service neutron] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:35:11.987487 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c13a110-fb5d-4e5f-b1df-34929665bf6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:35:11.997229 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c13a110-fb5d-4e5f-b1df-34929665bf6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:35:11.998745 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c13a110-fb5d-4e5f-b1df-34929665bf6a service neutron] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:35:12.008963 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1116/2229] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:35:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:35:12.076651 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b9c815-9c32-4981-a783-cadf09b71213 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:35:12.078287 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-a4b9c815-9c32-4981-a783-cadf09b71213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:35:12.092561 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b9c815-9c32-4981-a783-cadf09b71213 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:35:12.103555 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453df272-1e45-4cd7-b6c4-3823e31c487a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:35:12.104212 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453df272-1e45-4cd7-b6c4-3823e31c487a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:35:12.104489 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453df272-1e45-4cd7-b6c4-3823e31c487a admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:35:12.104764 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453df272-1e45-4cd7-b6c4-3823e31c487a admin admin] PATH_INFO: `/v3/projects/c88497bf710d4ad18b80ddf810626f6a` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:35:12.106106 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453df272-1e45-4cd7-b6c4-3823e31c487a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c88497bf710d4ad18b80ddf810626f6a)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:35:12.108077 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453df272-1e45-4cd7-b6c4-3823e31c487a admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:35:12.159347 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-453df272-1e45-4cd7-b6c4-3823e31c487a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c88497bf710d4ad18b80ddf810626f6a', 'request_id': 'req-453df272-1e45-4cd7-b6c4-3823e31c487a'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:35:12.165701 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-453df272-1e45-4cd7-b6c4-3823e31c487a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c88497bf710d4ad18b80ddf810626f6a', 'request_id': 'req-453df272-1e45-4cd7-b6c4-3823e31c487a'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:35:12.171898 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-453df272-1e45-4cd7-b6c4-3823e31c487a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c88497bf710d4ad18b80ddf810626f6a', 'request_id': 'req-453df272-1e45-4cd7-b6c4-3823e31c487a'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:35:12.185511 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-453df272-1e45-4cd7-b6c4-3823e31c487a admin admin] The token cache is being invalidate because project c88497bf710d4ad18b80ddf810626f6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:35:12.185804 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-453df272-1e45-4cd7-b6c4-3823e31c487a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:35:12.186519 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-453df272-1e45-4cd7-b6c4-3823e31c487a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:35:12.188295 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1114/2230] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 11:35:12 2022] DELETE /identity/v3/projects/c88497bf710d4ad18b80ddf810626f6a => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:35:12.194104 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1ec4ab-4886-4ef1-9105-a151021e240a None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:35:12.194492 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1ec4ab-4886-4ef1-9105-a151021e240a None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:35:12.194762 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1ec4ab-4886-4ef1-9105-a151021e240a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:35:12.238244 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-ef1ec4ab-4886-4ef1-9105-a151021e240a None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:35:12.239610 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-ef1ec4ab-4886-4ef1-9105-a151021e240a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:35:12.308380 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1117/2231] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:35:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:35:12.316740 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d3f81c-86ab-40ac-852f-33259528365e None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:35:12.317277 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d3f81c-86ab-40ac-852f-33259528365e None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:35:12.317277 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d3f81c-86ab-40ac-852f-33259528365e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:35:12.338534 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-f9d3f81c-86ab-40ac-852f-33259528365e None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:35:12.342641 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-f9d3f81c-86ab-40ac-852f-33259528365e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:35:12.350964 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1115/2232] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:35:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:35:12.355208 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1ec4ab-4886-4ef1-9105-a151021e240a None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:35:12.365166 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1ec4ab-4886-4ef1-9105-a151021e240a None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:35:12.374211 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3562d69-a885-4940-9069-eb821cc8e705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:35:12.374894 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3562d69-a885-4940-9069-eb821cc8e705 admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:35:12.375273 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3562d69-a885-4940-9069-eb821cc8e705 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:35:12.375705 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3562d69-a885-4940-9069-eb821cc8e705 admin admin] PATH_INFO: `/v3/domains` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:35:12.376820 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3562d69-a885-4940-9069-eb821cc8e705 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:35:12.377218 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3562d69-a885-4940-9069-eb821cc8e705 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:35:12.380807 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3562d69-a885-4940-9069-eb821cc8e705 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:35:12.395100 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1118/2233] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 24 11:35:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:35:12.399502 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d3f81c-86ab-40ac-852f-33259528365e None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:35:12.413200 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d3f81c-86ab-40ac-852f-33259528365e None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:35:12.419704 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab360f4d-011b-458f-a62f-f8d1b0746f1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:35:12.420424 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab360f4d-011b-458f-a62f-f8d1b0746f1c admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:35:12.420709 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab360f4d-011b-458f-a62f-f8d1b0746f1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:35:12.420982 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab360f4d-011b-458f-a62f-f8d1b0746f1c admin admin] PATH_INFO: `/v3/projects` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:35:12.421631 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab360f4d-011b-458f-a62f-f8d1b0746f1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:35:12.423616 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab360f4d-011b-458f-a62f-f8d1b0746f1c admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:35:12.456706 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1116/2234] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 11:35:12 2022] POST /identity/v3/projects => generated 385 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:35:12.457928 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3562d69-a885-4940-9069-eb821cc8e705 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:35:12.470786 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3562d69-a885-4940-9069-eb821cc8e705 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:35:12.542382 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe0fabd-8e90-4145-8c64-7ad47dd753ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:35:12.543248 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe0fabd-8e90-4145-8c64-7ad47dd753ce admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:35:12.543526 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe0fabd-8e90-4145-8c64-7ad47dd753ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:35:12.543798 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe0fabd-8e90-4145-8c64-7ad47dd753ce admin admin] PATH_INFO: `/v3/users` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:35:12.544427 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe0fabd-8e90-4145-8c64-7ad47dd753ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:35:12.546482 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe0fabd-8e90-4145-8c64-7ad47dd753ce admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:35:12.573936 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1119/2235] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 11:35:12 2022] POST /identity/v3/users => generated 293 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:35:12.575276 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab360f4d-011b-458f-a62f-f8d1b0746f1c admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:35:12.586064 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab360f4d-011b-458f-a62f-f8d1b0746f1c admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:35:12.590761 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a28d4c-3564-4256-ae17-694fd8d3540e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:35:12.591367 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a28d4c-3564-4256-ae17-694fd8d3540e admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:35:12.591647 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a28d4c-3564-4256-ae17-694fd8d3540e admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:35:12.591919 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a28d4c-3564-4256-ae17-694fd8d3540e admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:35:12.592584 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a28d4c-3564-4256-ae17-694fd8d3540e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:35:12.594172 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a28d4c-3564-4256-ae17-694fd8d3540e admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:35:12.607167 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1117/2236] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:35:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:35:12.608607 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe0fabd-8e90-4145-8c64-7ad47dd753ce admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:35:12.619601 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe0fabd-8e90-4145-8c64-7ad47dd753ce admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:35:12.625344 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78345bc-d20f-4b95-a6a4-46e06e0e3f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:35:12.626130 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78345bc-d20f-4b95-a6a4-46e06e0e3f96 admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:35:12.626496 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78345bc-d20f-4b95-a6a4-46e06e0e3f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:35:12.626876 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78345bc-d20f-4b95-a6a4-46e06e0e3f96 admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:35:12.627928 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78345bc-d20f-4b95-a6a4-46e06e0e3f96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:35:12.629666 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78345bc-d20f-4b95-a6a4-46e06e0e3f96 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:35:12.641734 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1120/2237] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:35:12 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 11:35:12.646077 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a28d4c-3564-4256-ae17-694fd8d3540e admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:35:12.656295 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a28d4c-3564-4256-ae17-694fd8d3540e admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:35:12.661353 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7de396b-f66c-43fa-b6e0-85272865b449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:35:12.661679 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7de396b-f66c-43fa-b6e0-85272865b449 admin admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:35:12.661938 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7de396b-f66c-43fa-b6e0-85272865b449 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:35:12.662209 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7de396b-f66c-43fa-b6e0-85272865b449 admin admin] PATH_INFO: `/v3/projects/aa8e72a719aa4777987b152cd71f3c72/users/45d6eb7fa01a4f61ba190e456d1e4cbd/roles/27e3e65e24df4b86b0d3d18d3212101d` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:35:12.677673 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7de396b-f66c-43fa-b6e0-85272865b449 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa8e72a719aa4777987b152cd71f3c72, user_id=45d6eb7fa01a4f61ba190e456d1e4cbd, role_id=27e3e65e24df4b86b0d3d18d3212101d)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:35:12.680456 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7de396b-f66c-43fa-b6e0-85272865b449 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:35:12.695156 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1118/2238] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 11:35:12 2022] PUT /identity/v3/projects/aa8e72a719aa4777987b152cd71f3c72/users/45d6eb7fa01a4f61ba190e456d1e4cbd/roles/27e3e65e24df4b86b0d3d18d3212101d => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 11:35:12.705643 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c846153-8bd1-4823-94ad-547ac7201d11 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:35:12.705826 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c846153-8bd1-4823-94ad-547ac7201d11 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:35:12.706774 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c846153-8bd1-4823-94ad-547ac7201d11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:35:12.722106 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460b5017-c744-4282-9502-e7017ba78372 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:35:12.722555 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460b5017-c744-4282-9502-e7017ba78372 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:35:12.723030 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460b5017-c744-4282-9502-e7017ba78372 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:35:12.754294 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-7c846153-8bd1-4823-94ad-547ac7201d11 None None] MFA Rules not processed for user `45d6eb7fa01a4f61ba190e456d1e4cbd`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:35:12.755555 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-7c846153-8bd1-4823-94ad-547ac7201d11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:35:12.768009 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-460b5017-c744-4282-9502-e7017ba78372 None None] MFA Rules not processed for user `c437b4066eb24573aec1a504cd838264`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:35:12.768219 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:35:12.769879 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-460b5017-c744-4282-9502-e7017ba78372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:35:12.816996 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:35:12.855960 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1119/2239] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:35:12 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:35:12.867656 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460b5017-c744-4282-9502-e7017ba78372 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:35:12.869169 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-460b5017-c744-4282-9502-e7017ba78372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:35:12.895214 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1121/2240] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:35:12 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 11:35:12.919435 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c846153-8bd1-4823-94ad-547ac7201d11 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:35:12.920918 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-7c846153-8bd1-4823-94ad-547ac7201d11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:35:12.971309 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460b5017-c744-4282-9502-e7017ba78372 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:35:12.975615 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e05d028-1039-407c-84d4-50a39de4f7cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92862b76ba3b4513b5dc5b5c962faac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:35:12.976349 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e05d028-1039-407c-84d4-50a39de4f7cf service cinder] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:35:12.976826 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e05d028-1039-407c-84d4-50a39de4f7cf service cinder] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:35:12.977111 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e05d028-1039-407c-84d4-50a39de4f7cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:35:12.986956 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e05d028-1039-407c-84d4-50a39de4f7cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:35:12.988632 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e05d028-1039-407c-84d4-50a39de4f7cf service cinder] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:35:12.998876 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1120/2241] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:35:12 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:35:13.005375 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c846153-8bd1-4823-94ad-547ac7201d11 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:35:13.009353 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0617731-b9ae-45d0-a268-e331c89ab2bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92862b76ba3b4513b5dc5b5c962faac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:35:13.009974 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0617731-b9ae-45d0-a268-e331c89ab2bf service cinder] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:35:13.010248 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0617731-b9ae-45d0-a268-e331c89ab2bf service cinder] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:35:13.010551 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0617731-b9ae-45d0-a268-e331c89ab2bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:35:13.020655 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0617731-b9ae-45d0-a268-e331c89ab2bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:35:13.022751 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0617731-b9ae-45d0-a268-e331c89ab2bf service cinder] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:35:13.035702 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1122/2242] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:35:12 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:35:14.379466 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29121a12-4ea3-4fd8-a253-90fc61f9b7d2 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:35:14.380000 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29121a12-4ea3-4fd8-a253-90fc61f9b7d2 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:35:14.380121 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29121a12-4ea3-4fd8-a253-90fc61f9b7d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:35:14.401581 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-29121a12-4ea3-4fd8-a253-90fc61f9b7d2 None None] MFA Rules not processed for user `c437b4066eb24573aec1a504cd838264`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:35:14.403005 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-29121a12-4ea3-4fd8-a253-90fc61f9b7d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:35:14.410254 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1121/2243] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:35:14 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:35:15.670577 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0617731-b9ae-45d0-a268-e331c89ab2bf service cinder] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:35:15.739408 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0617731-b9ae-45d0-a268-e331c89ab2bf service cinder] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:35:15.744547 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49613bf1-a93d-4b29-a512-59022129b0ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:35:15.745169 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49613bf1-a93d-4b29-a512-59022129b0ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:35:15.745441 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49613bf1-a93d-4b29-a512-59022129b0ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:35:15.745711 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49613bf1-a93d-4b29-a512-59022129b0ab admin admin] PATH_INFO: `/v3/users/45d6eb7fa01a4f61ba190e456d1e4cbd` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:35:15.746955 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49613bf1-a93d-4b29-a512-59022129b0ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=45d6eb7fa01a4f61ba190e456d1e4cbd)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:35:15.748898 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49613bf1-a93d-4b29-a512-59022129b0ab admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:35:15.804003 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-49613bf1-a93d-4b29-a512-59022129b0ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45d6eb7fa01a4f61ba190e456d1e4cbd'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:35:15.804651 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-49613bf1-a93d-4b29-a512-59022129b0ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45d6eb7fa01a4f61ba190e456d1e4cbd'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:35:15.805268 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-49613bf1-a93d-4b29-a512-59022129b0ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45d6eb7fa01a4f61ba190e456d1e4cbd'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:35:15.815028 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-49613bf1-a93d-4b29-a512-59022129b0ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45d6eb7fa01a4f61ba190e456d1e4cbd'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:35:15.820390 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:35:15.825298 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-49613bf1-a93d-4b29-a512-59022129b0ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45d6eb7fa01a4f61ba190e456d1e4cbd'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:35:15.844240 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1123/2244] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 11:35:15 2022] DELETE /identity/v3/users/45d6eb7fa01a4f61ba190e456d1e4cbd => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:35:15.848780 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bb0333-d8b4-4b74-8806-09a453abf4e7 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:35:15.849249 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bb0333-d8b4-4b74-8806-09a453abf4e7 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:35:15.849340 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bb0333-d8b4-4b74-8806-09a453abf4e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:35:15.869565 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-b1bb0333-d8b4-4b74-8806-09a453abf4e7 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:35:15.870789 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-b1bb0333-d8b4-4b74-8806-09a453abf4e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:35:15.939859 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1122/2245] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:35:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:35:15.951895 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49613bf1-a93d-4b29-a512-59022129b0ab admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:35:15.953390 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-49613bf1-a93d-4b29-a512-59022129b0ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:35:16.029280 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49613bf1-a93d-4b29-a512-59022129b0ab admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:35:16.033493 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dd1d7b-c0b2-43d1-bdb5-0f432963e934 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2d061d25d83443c9232218c90792d51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:35:16.034252 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dd1d7b-c0b2-43d1-bdb5-0f432963e934 service neutron] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:35:16.034728 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dd1d7b-c0b2-43d1-bdb5-0f432963e934 service neutron] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:35:16.035051 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dd1d7b-c0b2-43d1-bdb5-0f432963e934 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:35:16.052933 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dd1d7b-c0b2-43d1-bdb5-0f432963e934 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:35:16.054296 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dd1d7b-c0b2-43d1-bdb5-0f432963e934 service neutron] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:35:16.067364 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1124/2246] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:35:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:35:16.607586 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bb0333-d8b4-4b74-8806-09a453abf4e7 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:35:16.609176 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-b1bb0333-d8b4-4b74-8806-09a453abf4e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:35:16.633115 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bb0333-d8b4-4b74-8806-09a453abf4e7 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:35:16.639654 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67906b88-a390-44ef-81f2-59f50621e3f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:35:16.640484 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67906b88-a390-44ef-81f2-59f50621e3f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:35:16.640952 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67906b88-a390-44ef-81f2-59f50621e3f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:35:16.641267 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67906b88-a390-44ef-81f2-59f50621e3f4 admin admin] PATH_INFO: `/v3/projects/aa8e72a719aa4777987b152cd71f3c72` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:35:16.643791 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67906b88-a390-44ef-81f2-59f50621e3f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa8e72a719aa4777987b152cd71f3c72)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:35:16.646483 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67906b88-a390-44ef-81f2-59f50621e3f4 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:35:16.702406 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-67906b88-a390-44ef-81f2-59f50621e3f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa8e72a719aa4777987b152cd71f3c72', 'request_id': 'req-67906b88-a390-44ef-81f2-59f50621e3f4'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:35:16.708985 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-67906b88-a390-44ef-81f2-59f50621e3f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa8e72a719aa4777987b152cd71f3c72', 'request_id': 'req-67906b88-a390-44ef-81f2-59f50621e3f4'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:35:16.715235 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-67906b88-a390-44ef-81f2-59f50621e3f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa8e72a719aa4777987b152cd71f3c72', 'request_id': 'req-67906b88-a390-44ef-81f2-59f50621e3f4'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:35:16.720257 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:35:16.735969 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-67906b88-a390-44ef-81f2-59f50621e3f4 admin admin] The token cache is being invalidate because project aa8e72a719aa4777987b152cd71f3c72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:35:16.737169 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-67906b88-a390-44ef-81f2-59f50621e3f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:35:16.738307 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-67906b88-a390-44ef-81f2-59f50621e3f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:35:16.744756 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1123/2247] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 11:35:16 2022] DELETE /identity/v3/projects/aa8e72a719aa4777987b152cd71f3c72 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:35:16.747415 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5003e05d-bd76-4024-ad26-11ff146ae788 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:35:16.748303 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5003e05d-bd76-4024-ad26-11ff146ae788 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:35:16.748603 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5003e05d-bd76-4024-ad26-11ff146ae788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:35:16.769951 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-5003e05d-bd76-4024-ad26-11ff146ae788 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:35:16.771313 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-5003e05d-bd76-4024-ad26-11ff146ae788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:35:16.841236 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1125/2248] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:35:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:35:16.849490 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a1eb91-c46a-4ffb-a321-bbd024f2300b None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:35:16.850134 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a1eb91-c46a-4ffb-a321-bbd024f2300b None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:35:16.850134 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a1eb91-c46a-4ffb-a321-bbd024f2300b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:35:16.873431 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-a1a1eb91-c46a-4ffb-a321-bbd024f2300b None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:35:16.874751 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-a1a1eb91-c46a-4ffb-a321-bbd024f2300b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:35:16.884175 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1124/2249] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:35:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:35:16.888724 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5003e05d-bd76-4024-ad26-11ff146ae788 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:35:16.899079 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5003e05d-bd76-4024-ad26-11ff146ae788 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:35:16.904561 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23846439-0135-43a5-980f-003c93498309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:35:16.905177 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23846439-0135-43a5-980f-003c93498309 admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:35:16.905459 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23846439-0135-43a5-980f-003c93498309 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:35:16.905725 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23846439-0135-43a5-980f-003c93498309 admin admin] PATH_INFO: `/v3/domains` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:35:16.906412 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23846439-0135-43a5-980f-003c93498309 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:35:16.907141 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23846439-0135-43a5-980f-003c93498309 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:35:16.908929 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23846439-0135-43a5-980f-003c93498309 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:35:16.928115 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1126/2250] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 24 11:35:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:35:16.929657 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a1eb91-c46a-4ffb-a321-bbd024f2300b None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:35:16.942532 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a1eb91-c46a-4ffb-a321-bbd024f2300b None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:35:16.949486 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714317f3-32c1-49aa-bc89-7dbdff9aabe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:35:16.950105 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714317f3-32c1-49aa-bc89-7dbdff9aabe7 admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:35:16.950579 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714317f3-32c1-49aa-bc89-7dbdff9aabe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:35:16.950848 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714317f3-32c1-49aa-bc89-7dbdff9aabe7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:35:16.951483 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714317f3-32c1-49aa-bc89-7dbdff9aabe7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:35:16.953426 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714317f3-32c1-49aa-bc89-7dbdff9aabe7 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:35:16.982783 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1125/2251] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 11:35:16 2022] POST /identity/v3/projects => generated 373 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 11:35:16.987169 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23846439-0135-43a5-980f-003c93498309 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:35:16.997514 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23846439-0135-43a5-980f-003c93498309 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:35:17.058950 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5233cebf-942e-45e0-8e74-24cffb99c5a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:35:17.059578 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5233cebf-942e-45e0-8e74-24cffb99c5a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:35:17.059859 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5233cebf-942e-45e0-8e74-24cffb99c5a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:35:17.060153 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5233cebf-942e-45e0-8e74-24cffb99c5a4 admin admin] PATH_INFO: `/v3/users` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:35:17.060793 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5233cebf-942e-45e0-8e74-24cffb99c5a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:35:17.062777 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5233cebf-942e-45e0-8e74-24cffb99c5a4 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:35:17.075688 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:35:17.092799 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1127/2252] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 11:35:16 2022] POST /identity/v3/users => generated 287 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 11:35:17.094306 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714317f3-32c1-49aa-bc89-7dbdff9aabe7 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:35:17.113094 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714317f3-32c1-49aa-bc89-7dbdff9aabe7 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:35:17.118862 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff233c77-c19a-471c-8e79-687e009c1653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:35:17.119486 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff233c77-c19a-471c-8e79-687e009c1653 admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:35:17.119897 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff233c77-c19a-471c-8e79-687e009c1653 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:35:17.120178 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff233c77-c19a-471c-8e79-687e009c1653 admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:35:17.120851 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff233c77-c19a-471c-8e79-687e009c1653 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:35:17.122606 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff233c77-c19a-471c-8e79-687e009c1653 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:35:17.134282 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1126/2253] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:35:17 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:35:17.138725 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5233cebf-942e-45e0-8e74-24cffb99c5a4 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:35:17.149584 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5233cebf-942e-45e0-8e74-24cffb99c5a4 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:35:17.155688 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568a9a61-35af-4ff6-a233-95a622c996d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:35:17.156312 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568a9a61-35af-4ff6-a233-95a622c996d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:35:17.156587 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568a9a61-35af-4ff6-a233-95a622c996d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:35:17.156886 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568a9a61-35af-4ff6-a233-95a622c996d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:35:17.157549 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568a9a61-35af-4ff6-a233-95a622c996d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:35:17.159245 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568a9a61-35af-4ff6-a233-95a622c996d5 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:35:17.171408 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1128/2254] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:35:17 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 11:35:17.176054 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff233c77-c19a-471c-8e79-687e009c1653 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:35:17.186178 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff233c77-c19a-471c-8e79-687e009c1653 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:35:17.191215 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68b2049-bc9e-4a05-8253-e0afbab61d95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:35:17.191933 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68b2049-bc9e-4a05-8253-e0afbab61d95 admin admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:35:17.192215 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68b2049-bc9e-4a05-8253-e0afbab61d95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:35:17.192481 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68b2049-bc9e-4a05-8253-e0afbab61d95 admin admin] PATH_INFO: `/v3/projects/b378ba246e7e4fccbd2f530c561915d3/users/a045373a6fe940aabb7a6427008a3cbe/roles/27e3e65e24df4b86b0d3d18d3212101d` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:35:17.209798 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68b2049-bc9e-4a05-8253-e0afbab61d95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b378ba246e7e4fccbd2f530c561915d3, user_id=a045373a6fe940aabb7a6427008a3cbe, role_id=27e3e65e24df4b86b0d3d18d3212101d)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:35:17.212675 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68b2049-bc9e-4a05-8253-e0afbab61d95 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:35:17.226633 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1127/2255] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 11:35:17 2022] PUT /identity/v3/projects/b378ba246e7e4fccbd2f530c561915d3/users/a045373a6fe940aabb7a6427008a3cbe/roles/27e3e65e24df4b86b0d3d18d3212101d => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:35:17.237474 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480e522c-d158-460e-a3f6-ce19a7c8dc08 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:35:17.237765 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480e522c-d158-460e-a3f6-ce19a7c8dc08 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:35:17.238039 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480e522c-d158-460e-a3f6-ce19a7c8dc08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:35:17.268110 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-480e522c-d158-460e-a3f6-ce19a7c8dc08 None None] MFA Rules not processed for user `a045373a6fe940aabb7a6427008a3cbe`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:35:17.269366 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-480e522c-d158-460e-a3f6-ce19a7c8dc08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:35:17.346692 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1129/2256] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:35:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:35:17.358801 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68b2049-bc9e-4a05-8253-e0afbab61d95 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:35:17.360750 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-f68b2049-bc9e-4a05-8253-e0afbab61d95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:35:17.422664 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68b2049-bc9e-4a05-8253-e0afbab61d95 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:35:17.426516 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1677d057-860b-4a8a-9493-6c686611eae1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92862b76ba3b4513b5dc5b5c962faac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:35:17.427148 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1677d057-860b-4a8a-9493-6c686611eae1 service cinder] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:35:17.427423 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1677d057-860b-4a8a-9493-6c686611eae1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:35:17.427690 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1677d057-860b-4a8a-9493-6c686611eae1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:35:17.436339 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1677d057-860b-4a8a-9493-6c686611eae1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:35:17.437812 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1677d057-860b-4a8a-9493-6c686611eae1 service cinder] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:35:17.451359 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1128/2257] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:35:17 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:35:17.488882 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480e522c-d158-460e-a3f6-ce19a7c8dc08 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:35:17.561317 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480e522c-d158-460e-a3f6-ce19a7c8dc08 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:35:17.566114 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6960df10-4972-42e1-bdac-3e9ccfe77cc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:35:17.566802 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6960df10-4972-42e1-bdac-3e9ccfe77cc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:35:17.567078 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6960df10-4972-42e1-bdac-3e9ccfe77cc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:35:17.567352 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6960df10-4972-42e1-bdac-3e9ccfe77cc4 admin admin] PATH_INFO: `/v3/users/a045373a6fe940aabb7a6427008a3cbe` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:35:17.568527 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6960df10-4972-42e1-bdac-3e9ccfe77cc4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a045373a6fe940aabb7a6427008a3cbe)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:35:17.570530 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6960df10-4972-42e1-bdac-3e9ccfe77cc4 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:35:17.632246 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-6960df10-4972-42e1-bdac-3e9ccfe77cc4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a045373a6fe940aabb7a6427008a3cbe'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:35:17.632957 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-6960df10-4972-42e1-bdac-3e9ccfe77cc4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a045373a6fe940aabb7a6427008a3cbe'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:35:17.633554 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-6960df10-4972-42e1-bdac-3e9ccfe77cc4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a045373a6fe940aabb7a6427008a3cbe'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:35:17.643381 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-6960df10-4972-42e1-bdac-3e9ccfe77cc4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a045373a6fe940aabb7a6427008a3cbe'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:35:17.651567 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-6960df10-4972-42e1-bdac-3e9ccfe77cc4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a045373a6fe940aabb7a6427008a3cbe'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:35:17.663803 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:35:17.675637 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1130/2258] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 11:35:17 2022] DELETE /identity/v3/users/a045373a6fe940aabb7a6427008a3cbe => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:35:17.681652 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3256fefa-e86a-40cc-8a5c-88fc7287d629 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:35:17.682631 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3256fefa-e86a-40cc-8a5c-88fc7287d629 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:35:17.683970 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3256fefa-e86a-40cc-8a5c-88fc7287d629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:35:17.762459 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-3256fefa-e86a-40cc-8a5c-88fc7287d629 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:35:17.762459 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-3256fefa-e86a-40cc-8a5c-88fc7287d629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:35:17.848485 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1129/2259] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:35:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:35:17.859488 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6960df10-4972-42e1-bdac-3e9ccfe77cc4 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:35:17.861131 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-6960df10-4972-42e1-bdac-3e9ccfe77cc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:35:17.925717 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6960df10-4972-42e1-bdac-3e9ccfe77cc4 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:35:17.930002 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e80399-65cb-4483-bd40-e7c18ee6e085 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2d061d25d83443c9232218c90792d51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:35:17.930666 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e80399-65cb-4483-bd40-e7c18ee6e085 service neutron] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:35:17.930937 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e80399-65cb-4483-bd40-e7c18ee6e085 service neutron] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:35:17.931209 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e80399-65cb-4483-bd40-e7c18ee6e085 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:35:17.940806 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e80399-65cb-4483-bd40-e7c18ee6e085 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:35:17.942516 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e80399-65cb-4483-bd40-e7c18ee6e085 service neutron] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:35:17.952424 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1131/2260] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:35:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:35:18.256059 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3256fefa-e86a-40cc-8a5c-88fc7287d629 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:35:18.258542 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-3256fefa-e86a-40cc-8a5c-88fc7287d629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:35:18.272905 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3256fefa-e86a-40cc-8a5c-88fc7287d629 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:35:18.284905 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a189352-4a51-4fb5-b32e-9512f5c555d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:35:18.285510 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a189352-4a51-4fb5-b32e-9512f5c555d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:35:18.285791 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a189352-4a51-4fb5-b32e-9512f5c555d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:35:18.286057 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a189352-4a51-4fb5-b32e-9512f5c555d9 admin admin] PATH_INFO: `/v3/projects/b378ba246e7e4fccbd2f530c561915d3` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:35:18.287789 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a189352-4a51-4fb5-b32e-9512f5c555d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b378ba246e7e4fccbd2f530c561915d3)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:35:18.290255 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a189352-4a51-4fb5-b32e-9512f5c555d9 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:35:18.328752 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:35:18.343694 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-1a189352-4a51-4fb5-b32e-9512f5c555d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b378ba246e7e4fccbd2f530c561915d3', 'request_id': 'req-1a189352-4a51-4fb5-b32e-9512f5c555d9'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:35:18.351023 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-1a189352-4a51-4fb5-b32e-9512f5c555d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b378ba246e7e4fccbd2f530c561915d3', 'request_id': 'req-1a189352-4a51-4fb5-b32e-9512f5c555d9'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:35:18.357693 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-1a189352-4a51-4fb5-b32e-9512f5c555d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b378ba246e7e4fccbd2f530c561915d3', 'request_id': 'req-1a189352-4a51-4fb5-b32e-9512f5c555d9'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:35:18.372407 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-1a189352-4a51-4fb5-b32e-9512f5c555d9 admin admin] The token cache is being invalidate because project b378ba246e7e4fccbd2f530c561915d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:35:18.372696 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-1a189352-4a51-4fb5-b32e-9512f5c555d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:35:18.373384 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-1a189352-4a51-4fb5-b32e-9512f5c555d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:35:18.382434 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1130/2261] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 11:35:18 2022] DELETE /identity/v3/projects/b378ba246e7e4fccbd2f530c561915d3 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:35:27.947917 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:35:28.368873 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=13,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:35:28.782981 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56301fc3-9213-482b-b3b1-64470eb5b7c9 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:35:28.783260 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56301fc3-9213-482b-b3b1-64470eb5b7c9 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:35:28.783721 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56301fc3-9213-482b-b3b1-64470eb5b7c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:35:28.812341 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-56301fc3-9213-482b-b3b1-64470eb5b7c9 None None] MFA Rules not processed for user `c53eb370dc294248b3be2248570d1b04`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:35:28.813656 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-56301fc3-9213-482b-b3b1-64470eb5b7c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:35:28.886157 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1132/2262] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:35:28 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:35:29.441502 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82714f7d-b53b-4dd4-a1b1-7459b2936cb4 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:35:29.442395 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82714f7d-b53b-4dd4-a1b1-7459b2936cb4 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:35:29.442956 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82714f7d-b53b-4dd4-a1b1-7459b2936cb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:35:29.463062 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-82714f7d-b53b-4dd4-a1b1-7459b2936cb4 None None] MFA Rules not processed for user `a5915030f01941fc89f92228ff57c7f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:35:29.465179 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-82714f7d-b53b-4dd4-a1b1-7459b2936cb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:35:29.532723 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1131/2263] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Aug 24 11:35:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:35:29.546935 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56301fc3-9213-482b-b3b1-64470eb5b7c9 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:35:29.548761 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-56301fc3-9213-482b-b3b1-64470eb5b7c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:35:29.627634 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56301fc3-9213-482b-b3b1-64470eb5b7c9 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:35:29.633063 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bf0b89-e96a-45d1-a53a-5bf9e7bb2cc3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1069558c085449f9e4c9f06013b2a85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:35:29.633984 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bf0b89-e96a-45d1-a53a-5bf9e7bb2cc3 service swift] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:35:29.634275 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bf0b89-e96a-45d1-a53a-5bf9e7bb2cc3 service swift] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:35:29.634694 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bf0b89-e96a-45d1-a53a-5bf9e7bb2cc3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:35:29.644666 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bf0b89-e96a-45d1-a53a-5bf9e7bb2cc3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:35:29.646344 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bf0b89-e96a-45d1-a53a-5bf9e7bb2cc3 service swift] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:35:29.655823 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1133/2264] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Aug 24 11:35:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 11:35:33.766493 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82714f7d-b53b-4dd4-a1b1-7459b2936cb4 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:35:33.768668 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-82714f7d-b53b-4dd4-a1b1-7459b2936cb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:35:33.904813 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82714f7d-b53b-4dd4-a1b1-7459b2936cb4 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:35:33.915849 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c703e4e3-f417-4e65-ab07-a4967a895f58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2d061d25d83443c9232218c90792d51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:35:33.919352 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c703e4e3-f417-4e65-ab07-a4967a895f58 service neutron] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:35:33.919846 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c703e4e3-f417-4e65-ab07-a4967a895f58 service neutron] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:35:33.920455 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c703e4e3-f417-4e65-ab07-a4967a895f58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:35:33.924981 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-c703e4e3-f417-4e65-ab07-a4967a895f58 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:35:34.109268 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c703e4e3-f417-4e65-ab07-a4967a895f58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:35:34.112365 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c703e4e3-f417-4e65-ab07-a4967a895f58 service neutron] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:35:34.131033 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1132/2265] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:35:33 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:35:34.767096 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a48677-e187-4cbf-9bb6-dca359a2fab0 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:35:34.767685 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a48677-e187-4cbf-9bb6-dca359a2fab0 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:35:34.767685 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a48677-e187-4cbf-9bb6-dca359a2fab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:35:34.836485 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-e9a48677-e187-4cbf-9bb6-dca359a2fab0 None None] MFA Rules not processed for user `5bfd72d5fe714437be00c7c5533115b4`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:35:34.846843 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-e9a48677-e187-4cbf-9bb6-dca359a2fab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:35:35.025563 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1134/2266] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:35:34 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:35:44.120607 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=75 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:35:44.992297 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=82 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:35:48.413107 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d1fa6e-233a-49d4-840e-822accdf32a4 None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:35:48.414016 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d1fa6e-233a-49d4-840e-822accdf32a4 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:35:48.414289 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d1fa6e-233a-49d4-840e-822accdf32a4 None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:35:48.415714 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1133/2267] 10.222.0.27 () {54 vars in 921 bytes} [Wed Aug 24 11:35:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:35:48.422265 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e9f8a4-a7d9-48a4-a3f6-a067d0f9e62f None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:35:48.422805 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e9f8a4-a7d9-48a4-a3f6-a067d0f9e62f None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:35:48.423006 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e9f8a4-a7d9-48a4-a3f6-a067d0f9e62f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:35:48.444993 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-09e9f8a4-a7d9-48a4-a3f6-a067d0f9e62f None None] MFA Rules not processed for user `282ec32864d046b2bea170f6a3845cc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:35:48.446290 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-09e9f8a4-a7d9-48a4-a3f6-a067d0f9e62f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:35:48.515764 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1135/2268] 10.222.0.27 () {58 vars in 1018 bytes} [Wed Aug 24 11:35:48 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:35:48.528408 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d1fa6e-233a-49d4-840e-822accdf32a4 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:35:48.530064 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-30d1fa6e-233a-49d4-840e-822accdf32a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:35:48.588637 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d1fa6e-233a-49d4-840e-822accdf32a4 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:35:48.592607 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9834fb54-0d11-48f8-8e90-281a5e0e6634 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abffba24649e49d28a01cbee51924ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:35:48.593204 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9834fb54-0d11-48f8-8e90-281a5e0e6634 service glance] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:35:48.593483 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9834fb54-0d11-48f8-8e90-281a5e0e6634 service glance] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:35:48.593743 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9834fb54-0d11-48f8-8e90-281a5e0e6634 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:35:48.603702 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9834fb54-0d11-48f8-8e90-281a5e0e6634 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:35:48.605138 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9834fb54-0d11-48f8-8e90-281a5e0e6634 service glance] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:35:48.615541 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1134/2269] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:35:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:35:48.691992 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b32a24e-9d62-4547-8105-98902ba947a1 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:35:48.692358 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b32a24e-9d62-4547-8105-98902ba947a1 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:35:48.692544 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b32a24e-9d62-4547-8105-98902ba947a1 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:35:48.694153 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1136/2270] 10.222.0.27 () {54 vars in 921 bytes} [Wed Aug 24 11:35:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:35:48.699064 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f822c7b4-c754-4343-a97d-e40f4be15160 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:35:48.699370 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f822c7b4-c754-4343-a97d-e40f4be15160 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:35:48.699636 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f822c7b4-c754-4343-a97d-e40f4be15160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:35:48.720882 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-f822c7b4-c754-4343-a97d-e40f4be15160 None None] MFA Rules not processed for user `e2d061d25d83443c9232218c90792d51`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:35:48.722123 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-f822c7b4-c754-4343-a97d-e40f4be15160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:35:48.729235 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1135/2271] 10.222.0.27 () {58 vars in 1018 bytes} [Wed Aug 24 11:35:48 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:35:48.741433 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b32a24e-9d62-4547-8105-98902ba947a1 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:35:48.753115 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b32a24e-9d62-4547-8105-98902ba947a1 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:35:48.756712 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b2e256-2fe9-4a50-9655-90fc51204d1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2d061d25d83443c9232218c90792d51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:35:48.757315 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b2e256-2fe9-4a50-9655-90fc51204d1c service neutron] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:35:48.757591 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b2e256-2fe9-4a50-9655-90fc51204d1c service neutron] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:35:48.757871 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b2e256-2fe9-4a50-9655-90fc51204d1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:35:48.764823 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b2e256-2fe9-4a50-9655-90fc51204d1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:35:48.766312 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b2e256-2fe9-4a50-9655-90fc51204d1c service neutron] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:35:48.774138 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1137/2272] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:35:48 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:35:48.859676 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1786fa-9538-4a3a-83f8-c8b082abcdb6 None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:35:48.859958 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1786fa-9538-4a3a-83f8-c8b082abcdb6 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:35:48.860225 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1786fa-9538-4a3a-83f8-c8b082abcdb6 None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:35:48.861601 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1136/2273] 10.222.0.27 () {54 vars in 921 bytes} [Wed Aug 24 11:35:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:35:48.867441 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed2da7b-59f0-4cb5-8565-b9539dbebf9b None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:35:48.867924 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed2da7b-59f0-4cb5-8565-b9539dbebf9b None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:35:48.868221 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed2da7b-59f0-4cb5-8565-b9539dbebf9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:35:48.888769 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-0ed2da7b-59f0-4cb5-8565-b9539dbebf9b None None] MFA Rules not processed for user `282ec32864d046b2bea170f6a3845cc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:35:48.889975 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-0ed2da7b-59f0-4cb5-8565-b9539dbebf9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:35:48.899557 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1138/2274] 10.222.0.27 () {58 vars in 1018 bytes} [Wed Aug 24 11:35:48 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 11:35:48.910279 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1786fa-9538-4a3a-83f8-c8b082abcdb6 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:35:48.921397 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1786fa-9538-4a3a-83f8-c8b082abcdb6 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:35:48.925066 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d048f3-0506-4cc4-afe6-70f918dc0ea7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2d061d25d83443c9232218c90792d51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:35:48.925659 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d048f3-0506-4cc4-afe6-70f918dc0ea7 service neutron] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:35:48.925940 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d048f3-0506-4cc4-afe6-70f918dc0ea7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:35:48.926240 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d048f3-0506-4cc4-afe6-70f918dc0ea7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:35:48.936840 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d048f3-0506-4cc4-afe6-70f918dc0ea7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:35:48.938275 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d048f3-0506-4cc4-afe6-70f918dc0ea7 service neutron] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:35:48.949350 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1137/2275] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:35:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:35:53.239616 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cba662-0462-42a9-bf8d-1fdf97f60f71 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:35:53.240190 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cba662-0462-42a9-bf8d-1fdf97f60f71 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:35:53.240293 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cba662-0462-42a9-bf8d-1fdf97f60f71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:35:53.271038 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-30cba662-0462-42a9-bf8d-1fdf97f60f71 None None] MFA Rules not processed for user `a5915030f01941fc89f92228ff57c7f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:35:53.272160 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-30cba662-0462-42a9-bf8d-1fdf97f60f71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:35:53.279487 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1139/2276] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Aug 24 11:35:53 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:35:53.291796 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d048f3-0506-4cc4-afe6-70f918dc0ea7 service neutron] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:35:53.303588 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d048f3-0506-4cc4-afe6-70f918dc0ea7 service neutron] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:35:53.308634 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df767cb1-ea7f-4ba7-936e-9c87e9f77f61 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1069558c085449f9e4c9f06013b2a85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:35:53.309270 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df767cb1-ea7f-4ba7-936e-9c87e9f77f61 service swift] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:35:53.309543 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df767cb1-ea7f-4ba7-936e-9c87e9f77f61 service swift] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:35:53.309811 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df767cb1-ea7f-4ba7-936e-9c87e9f77f61 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:35:53.318309 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df767cb1-ea7f-4ba7-936e-9c87e9f77f61 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:35:53.319926 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df767cb1-ea7f-4ba7-936e-9c87e9f77f61 service swift] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:35:53.328409 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1138/2277] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Aug 24 11:35:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 11:35:54.566068 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b5ea96-f494-4166-8a36-9c35e263eb00 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:35:54.566578 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b5ea96-f494-4166-8a36-9c35e263eb00 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:35:54.566698 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b5ea96-f494-4166-8a36-9c35e263eb00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:35:54.601573 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-13b5ea96-f494-4166-8a36-9c35e263eb00 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:35:54.602849 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-13b5ea96-f494-4166-8a36-9c35e263eb00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:35:54.664047 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1140/2278] 10.222.0.97 () {58 vars in 1016 bytes} [Wed Aug 24 11:35:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:35:54.679172 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df767cb1-ea7f-4ba7-936e-9c87e9f77f61 service swift] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:35:54.680704 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-df767cb1-ea7f-4ba7-936e-9c87e9f77f61 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:35:54.696542 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df767cb1-ea7f-4ba7-936e-9c87e9f77f61 service swift] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:35:54.703088 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a044c729-00cc-4533-9aed-60d0f2c45d31 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '282ec32864d046b2bea170f6a3845cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:35:54.703765 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a044c729-00cc-4533-9aed-60d0f2c45d31 service nova] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:35:54.704044 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a044c729-00cc-4533-9aed-60d0f2c45d31 service nova] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:35:54.704320 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a044c729-00cc-4533-9aed-60d0f2c45d31 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:35:54.713405 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a044c729-00cc-4533-9aed-60d0f2c45d31 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:35:54.715062 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a044c729-00cc-4533-9aed-60d0f2c45d31 service nova] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:35:54.726013 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1139/2279] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:35:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:36:04.656316 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=70 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:36:04.720781 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=47 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:36:11.080760 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ac1a71-e15d-4fb2-82fb-d231a7ada985 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:36:11.081370 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ac1a71-e15d-4fb2-82fb-d231a7ada985 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:36:11.081370 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ac1a71-e15d-4fb2-82fb-d231a7ada985 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:36:11.117051 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-11ac1a71-e15d-4fb2-82fb-d231a7ada985 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:36:11.118520 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-11ac1a71-e15d-4fb2-82fb-d231a7ada985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:36:11.130068 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1141/2280] 10.222.0.97 () {58 vars in 1016 bytes} [Wed Aug 24 11:36:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:36:11.149503 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a044c729-00cc-4533-9aed-60d0f2c45d31 service nova] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:36:11.151747 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-a044c729-00cc-4533-9aed-60d0f2c45d31 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:36:11.166966 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a044c729-00cc-4533-9aed-60d0f2c45d31 service nova] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:36:11.175686 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fb0420-97cf-4f9f-8b18-24d5ade77ebd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '282ec32864d046b2bea170f6a3845cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:36:11.176553 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fb0420-97cf-4f9f-8b18-24d5ade77ebd service nova] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:36:11.176869 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fb0420-97cf-4f9f-8b18-24d5ade77ebd service nova] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:36:11.177195 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fb0420-97cf-4f9f-8b18-24d5ade77ebd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:36:11.188209 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fb0420-97cf-4f9f-8b18-24d5ade77ebd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:36:11.190006 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fb0420-97cf-4f9f-8b18-24d5ade77ebd service nova] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:36:11.200784 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1140/2281] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:36:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:36:15.376308 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b5f4b6-a60c-473e-8f1b-d7767ae4a3eb None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:36:15.376849 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b5f4b6-a60c-473e-8f1b-d7767ae4a3eb None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:36:15.376849 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b5f4b6-a60c-473e-8f1b-d7767ae4a3eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:36:15.398955 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-46b5f4b6-a60c-473e-8f1b-d7767ae4a3eb None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:36:15.400722 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-46b5f4b6-a60c-473e-8f1b-d7767ae4a3eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:36:15.414006 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1142/2282] 10.222.0.97 () {58 vars in 1016 bytes} [Wed Aug 24 11:36:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:36:15.444882 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fb0420-97cf-4f9f-8b18-24d5ade77ebd service nova] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:36:15.456549 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fb0420-97cf-4f9f-8b18-24d5ade77ebd service nova] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:36:15.463649 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0b3c92-8a37-4380-a040-af313d83dafa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '282ec32864d046b2bea170f6a3845cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:36:15.464246 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0b3c92-8a37-4380-a040-af313d83dafa service nova] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:36:15.464516 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0b3c92-8a37-4380-a040-af313d83dafa service nova] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:36:15.464778 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0b3c92-8a37-4380-a040-af313d83dafa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:36:15.473798 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0b3c92-8a37-4380-a040-af313d83dafa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:36:15.475663 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0b3c92-8a37-4380-a040-af313d83dafa service nova] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:36:15.485318 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1141/2283] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:36:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:36:19.498810 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af30f4c-5b69-41df-9df4-3d3de6a4593d None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:36:19.499436 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af30f4c-5b69-41df-9df4-3d3de6a4593d None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:36:19.499436 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af30f4c-5b69-41df-9df4-3d3de6a4593d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:36:19.520210 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-9af30f4c-5b69-41df-9df4-3d3de6a4593d None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:36:19.521396 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-9af30f4c-5b69-41df-9df4-3d3de6a4593d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:36:19.529749 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1143/2284] 10.222.0.97 () {58 vars in 1016 bytes} [Wed Aug 24 11:36:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:36:19.546401 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0b3c92-8a37-4380-a040-af313d83dafa service nova] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:36:19.557979 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0b3c92-8a37-4380-a040-af313d83dafa service nova] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:36:19.564509 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b42cc9-ab36-4915-81eb-8ccfd319339b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '282ec32864d046b2bea170f6a3845cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:36:19.565106 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b42cc9-ab36-4915-81eb-8ccfd319339b service nova] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:36:19.566849 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b42cc9-ab36-4915-81eb-8ccfd319339b service nova] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:36:19.566849 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b42cc9-ab36-4915-81eb-8ccfd319339b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:36:19.574867 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b42cc9-ab36-4915-81eb-8ccfd319339b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:36:19.576459 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b42cc9-ab36-4915-81eb-8ccfd319339b service nova] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:36:19.586649 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1142/2285] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:36:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:36:20.908054 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1cc0bd-e1e8-423d-ac6b-14ec85d25e4b None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:36:20.908582 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1cc0bd-e1e8-423d-ac6b-14ec85d25e4b None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:36:20.908677 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1cc0bd-e1e8-423d-ac6b-14ec85d25e4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:36:20.928281 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-7a1cc0bd-e1e8-423d-ac6b-14ec85d25e4b None None] MFA Rules not processed for user `a5915030f01941fc89f92228ff57c7f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:36:20.929507 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-7a1cc0bd-e1e8-423d-ac6b-14ec85d25e4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:36:20.936770 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1144/2286] 10.222.0.27 () {58 vars in 967 bytes} [Wed Aug 24 11:36:20 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:36:20.961170 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b42cc9-ab36-4915-81eb-8ccfd319339b service nova] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:36:20.972611 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b42cc9-ab36-4915-81eb-8ccfd319339b service nova] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:36:20.978753 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8df7d8-fbd5-4e0f-9cfe-c170480f32c6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1069558c085449f9e4c9f06013b2a85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:36:20.979359 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8df7d8-fbd5-4e0f-9cfe-c170480f32c6 service swift] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:36:20.979628 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8df7d8-fbd5-4e0f-9cfe-c170480f32c6 service swift] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:36:20.979896 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8df7d8-fbd5-4e0f-9cfe-c170480f32c6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:36:20.988938 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8df7d8-fbd5-4e0f-9cfe-c170480f32c6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:36:20.990730 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8df7d8-fbd5-4e0f-9cfe-c170480f32c6 service swift] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:36:20.999453 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1143/2287] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Aug 24 11:36:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 24 11:36:24.770228 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038fe629-ada5-425a-a68e-eaab950c5075 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:36:24.771116 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038fe629-ada5-425a-a68e-eaab950c5075 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:36:24.771116 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038fe629-ada5-425a-a68e-eaab950c5075 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:36:24.795597 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-038fe629-ada5-425a-a68e-eaab950c5075 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:36:24.796828 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-038fe629-ada5-425a-a68e-eaab950c5075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:36:24.806277 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1145/2288] 10.222.0.97 () {58 vars in 1016 bytes} [Wed Aug 24 11:36:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:36:24.823637 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8df7d8-fbd5-4e0f-9cfe-c170480f32c6 service swift] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:36:24.836432 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8df7d8-fbd5-4e0f-9cfe-c170480f32c6 service swift] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:36:24.843453 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7157cb0d-d7df-4e4f-bbf0-bca1ab92ebc6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '282ec32864d046b2bea170f6a3845cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:36:24.844314 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7157cb0d-d7df-4e4f-bbf0-bca1ab92ebc6 service nova] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:36:24.844659 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7157cb0d-d7df-4e4f-bbf0-bca1ab92ebc6 service nova] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:36:24.845031 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7157cb0d-d7df-4e4f-bbf0-bca1ab92ebc6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:36:24.858737 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7157cb0d-d7df-4e4f-bbf0-bca1ab92ebc6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:36:24.860926 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7157cb0d-d7df-4e4f-bbf0-bca1ab92ebc6 service nova] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:36:24.870815 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1144/2289] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:36:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:36:28.971617 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf8596f-6e81-45e8-8ef7-add8a6cdc077 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:36:28.972172 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf8596f-6e81-45e8-8ef7-add8a6cdc077 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:36:28.972172 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf8596f-6e81-45e8-8ef7-add8a6cdc077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:36:28.993352 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-faf8596f-6e81-45e8-8ef7-add8a6cdc077 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:36:28.994610 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-faf8596f-6e81-45e8-8ef7-add8a6cdc077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:36:29.004268 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1146/2290] 10.222.0.97 () {58 vars in 1016 bytes} [Wed Aug 24 11:36:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:36:29.020737 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7157cb0d-d7df-4e4f-bbf0-bca1ab92ebc6 service nova] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:36:29.032388 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7157cb0d-d7df-4e4f-bbf0-bca1ab92ebc6 service nova] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:36:29.039165 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d9830c-8f25-44ab-bab0-93457922179a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '282ec32864d046b2bea170f6a3845cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:36:29.039784 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d9830c-8f25-44ab-bab0-93457922179a service nova] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:36:29.040059 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d9830c-8f25-44ab-bab0-93457922179a service nova] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:36:29.040327 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d9830c-8f25-44ab-bab0-93457922179a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:36:29.049068 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d9830c-8f25-44ab-bab0-93457922179a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:36:29.050709 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d9830c-8f25-44ab-bab0-93457922179a service nova] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:36:29.060610 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1145/2291] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:36:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:36:38.987853 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=18 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:36:39.056207 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=36 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:36:41.850054 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf8596f-6e81-45e8-8ef7-add8a6cdc077 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:36:41.851637 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-faf8596f-6e81-45e8-8ef7-add8a6cdc077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:36:41.934512 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf8596f-6e81-45e8-8ef7-add8a6cdc077 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:36:41.940463 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e579982d-ca0a-41b2-8902-36eebb45512e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad45431e70ff48a9b90905a97d473d81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:36:41.941081 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e579982d-ca0a-41b2-8902-36eebb45512e service placement] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:36:41.941355 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e579982d-ca0a-41b2-8902-36eebb45512e service placement] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:36:41.941621 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e579982d-ca0a-41b2-8902-36eebb45512e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:36:41.943496 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-e579982d-ca0a-41b2-8902-36eebb45512e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:36:41.954893 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e579982d-ca0a-41b2-8902-36eebb45512e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:36:41.956515 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e579982d-ca0a-41b2-8902-36eebb45512e service placement] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:36:41.966213 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1147/2292] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:36:41 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 11:36:46.571431 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975c4d60-d5cd-4b60-b6c0-5b7f580ddc2a None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:36:46.571965 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975c4d60-d5cd-4b60-b6c0-5b7f580ddc2a None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:36:46.571965 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975c4d60-d5cd-4b60-b6c0-5b7f580ddc2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:36:46.592299 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-975c4d60-d5cd-4b60-b6c0-5b7f580ddc2a None None] MFA Rules not processed for user `c437b4066eb24573aec1a504cd838264`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:36:46.593506 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-975c4d60-d5cd-4b60-b6c0-5b7f580ddc2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:36:46.654963 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1146/2293] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:36:46 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:36:51.962046 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=32 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:36:56.647040 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=25 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:37:02.432460 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2602e4e1-36d7-4b2a-bb3b-f991f056ab70 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:37:02.433059 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2602e4e1-36d7-4b2a-bb3b-f991f056ab70 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:37:02.433059 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2602e4e1-36d7-4b2a-bb3b-f991f056ab70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:37:02.452227 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-2602e4e1-36d7-4b2a-bb3b-f991f056ab70 None None] MFA Rules not processed for user `c53eb370dc294248b3be2248570d1b04`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:37:02.453460 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-2602e4e1-36d7-4b2a-bb3b-f991f056ab70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:37:02.460507 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1148/2294] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:37:02 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:37:02.781226 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1dfd47-b6a2-4a69-9578-092584082da6 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:37:02.781748 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1dfd47-b6a2-4a69-9578-092584082da6 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:37:02.781964 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1dfd47-b6a2-4a69-9578-092584082da6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:37:02.802344 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-0c1dfd47-b6a2-4a69-9578-092584082da6 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:37:02.803598 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-0c1dfd47-b6a2-4a69-9578-092584082da6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:37:02.812465 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1147/2295] 10.222.0.97 () {58 vars in 1016 bytes} [Wed Aug 24 11:37:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:37:02.829061 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2602e4e1-36d7-4b2a-bb3b-f991f056ab70 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:37:02.842131 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2602e4e1-36d7-4b2a-bb3b-f991f056ab70 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:37:02.848327 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f22232-1679-4911-b534-71bf3f8b40a1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '282ec32864d046b2bea170f6a3845cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:37:02.849017 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f22232-1679-4911-b534-71bf3f8b40a1 service nova] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:37:02.849305 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f22232-1679-4911-b534-71bf3f8b40a1 service nova] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:37:02.849565 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f22232-1679-4911-b534-71bf3f8b40a1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:37:02.858289 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f22232-1679-4911-b534-71bf3f8b40a1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:37:02.859929 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f22232-1679-4911-b534-71bf3f8b40a1 service nova] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:37:02.869817 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1149/2296] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:37:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:37:06.046304 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294885b6-54aa-471c-9d14-9f9e3218e621 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:37:06.047218 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294885b6-54aa-471c-9d14-9f9e3218e621 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:37:06.047734 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294885b6-54aa-471c-9d14-9f9e3218e621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:37:06.071216 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-294885b6-54aa-471c-9d14-9f9e3218e621 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:37:06.072519 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-294885b6-54aa-471c-9d14-9f9e3218e621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:37:06.081666 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1148/2297] 10.222.0.97 () {58 vars in 1016 bytes} [Wed Aug 24 11:37:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:37:06.096719 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f22232-1679-4911-b534-71bf3f8b40a1 service nova] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:37:06.109368 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f22232-1679-4911-b534-71bf3f8b40a1 service nova] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:37:06.115099 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de034cca-523c-4067-8023-b0f1e6044e49 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '282ec32864d046b2bea170f6a3845cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:37:06.115711 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de034cca-523c-4067-8023-b0f1e6044e49 service nova] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:37:06.115990 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de034cca-523c-4067-8023-b0f1e6044e49 service nova] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:37:06.116257 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de034cca-523c-4067-8023-b0f1e6044e49 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:37:06.125723 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de034cca-523c-4067-8023-b0f1e6044e49 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:37:06.127395 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de034cca-523c-4067-8023-b0f1e6044e49 service nova] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:37:06.139520 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1150/2298] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:37:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:37:09.122563 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4818ccb2-dcc1-4b81-9c0b-4eee1df3a72d None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:37:09.123166 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4818ccb2-dcc1-4b81-9c0b-4eee1df3a72d None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:37:09.123166 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4818ccb2-dcc1-4b81-9c0b-4eee1df3a72d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:37:09.145077 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-4818ccb2-dcc1-4b81-9c0b-4eee1df3a72d None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:37:09.146340 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-4818ccb2-dcc1-4b81-9c0b-4eee1df3a72d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:37:09.155104 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1149/2299] 10.222.0.97 () {58 vars in 1016 bytes} [Wed Aug 24 11:37:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:37:09.241226 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de034cca-523c-4067-8023-b0f1e6044e49 service nova] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:37:09.253741 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de034cca-523c-4067-8023-b0f1e6044e49 service nova] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:37:09.259681 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b0ecaf-c011-4262-9ad0-dce1290c6ba6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '282ec32864d046b2bea170f6a3845cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:37:09.260412 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b0ecaf-c011-4262-9ad0-dce1290c6ba6 service nova] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:37:09.260785 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b0ecaf-c011-4262-9ad0-dce1290c6ba6 service nova] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:37:09.261173 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b0ecaf-c011-4262-9ad0-dce1290c6ba6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:37:09.270778 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b0ecaf-c011-4262-9ad0-dce1290c6ba6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:37:09.272398 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b0ecaf-c011-4262-9ad0-dce1290c6ba6 service nova] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:37:09.282661 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1151/2300] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:37:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:37:13.314570 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58d6a35-f971-4ce0-96e9-7ac28043eda8 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:37:13.315075 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58d6a35-f971-4ce0-96e9-7ac28043eda8 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:37:13.315190 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58d6a35-f971-4ce0-96e9-7ac28043eda8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:37:13.334377 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-c58d6a35-f971-4ce0-96e9-7ac28043eda8 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:37:13.335590 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-c58d6a35-f971-4ce0-96e9-7ac28043eda8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:37:13.343427 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1150/2301] 10.222.0.97 () {58 vars in 1016 bytes} [Wed Aug 24 11:37:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:37:13.363232 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b0ecaf-c011-4262-9ad0-dce1290c6ba6 service nova] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:37:13.374961 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b0ecaf-c011-4262-9ad0-dce1290c6ba6 service nova] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:37:13.380815 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f341b40e-60d4-47a8-90ed-271de0784f31 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '282ec32864d046b2bea170f6a3845cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:37:13.381427 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f341b40e-60d4-47a8-90ed-271de0784f31 service nova] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:37:13.381701 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f341b40e-60d4-47a8-90ed-271de0784f31 service nova] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:37:13.381983 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f341b40e-60d4-47a8-90ed-271de0784f31 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:37:13.390850 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f341b40e-60d4-47a8-90ed-271de0784f31 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:37:13.392450 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f341b40e-60d4-47a8-90ed-271de0784f31 service nova] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:37:13.402215 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1152/2302] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:37:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 11:37:18.550540 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c73962-ae4d-4d0d-aec3-e46956882101 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:37:18.551277 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c73962-ae4d-4d0d-aec3-e46956882101 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:37:18.551277 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c73962-ae4d-4d0d-aec3-e46956882101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:37:18.571417 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-49c73962-ae4d-4d0d-aec3-e46956882101 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:37:18.572761 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-49c73962-ae4d-4d0d-aec3-e46956882101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:37:18.582009 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1151/2303] 10.222.0.97 () {58 vars in 1016 bytes} [Wed Aug 24 11:37:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:37:18.603644 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f341b40e-60d4-47a8-90ed-271de0784f31 service nova] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:37:18.614435 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f341b40e-60d4-47a8-90ed-271de0784f31 service nova] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:37:18.621716 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b1cd6d-23ad-4990-b3c6-dd9e4eb5b5e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '282ec32864d046b2bea170f6a3845cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:37:18.622459 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b1cd6d-23ad-4990-b3c6-dd9e4eb5b5e0 service nova] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:37:18.622826 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b1cd6d-23ad-4990-b3c6-dd9e4eb5b5e0 service nova] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:37:18.623521 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b1cd6d-23ad-4990-b3c6-dd9e4eb5b5e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:37:18.633377 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b1cd6d-23ad-4990-b3c6-dd9e4eb5b5e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:37:18.635110 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b1cd6d-23ad-4990-b3c6-dd9e4eb5b5e0 service nova] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:37:18.645641 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1153/2304] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:37:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:37:21.210097 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a6fb9b-3900-4ce6-af2b-5752ae95c32a None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:37:21.210693 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a6fb9b-3900-4ce6-af2b-5752ae95c32a None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:37:21.210693 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a6fb9b-3900-4ce6-af2b-5752ae95c32a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:37:21.230665 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-37a6fb9b-3900-4ce6-af2b-5752ae95c32a None None] MFA Rules not processed for user `6b08455fa85c4b60af58e9f213a00a4d`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:37:21.231864 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-37a6fb9b-3900-4ce6-af2b-5752ae95c32a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:37:21.287972 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1152/2305] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:37:21 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:37:28.640948 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=33 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:37:31.281313 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=40 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:37:33.845845 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a75a61f-eae9-4c9d-a94d-b76f30b25fe0 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:37:33.846959 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a75a61f-eae9-4c9d-a94d-b76f30b25fe0 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:37:33.847422 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a75a61f-eae9-4c9d-a94d-b76f30b25fe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:37:33.869528 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-1a75a61f-eae9-4c9d-a94d-b76f30b25fe0 None None] MFA Rules not processed for user `5bfd72d5fe714437be00c7c5533115b4`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:37:33.870788 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-1a75a61f-eae9-4c9d-a94d-b76f30b25fe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:37:33.880371 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1154/2306] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:37:33 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:37:43.864558 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=3 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:37:49.765395 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f90e8c9-5f36-430a-8ec8-e6fa8ab46815 None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:37:49.765940 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f90e8c9-5f36-430a-8ec8-e6fa8ab46815 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:37:49.766052 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f90e8c9-5f36-430a-8ec8-e6fa8ab46815 None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:37:49.767532 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1153/2307] 10.222.0.27 () {54 vars in 921 bytes} [Wed Aug 24 11:37:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:37:49.778442 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee555e03-8abc-4774-bbc3-f6c6d8cc9f82 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:37:49.778911 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee555e03-8abc-4774-bbc3-f6c6d8cc9f82 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:37:49.779003 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee555e03-8abc-4774-bbc3-f6c6d8cc9f82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:37:49.800477 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-ee555e03-8abc-4774-bbc3-f6c6d8cc9f82 None None] MFA Rules not processed for user `ad45431e70ff48a9b90905a97d473d81`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:37:49.801903 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-ee555e03-8abc-4774-bbc3-f6c6d8cc9f82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:37:49.812895 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1155/2308] 10.222.0.27 () {58 vars in 1018 bytes} [Wed Aug 24 11:37:49 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:37:49.828418 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f90e8c9-5f36-430a-8ec8-e6fa8ab46815 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:37:49.833767 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee555e03-8abc-4774-bbc3-f6c6d8cc9f82 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:37:49.835395 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-ee555e03-8abc-4774-bbc3-f6c6d8cc9f82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:37:49.844943 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f90e8c9-5f36-430a-8ec8-e6fa8ab46815 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:37:49.850159 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee555e03-8abc-4774-bbc3-f6c6d8cc9f82 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:37:49.850279 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03e5008-697f-4791-b02c-ade6f4023d5a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad45431e70ff48a9b90905a97d473d81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:37:49.851172 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03e5008-697f-4791-b02c-ade6f4023d5a service placement] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:37:49.851449 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03e5008-697f-4791-b02c-ade6f4023d5a service placement] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:37:49.851719 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03e5008-697f-4791-b02c-ade6f4023d5a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:37:49.855415 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc21426-93f5-4b63-a27b-96841dc3f84d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:37:49.856001 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc21426-93f5-4b63-a27b-96841dc3f84d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:37:49.856274 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc21426-93f5-4b63-a27b-96841dc3f84d admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:37:49.856539 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc21426-93f5-4b63-a27b-96841dc3f84d admin admin] PATH_INFO: `/v3/users/c437b4066eb24573aec1a504cd838264` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:37:49.857764 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc21426-93f5-4b63-a27b-96841dc3f84d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c437b4066eb24573aec1a504cd838264)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:37:49.859867 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc21426-93f5-4b63-a27b-96841dc3f84d admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:37:49.860726 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03e5008-697f-4791-b02c-ade6f4023d5a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:37:49.862293 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03e5008-697f-4791-b02c-ade6f4023d5a service placement] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:37:49.872419 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1154/2309] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:37:49 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:37:49.909954 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-6cc21426-93f5-4b63-a27b-96841dc3f84d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c437b4066eb24573aec1a504cd838264'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:37:49.910695 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-6cc21426-93f5-4b63-a27b-96841dc3f84d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c437b4066eb24573aec1a504cd838264'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:37:49.911373 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-6cc21426-93f5-4b63-a27b-96841dc3f84d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c437b4066eb24573aec1a504cd838264'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:37:49.919170 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-6cc21426-93f5-4b63-a27b-96841dc3f84d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c437b4066eb24573aec1a504cd838264'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:37:49.926227 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-6cc21426-93f5-4b63-a27b-96841dc3f84d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c437b4066eb24573aec1a504cd838264'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:37:49.943772 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1156/2310] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 11:37:49 2022] DELETE /identity/v3/users/c437b4066eb24573aec1a504cd838264 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:37:50.128104 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03e5008-697f-4791-b02c-ade6f4023d5a service placement] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:37:50.139632 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03e5008-697f-4791-b02c-ade6f4023d5a service placement] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:37:50.203741 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faec2af-892e-45f0-8b84-d95b578a7ef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:37:50.204357 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faec2af-892e-45f0-8b84-d95b578a7ef5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:37:50.204650 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faec2af-892e-45f0-8b84-d95b578a7ef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:37:50.204923 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faec2af-892e-45f0-8b84-d95b578a7ef5 admin admin] PATH_INFO: `/v3/projects/f68989e15a6345dea2233637178502c1` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:37:50.206066 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faec2af-892e-45f0-8b84-d95b578a7ef5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f68989e15a6345dea2233637178502c1)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:37:50.208071 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faec2af-892e-45f0-8b84-d95b578a7ef5 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:37:50.259390 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-2faec2af-892e-45f0-8b84-d95b578a7ef5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f68989e15a6345dea2233637178502c1', 'request_id': 'req-2faec2af-892e-45f0-8b84-d95b578a7ef5'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:37:50.265827 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-2faec2af-892e-45f0-8b84-d95b578a7ef5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f68989e15a6345dea2233637178502c1', 'request_id': 'req-2faec2af-892e-45f0-8b84-d95b578a7ef5'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:37:50.272427 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-2faec2af-892e-45f0-8b84-d95b578a7ef5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f68989e15a6345dea2233637178502c1', 'request_id': 'req-2faec2af-892e-45f0-8b84-d95b578a7ef5'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:37:50.287038 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-2faec2af-892e-45f0-8b84-d95b578a7ef5 admin admin] The token cache is being invalidate because project f68989e15a6345dea2233637178502c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:37:50.287318 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-2faec2af-892e-45f0-8b84-d95b578a7ef5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:37:50.287971 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-2faec2af-892e-45f0-8b84-d95b578a7ef5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:37:50.289548 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1155/2311] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 11:37:50 2022] DELETE /identity/v3/projects/f68989e15a6345dea2233637178502c1 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:37:59.940274 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=32,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:38:00.283961 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=57,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:38:16.669053 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38495087-4055-4d39-9df9-cfa3ef7c23c1 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:38:16.669576 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38495087-4055-4d39-9df9-cfa3ef7c23c1 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:38:16.669576 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38495087-4055-4d39-9df9-cfa3ef7c23c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:38:16.694176 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-38495087-4055-4d39-9df9-cfa3ef7c23c1 None None] MFA Rules not processed for user `c53eb370dc294248b3be2248570d1b04`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:38:16.695842 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-38495087-4055-4d39-9df9-cfa3ef7c23c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:38:16.768863 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1157/2312] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:38:16 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:38:17.922804 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faec2af-892e-45f0-8b84-d95b578a7ef5 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:38:17.924406 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-2faec2af-892e-45f0-8b84-d95b578a7ef5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:38:17.985977 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faec2af-892e-45f0-8b84-d95b578a7ef5 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:38:17.989663 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75a2ceb-d3d0-4ffe-aa82-d5e13c07989c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2d061d25d83443c9232218c90792d51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:38:17.990188 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75a2ceb-d3d0-4ffe-aa82-d5e13c07989c service neutron] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:38:17.990500 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75a2ceb-d3d0-4ffe-aa82-d5e13c07989c service neutron] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:38:17.990769 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75a2ceb-d3d0-4ffe-aa82-d5e13c07989c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:38:17.992562 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-e75a2ceb-d3d0-4ffe-aa82-d5e13c07989c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:38:18.077752 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75a2ceb-d3d0-4ffe-aa82-d5e13c07989c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:38:18.080185 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75a2ceb-d3d0-4ffe-aa82-d5e13c07989c service neutron] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:38:18.094734 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1156/2313] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:38:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:38:21.114467 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38495087-4055-4d39-9df9-cfa3ef7c23c1 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:38:21.125205 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38495087-4055-4d39-9df9-cfa3ef7c23c1 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:38:21.129138 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d24959b-9bf5-4c15-ab60-7a495ca6e880 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2d061d25d83443c9232218c90792d51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:38:21.130049 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d24959b-9bf5-4c15-ab60-7a495ca6e880 service neutron] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:38:21.130542 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d24959b-9bf5-4c15-ab60-7a495ca6e880 service neutron] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:38:21.131009 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d24959b-9bf5-4c15-ab60-7a495ca6e880 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:38:21.133261 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-6d24959b-9bf5-4c15-ab60-7a495ca6e880 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:38:21.148317 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d24959b-9bf5-4c15-ab60-7a495ca6e880 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:38:21.149863 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d24959b-9bf5-4c15-ab60-7a495ca6e880 service neutron] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:38:21.161202 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1158/2314] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:38:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:38:28.088954 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=54 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:38:31.156800 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=31 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:38:33.324572 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75a2ceb-d3d0-4ffe-aa82-d5e13c07989c service neutron] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:38:33.326206 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-e75a2ceb-d3d0-4ffe-aa82-d5e13c07989c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:38:33.341403 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75a2ceb-d3d0-4ffe-aa82-d5e13c07989c service neutron] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:38:33.347573 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bd759c-ed74-449d-934c-bfa77748476c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '282ec32864d046b2bea170f6a3845cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:38:33.348598 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bd759c-ed74-449d-934c-bfa77748476c service nova] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:38:33.349207 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bd759c-ed74-449d-934c-bfa77748476c service nova] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:38:33.349677 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bd759c-ed74-449d-934c-bfa77748476c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:38:33.351677 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-34bd759c-ed74-449d-934c-bfa77748476c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:38:33.433878 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bd759c-ed74-449d-934c-bfa77748476c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:38:33.435828 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bd759c-ed74-449d-934c-bfa77748476c service nova] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:38:33.445601 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1157/2315] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:38:33 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:38:34.251077 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2749d2f2-1c30-4db7-a056-09be3ca87387 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:38:34.251602 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2749d2f2-1c30-4db7-a056-09be3ca87387 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:38:34.251602 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2749d2f2-1c30-4db7-a056-09be3ca87387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:38:34.271589 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-2749d2f2-1c30-4db7-a056-09be3ca87387 None None] MFA Rules not processed for user `d908050afb6e420ba36bfd5f4d59b50a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:38:34.272806 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-2749d2f2-1c30-4db7-a056-09be3ca87387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:38:34.332305 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1159/2316] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:38:34 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:38:42.895875 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bd759c-ed74-449d-934c-bfa77748476c service nova] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:38:42.912264 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bd759c-ed74-449d-934c-bfa77748476c service nova] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:38:42.919777 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3acf545-0e2d-4139-ac53-993b51d8c17f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '282ec32864d046b2bea170f6a3845cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:38:42.920384 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3acf545-0e2d-4139-ac53-993b51d8c17f service nova] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:38:42.920638 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3acf545-0e2d-4139-ac53-993b51d8c17f service nova] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:38:42.920917 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3acf545-0e2d-4139-ac53-993b51d8c17f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:38:42.923056 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-d3acf545-0e2d-4139-ac53-993b51d8c17f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:38:42.983814 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3acf545-0e2d-4139-ac53-993b51d8c17f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:38:42.985425 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3acf545-0e2d-4139-ac53-993b51d8c17f service nova] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:38:42.994495 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1158/2317] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:38:42 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:38:44.324523 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=25 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:38:46.749760 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2749d2f2-1c30-4db7-a056-09be3ca87387 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:38:46.751460 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-2749d2f2-1c30-4db7-a056-09be3ca87387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:38:46.764164 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2749d2f2-1c30-4db7-a056-09be3ca87387 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:38:46.768070 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180482db-39c0-4a79-92c8-1bdd98ae518a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2d061d25d83443c9232218c90792d51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:38:46.768666 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180482db-39c0-4a79-92c8-1bdd98ae518a service neutron] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:38:46.768939 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180482db-39c0-4a79-92c8-1bdd98ae518a service neutron] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:38:46.769204 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180482db-39c0-4a79-92c8-1bdd98ae518a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:38:46.770941 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-180482db-39c0-4a79-92c8-1bdd98ae518a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:38:46.834302 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180482db-39c0-4a79-92c8-1bdd98ae518a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:38:46.835818 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180482db-39c0-4a79-92c8-1bdd98ae518a service neutron] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:38:46.847158 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1160/2318] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:38:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:38:47.437248 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34abb5d9-a585-4366-8cfb-6bfb1ca8f2eb None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:38:47.437747 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34abb5d9-a585-4366-8cfb-6bfb1ca8f2eb None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:38:47.437974 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34abb5d9-a585-4366-8cfb-6bfb1ca8f2eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:38:47.457433 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-34abb5d9-a585-4366-8cfb-6bfb1ca8f2eb None None] MFA Rules not processed for user `a5915030f01941fc89f92228ff57c7f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:38:47.458871 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-34abb5d9-a585-4366-8cfb-6bfb1ca8f2eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:38:47.521324 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1159/2319] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Aug 24 11:38:47 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:38:47.578610 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180482db-39c0-4a79-92c8-1bdd98ae518a service neutron] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:38:47.580379 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-180482db-39c0-4a79-92c8-1bdd98ae518a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:38:47.655932 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180482db-39c0-4a79-92c8-1bdd98ae518a service neutron] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:38:47.664522 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5ced11-8f04-4f04-bba7-0e1b19909ed2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1069558c085449f9e4c9f06013b2a85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:38:47.665162 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5ced11-8f04-4f04-bba7-0e1b19909ed2 service swift] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:38:47.665433 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5ced11-8f04-4f04-bba7-0e1b19909ed2 service swift] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:38:47.665700 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5ced11-8f04-4f04-bba7-0e1b19909ed2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:38:47.675228 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5ced11-8f04-4f04-bba7-0e1b19909ed2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:38:47.676851 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5ced11-8f04-4f04-bba7-0e1b19909ed2 service swift] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:38:47.685769 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1161/2320] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Aug 24 11:38:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 11:38:51.153991 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34abb5d9-a585-4366-8cfb-6bfb1ca8f2eb None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:38:51.155943 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-34abb5d9-a585-4366-8cfb-6bfb1ca8f2eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:38:51.179482 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34abb5d9-a585-4366-8cfb-6bfb1ca8f2eb None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:38:51.185175 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbd8ad4-9808-4558-bdcd-d5c638098ace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:38:51.185985 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbd8ad4-9808-4558-bdcd-d5c638098ace admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:38:51.186391 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbd8ad4-9808-4558-bdcd-d5c638098ace admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:38:51.186877 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbd8ad4-9808-4558-bdcd-d5c638098ace admin admin] PATH_INFO: `/v3/users/5bfd72d5fe714437be00c7c5533115b4` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:38:51.188274 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbd8ad4-9808-4558-bdcd-d5c638098ace admin admin] RBAC: Authorizing `identity:delete_user(user_id=5bfd72d5fe714437be00c7c5533115b4)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:38:51.190415 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbd8ad4-9808-4558-bdcd-d5c638098ace admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:38:51.249951 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:38:51.274643 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-6cbd8ad4-9808-4558-bdcd-d5c638098ace admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5bfd72d5fe714437be00c7c5533115b4'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:38:51.275444 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-6cbd8ad4-9808-4558-bdcd-d5c638098ace admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5bfd72d5fe714437be00c7c5533115b4'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:38:51.286198 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-6cbd8ad4-9808-4558-bdcd-d5c638098ace admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5bfd72d5fe714437be00c7c5533115b4'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:38:51.295870 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-6cbd8ad4-9808-4558-bdcd-d5c638098ace admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5bfd72d5fe714437be00c7c5533115b4'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:38:51.296609 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-6cbd8ad4-9808-4558-bdcd-d5c638098ace admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5bfd72d5fe714437be00c7c5533115b4'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:38:51.322986 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1160/2321] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 11:38:51 2022] DELETE /identity/v3/users/5bfd72d5fe714437be00c7c5533115b4 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:38:51.587832 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5ced11-8f04-4f04-bba7-0e1b19909ed2 service swift] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:38:51.613181 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5ced11-8f04-4f04-bba7-0e1b19909ed2 service swift] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:38:51.695517 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc50375-4582-47db-b271-c5ab1fc35b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:38:51.696053 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc50375-4582-47db-b271-c5ab1fc35b71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:38:51.696331 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc50375-4582-47db-b271-c5ab1fc35b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:38:51.696604 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc50375-4582-47db-b271-c5ab1fc35b71 admin admin] PATH_INFO: `/v3/projects/a6fb390da7ba4985b27c83ef80498a4a` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:38:51.697734 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc50375-4582-47db-b271-c5ab1fc35b71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6fb390da7ba4985b27c83ef80498a4a)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:38:51.699878 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc50375-4582-47db-b271-c5ab1fc35b71 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:38:51.734787 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:38:51.756652 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-3cc50375-4582-47db-b271-c5ab1fc35b71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6fb390da7ba4985b27c83ef80498a4a', 'request_id': 'req-3cc50375-4582-47db-b271-c5ab1fc35b71'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:38:51.763303 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-3cc50375-4582-47db-b271-c5ab1fc35b71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6fb390da7ba4985b27c83ef80498a4a', 'request_id': 'req-3cc50375-4582-47db-b271-c5ab1fc35b71'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:38:51.769416 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-3cc50375-4582-47db-b271-c5ab1fc35b71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6fb390da7ba4985b27c83ef80498a4a', 'request_id': 'req-3cc50375-4582-47db-b271-c5ab1fc35b71'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:38:51.809480 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-3cc50375-4582-47db-b271-c5ab1fc35b71 admin admin] The token cache is being invalidate because project a6fb390da7ba4985b27c83ef80498a4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81501) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:38:51.809902 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-3cc50375-4582-47db-b271-c5ab1fc35b71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:38:51.811015 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-3cc50375-4582-47db-b271-c5ab1fc35b71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:38:51.812610 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1162/2322] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 11:38:51 2022] DELETE /identity/v3/projects/a6fb390da7ba4985b27c83ef80498a4a => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:38:51.817580 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7b2140-e2ce-4631-9e6f-b20320bb8bcc None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:38:51.818489 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7b2140-e2ce-4631-9e6f-b20320bb8bcc None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:38:51.818985 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7b2140-e2ce-4631-9e6f-b20320bb8bcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:38:51.847587 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-9f7b2140-e2ce-4631-9e6f-b20320bb8bcc None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:38:51.848753 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-9f7b2140-e2ce-4631-9e6f-b20320bb8bcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:38:51.925751 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1161/2323] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:38:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:38:51.933435 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dda0c4-48a4-43e0-b0ae-0113f9910bac None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:38:51.933947 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dda0c4-48a4-43e0-b0ae-0113f9910bac None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:38:51.934309 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dda0c4-48a4-43e0-b0ae-0113f9910bac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:38:51.954802 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-d1dda0c4-48a4-43e0-b0ae-0113f9910bac None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:38:51.956116 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-d1dda0c4-48a4-43e0-b0ae-0113f9910bac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:38:51.964254 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1163/2324] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:38:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:38:51.968642 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7b2140-e2ce-4631-9e6f-b20320bb8bcc None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:38:51.981156 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7b2140-e2ce-4631-9e6f-b20320bb8bcc None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:38:51.987145 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9c7227-0508-484b-9697-86ed4d2861c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:38:51.987845 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9c7227-0508-484b-9697-86ed4d2861c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:38:51.988191 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9c7227-0508-484b-9697-86ed4d2861c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:38:51.988522 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9c7227-0508-484b-9697-86ed4d2861c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:38:51.989249 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9c7227-0508-484b-9697-86ed4d2861c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:38:51.989616 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9c7227-0508-484b-9697-86ed4d2861c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:38:51.991360 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9c7227-0508-484b-9697-86ed4d2861c1 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:38:52.005054 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1162/2325] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 24 11:38:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:38:52.009098 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dda0c4-48a4-43e0-b0ae-0113f9910bac None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:38:52.019004 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dda0c4-48a4-43e0-b0ae-0113f9910bac None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:38:52.023789 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f54577-5cc0-4af9-a83b-0f31236941d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:38:52.024393 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f54577-5cc0-4af9-a83b-0f31236941d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:38:52.024667 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f54577-5cc0-4af9-a83b-0f31236941d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:38:52.024930 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f54577-5cc0-4af9-a83b-0f31236941d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:38:52.025585 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f54577-5cc0-4af9-a83b-0f31236941d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:38:52.027716 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f54577-5cc0-4af9-a83b-0f31236941d5 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:38:52.060703 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1164/2326] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 11:38:52 2022] POST /identity/v3/projects => generated 373 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:38:52.064822 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9c7227-0508-484b-9697-86ed4d2861c1 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:38:52.075329 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9c7227-0508-484b-9697-86ed4d2861c1 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:38:52.150587 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1491c1-82e1-44b5-a2af-dd4dae1faa02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:38:52.151351 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1491c1-82e1-44b5-a2af-dd4dae1faa02 admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:38:52.151693 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1491c1-82e1-44b5-a2af-dd4dae1faa02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:38:52.152032 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1491c1-82e1-44b5-a2af-dd4dae1faa02 admin admin] PATH_INFO: `/v3/users` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:38:52.152745 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1491c1-82e1-44b5-a2af-dd4dae1faa02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:38:52.154774 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1491c1-82e1-44b5-a2af-dd4dae1faa02 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:38:52.178565 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1163/2327] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 11:38:52 2022] POST /identity/v3/users => generated 287 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 11:38:52.183023 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f54577-5cc0-4af9-a83b-0f31236941d5 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:38:52.195215 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f54577-5cc0-4af9-a83b-0f31236941d5 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:38:52.200406 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa0fc46-b23b-4a46-848d-57e08a3d1a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:38:52.201315 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa0fc46-b23b-4a46-848d-57e08a3d1a0b admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:38:52.201598 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa0fc46-b23b-4a46-848d-57e08a3d1a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:38:52.201869 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa0fc46-b23b-4a46-848d-57e08a3d1a0b admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:38:52.202581 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa0fc46-b23b-4a46-848d-57e08a3d1a0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:38:52.204332 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa0fc46-b23b-4a46-848d-57e08a3d1a0b admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:38:52.215298 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1165/2328] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:38:52 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 11:38:52.219452 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1491c1-82e1-44b5-a2af-dd4dae1faa02 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:38:52.231509 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1491c1-82e1-44b5-a2af-dd4dae1faa02 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:38:52.236468 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f6a7f8-28f2-4ddb-a4d0-abc876cb743e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:38:52.237227 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f6a7f8-28f2-4ddb-a4d0-abc876cb743e admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:38:52.237502 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f6a7f8-28f2-4ddb-a4d0-abc876cb743e admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:38:52.237770 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f6a7f8-28f2-4ddb-a4d0-abc876cb743e admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:38:52.238568 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f6a7f8-28f2-4ddb-a4d0-abc876cb743e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:38:52.240351 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f6a7f8-28f2-4ddb-a4d0-abc876cb743e admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:38:52.255696 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1164/2329] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:38:52 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:38:52.256997 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa0fc46-b23b-4a46-848d-57e08a3d1a0b admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:38:52.267595 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa0fc46-b23b-4a46-848d-57e08a3d1a0b admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:38:52.272347 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5343fd-56f0-4a0d-98c8-f19456498f0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:38:52.273008 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5343fd-56f0-4a0d-98c8-f19456498f0a admin admin] REQUEST_METHOD: `PUT` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:38:52.273284 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5343fd-56f0-4a0d-98c8-f19456498f0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:38:52.273556 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5343fd-56f0-4a0d-98c8-f19456498f0a admin admin] PATH_INFO: `/v3/projects/cdf7336e4b6147d6a03df99a9bd75faf/users/8398764e258741bd9d959de0a301d478/roles/27e3e65e24df4b86b0d3d18d3212101d` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:38:52.290126 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5343fd-56f0-4a0d-98c8-f19456498f0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdf7336e4b6147d6a03df99a9bd75faf, user_id=8398764e258741bd9d959de0a301d478, role_id=27e3e65e24df4b86b0d3d18d3212101d)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:38:52.292895 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5343fd-56f0-4a0d-98c8-f19456498f0a admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:38:52.310789 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1166/2330] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 11:38:52 2022] PUT /identity/v3/projects/cdf7336e4b6147d6a03df99a9bd75faf/users/8398764e258741bd9d959de0a301d478/roles/27e3e65e24df4b86b0d3d18d3212101d => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:38:52.321249 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c22635-176c-4ca3-8225-8e9ac4b6bb99 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:38:52.321528 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c22635-176c-4ca3-8225-8e9ac4b6bb99 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:38:52.321789 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c22635-176c-4ca3-8225-8e9ac4b6bb99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:38:52.353568 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-b2c22635-176c-4ca3-8225-8e9ac4b6bb99 None None] MFA Rules not processed for user `8398764e258741bd9d959de0a301d478`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:38:52.355283 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-b2c22635-176c-4ca3-8225-8e9ac4b6bb99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:38:52.364215 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:38:52.433616 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1165/2331] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:38:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:38:52.434887 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5343fd-56f0-4a0d-98c8-f19456498f0a admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:38:52.504360 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5343fd-56f0-4a0d-98c8-f19456498f0a admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:38:52.509793 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1aee0f-121f-480e-90d7-2782214570b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:38:52.510667 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1aee0f-121f-480e-90d7-2782214570b3 admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:38:52.511482 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1aee0f-121f-480e-90d7-2782214570b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:38:52.511482 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1aee0f-121f-480e-90d7-2782214570b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:38:52.512117 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1aee0f-121f-480e-90d7-2782214570b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:38:52.514153 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1aee0f-121f-480e-90d7-2782214570b3 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:38:52.565167 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1167/2332] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 11:38:52 2022] POST /identity/v3/projects => generated 369 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:38:52.570009 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c22635-176c-4ca3-8225-8e9ac4b6bb99 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:38:52.587734 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c22635-176c-4ca3-8225-8e9ac4b6bb99 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:38:52.677627 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499d06c6-9f47-4762-95a3-cd8823ff4c83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:38:52.678531 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499d06c6-9f47-4762-95a3-cd8823ff4c83 admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:38:52.678907 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499d06c6-9f47-4762-95a3-cd8823ff4c83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:38:52.679286 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499d06c6-9f47-4762-95a3-cd8823ff4c83 admin admin] PATH_INFO: `/v3/users` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:38:52.680023 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499d06c6-9f47-4762-95a3-cd8823ff4c83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:38:52.682263 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499d06c6-9f47-4762-95a3-cd8823ff4c83 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:38:52.709994 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1166/2333] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 11:38:52 2022] POST /identity/v3/users => generated 291 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:38:52.713771 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1aee0f-121f-480e-90d7-2782214570b3 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:38:52.733564 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1aee0f-121f-480e-90d7-2782214570b3 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:38:52.747501 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e46abd9-b19f-4693-8b09-f26570d95179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:38:52.748716 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e46abd9-b19f-4693-8b09-f26570d95179 admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:38:52.748716 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e46abd9-b19f-4693-8b09-f26570d95179 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:38:52.748716 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e46abd9-b19f-4693-8b09-f26570d95179 admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:38:52.749380 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e46abd9-b19f-4693-8b09-f26570d95179 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:38:52.751472 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e46abd9-b19f-4693-8b09-f26570d95179 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:38:52.766941 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1168/2334] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:38:52 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 11:38:52.771243 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499d06c6-9f47-4762-95a3-cd8823ff4c83 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:38:52.784208 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499d06c6-9f47-4762-95a3-cd8823ff4c83 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:38:52.789923 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c088da70-88af-48d2-bb0d-2e9e7c367c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:38:52.790795 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c088da70-88af-48d2-bb0d-2e9e7c367c75 admin admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:38:52.791140 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c088da70-88af-48d2-bb0d-2e9e7c367c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:38:52.791597 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c088da70-88af-48d2-bb0d-2e9e7c367c75 admin admin] PATH_INFO: `/v3/projects/3bfbebb864c6480185a2bb1faa6cd802/users/c3cefb84e5f74539b3cbd061f82a3480/roles/30bb1e97257f4ca5b90c88545777317b` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:38:52.814233 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c088da70-88af-48d2-bb0d-2e9e7c367c75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bfbebb864c6480185a2bb1faa6cd802, user_id=c3cefb84e5f74539b3cbd061f82a3480, role_id=30bb1e97257f4ca5b90c88545777317b)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:38:52.817388 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c088da70-88af-48d2-bb0d-2e9e7c367c75 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:38:52.851909 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1167/2335] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 11:38:52 2022] PUT /identity/v3/projects/3bfbebb864c6480185a2bb1faa6cd802/users/c3cefb84e5f74539b3cbd061f82a3480/roles/30bb1e97257f4ca5b90c88545777317b => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 11:38:52.855623 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e46abd9-b19f-4693-8b09-f26570d95179 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:38:52.871974 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e46abd9-b19f-4693-8b09-f26570d95179 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:38:52.919220 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:38:52.969740 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315dad09-b0f4-40e8-9d7e-2bc2b0784bbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:38:52.970971 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315dad09-b0f4-40e8-9d7e-2bc2b0784bbb admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:38:52.973108 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315dad09-b0f4-40e8-9d7e-2bc2b0784bbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:38:52.973461 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315dad09-b0f4-40e8-9d7e-2bc2b0784bbb admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:38:52.974647 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315dad09-b0f4-40e8-9d7e-2bc2b0784bbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:38:52.976864 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315dad09-b0f4-40e8-9d7e-2bc2b0784bbb admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:38:52.991717 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1169/2336] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:38:52 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:38:52.995969 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c088da70-88af-48d2-bb0d-2e9e7c367c75 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:38:53.007573 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c088da70-88af-48d2-bb0d-2e9e7c367c75 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:38:53.012489 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf0be44-beb8-4884-b1a8-63f2af58d23e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:38:53.013294 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf0be44-beb8-4884-b1a8-63f2af58d23e admin admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:38:53.013570 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf0be44-beb8-4884-b1a8-63f2af58d23e admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:38:53.013907 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf0be44-beb8-4884-b1a8-63f2af58d23e admin admin] PATH_INFO: `/v3/projects/3bfbebb864c6480185a2bb1faa6cd802/users/c3cefb84e5f74539b3cbd061f82a3480/roles/30bb1e97257f4ca5b90c88545777317b` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:38:53.015950 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf0be44-beb8-4884-b1a8-63f2af58d23e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bfbebb864c6480185a2bb1faa6cd802, user_id=c3cefb84e5f74539b3cbd061f82a3480, role_id=30bb1e97257f4ca5b90c88545777317b)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:38:53.019095 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf0be44-beb8-4884-b1a8-63f2af58d23e admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:38:53.036032 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1168/2337] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 11:38:52 2022] PUT /identity/v3/projects/3bfbebb864c6480185a2bb1faa6cd802/users/c3cefb84e5f74539b3cbd061f82a3480/roles/30bb1e97257f4ca5b90c88545777317b => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 11:38:53.047481 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2e5f1f-a6b5-4aaf-b857-19d2a518ab65 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:38:53.048087 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2e5f1f-a6b5-4aaf-b857-19d2a518ab65 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:38:53.048541 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2e5f1f-a6b5-4aaf-b857-19d2a518ab65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:38:53.085362 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-fd2e5f1f-a6b5-4aaf-b857-19d2a518ab65 None None] MFA Rules not processed for user `c3cefb84e5f74539b3cbd061f82a3480`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:38:53.087232 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-fd2e5f1f-a6b5-4aaf-b857-19d2a518ab65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:38:53.205305 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1170/2338] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:38:53 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:38:53.213075 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf0be44-beb8-4884-b1a8-63f2af58d23e admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:38:53.215044 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-bcf0be44-beb8-4884-b1a8-63f2af58d23e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:38:53.315843 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf0be44-beb8-4884-b1a8-63f2af58d23e admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:38:53.324953 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602b8e6d-db30-4a58-82dc-c2077aecab22 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92862b76ba3b4513b5dc5b5c962faac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:38:53.325594 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602b8e6d-db30-4a58-82dc-c2077aecab22 service cinder] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:38:53.325870 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602b8e6d-db30-4a58-82dc-c2077aecab22 service cinder] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:38:53.326136 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602b8e6d-db30-4a58-82dc-c2077aecab22 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:38:53.339014 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602b8e6d-db30-4a58-82dc-c2077aecab22 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:38:53.341456 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602b8e6d-db30-4a58-82dc-c2077aecab22 service cinder] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:38:53.355888 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1169/2339] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:38:53 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:38:53.888166 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2e5f1f-a6b5-4aaf-b857-19d2a518ab65 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:38:53.991697 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2e5f1f-a6b5-4aaf-b857-19d2a518ab65 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:38:53.997055 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249fcd4c-ee1e-44ca-ae18-4f5276c3f9b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:38:53.997802 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249fcd4c-ee1e-44ca-ae18-4f5276c3f9b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:38:53.998173 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249fcd4c-ee1e-44ca-ae18-4f5276c3f9b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:38:53.998600 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249fcd4c-ee1e-44ca-ae18-4f5276c3f9b0 admin admin] PATH_INFO: `/v3/users/8398764e258741bd9d959de0a301d478` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:38:54.001103 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249fcd4c-ee1e-44ca-ae18-4f5276c3f9b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8398764e258741bd9d959de0a301d478)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:38:54.004763 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249fcd4c-ee1e-44ca-ae18-4f5276c3f9b0 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:38:54.090302 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-249fcd4c-ee1e-44ca-ae18-4f5276c3f9b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8398764e258741bd9d959de0a301d478'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:38:54.091275 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-249fcd4c-ee1e-44ca-ae18-4f5276c3f9b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8398764e258741bd9d959de0a301d478'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:38:54.092050 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-249fcd4c-ee1e-44ca-ae18-4f5276c3f9b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8398764e258741bd9d959de0a301d478'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:38:54.094715 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:38:54.108866 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-249fcd4c-ee1e-44ca-ae18-4f5276c3f9b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8398764e258741bd9d959de0a301d478'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:38:54.121815 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-249fcd4c-ee1e-44ca-ae18-4f5276c3f9b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8398764e258741bd9d959de0a301d478'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:38:54.146398 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1171/2340] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 11:38:53 2022] DELETE /identity/v3/users/8398764e258741bd9d959de0a301d478 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:38:54.147956 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fcade8-d541-4df7-86d6-2183cfd9a05a None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:38:54.148225 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fcade8-d541-4df7-86d6-2183cfd9a05a None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:38:54.148503 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fcade8-d541-4df7-86d6-2183cfd9a05a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:38:54.174811 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:38:54.186911 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-a4fcade8-d541-4df7-86d6-2183cfd9a05a None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:38:54.189802 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-a4fcade8-d541-4df7-86d6-2183cfd9a05a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:38:54.284403 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1170/2341] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:38:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:38:54.300068 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249fcd4c-ee1e-44ca-ae18-4f5276c3f9b0 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:38:54.301572 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-249fcd4c-ee1e-44ca-ae18-4f5276c3f9b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:38:54.374036 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249fcd4c-ee1e-44ca-ae18-4f5276c3f9b0 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:38:54.378432 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8c7ffb-fdc8-47eb-97da-bdfc60fb3b14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2d061d25d83443c9232218c90792d51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:38:54.378881 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8c7ffb-fdc8-47eb-97da-bdfc60fb3b14 service neutron] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:38:54.379254 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8c7ffb-fdc8-47eb-97da-bdfc60fb3b14 service neutron] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:38:54.379616 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8c7ffb-fdc8-47eb-97da-bdfc60fb3b14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:38:54.389873 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8c7ffb-fdc8-47eb-97da-bdfc60fb3b14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:38:54.391498 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8c7ffb-fdc8-47eb-97da-bdfc60fb3b14 service neutron] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:38:54.411686 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1172/2342] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:38:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:38:54.424637 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fcade8-d541-4df7-86d6-2183cfd9a05a None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:38:54.441322 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fcade8-d541-4df7-86d6-2183cfd9a05a None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:38:54.446083 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3e06fd-a9b9-4155-b57f-c890ec7037a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2d061d25d83443c9232218c90792d51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:38:54.446735 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3e06fd-a9b9-4155-b57f-c890ec7037a0 service neutron] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:38:54.447019 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3e06fd-a9b9-4155-b57f-c890ec7037a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:38:54.450456 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3e06fd-a9b9-4155-b57f-c890ec7037a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:38:54.450456 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-8a3e06fd-a9b9-4155-b57f-c890ec7037a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:38:54.479833 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3e06fd-a9b9-4155-b57f-c890ec7037a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:38:54.481585 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3e06fd-a9b9-4155-b57f-c890ec7037a0 service neutron] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:38:54.508732 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1171/2343] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:38:54 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:38:54.872290 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8c7ffb-fdc8-47eb-97da-bdfc60fb3b14 service neutron] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:38:54.875344 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-3b8c7ffb-fdc8-47eb-97da-bdfc60fb3b14 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:38:54.910510 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8c7ffb-fdc8-47eb-97da-bdfc60fb3b14 service neutron] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:38:54.924067 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40421908-bb4f-45a4-97e4-22d3823bb7c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:38:54.924730 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40421908-bb4f-45a4-97e4-22d3823bb7c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:38:54.925499 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40421908-bb4f-45a4-97e4-22d3823bb7c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:38:54.925820 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40421908-bb4f-45a4-97e4-22d3823bb7c3 admin admin] PATH_INFO: `/v3/projects/cdf7336e4b6147d6a03df99a9bd75faf` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:38:54.927006 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40421908-bb4f-45a4-97e4-22d3823bb7c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cdf7336e4b6147d6a03df99a9bd75faf)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:38:54.930244 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40421908-bb4f-45a4-97e4-22d3823bb7c3 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:38:54.998872 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-40421908-bb4f-45a4-97e4-22d3823bb7c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cdf7336e4b6147d6a03df99a9bd75faf', 'request_id': 'req-40421908-bb4f-45a4-97e4-22d3823bb7c3'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:38:55.005726 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-40421908-bb4f-45a4-97e4-22d3823bb7c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cdf7336e4b6147d6a03df99a9bd75faf', 'request_id': 'req-40421908-bb4f-45a4-97e4-22d3823bb7c3'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:38:55.011697 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-40421908-bb4f-45a4-97e4-22d3823bb7c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cdf7336e4b6147d6a03df99a9bd75faf', 'request_id': 'req-40421908-bb4f-45a4-97e4-22d3823bb7c3'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:38:55.034343 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-40421908-bb4f-45a4-97e4-22d3823bb7c3 admin admin] The token cache is being invalidate because project cdf7336e4b6147d6a03df99a9bd75faf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81501) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:38:55.034949 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-40421908-bb4f-45a4-97e4-22d3823bb7c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:38:55.039268 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-40421908-bb4f-45a4-97e4-22d3823bb7c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:38:55.043864 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1173/2344] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 11:38:54 2022] DELETE /identity/v3/projects/cdf7336e4b6147d6a03df99a9bd75faf => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 11:38:55.048087 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3e06fd-a9b9-4155-b57f-c890ec7037a0 service neutron] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:38:55.061808 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3e06fd-a9b9-4155-b57f-c890ec7037a0 service neutron] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:38:55.173079 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80908e83-d2f6-411f-8976-08eeee134afd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:38:55.174003 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80908e83-d2f6-411f-8976-08eeee134afd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:38:55.174470 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80908e83-d2f6-411f-8976-08eeee134afd admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:38:55.174893 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80908e83-d2f6-411f-8976-08eeee134afd admin admin] PATH_INFO: `/v3/users/c3cefb84e5f74539b3cbd061f82a3480` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:38:55.176860 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80908e83-d2f6-411f-8976-08eeee134afd admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3cefb84e5f74539b3cbd061f82a3480)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:38:55.179454 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80908e83-d2f6-411f-8976-08eeee134afd admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:38:55.300400 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-80908e83-d2f6-411f-8976-08eeee134afd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3cefb84e5f74539b3cbd061f82a3480'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:38:55.301619 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-80908e83-d2f6-411f-8976-08eeee134afd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3cefb84e5f74539b3cbd061f82a3480'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:38:55.323640 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-80908e83-d2f6-411f-8976-08eeee134afd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3cefb84e5f74539b3cbd061f82a3480'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:38:55.334921 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-80908e83-d2f6-411f-8976-08eeee134afd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3cefb84e5f74539b3cbd061f82a3480'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:38:55.336403 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-80908e83-d2f6-411f-8976-08eeee134afd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3cefb84e5f74539b3cbd061f82a3480'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:38:55.375328 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1172/2345] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 11:38:55 2022] DELETE /identity/v3/users/c3cefb84e5f74539b3cbd061f82a3480 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:38:55.756204 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40421908-bb4f-45a4-97e4-22d3823bb7c3 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:38:55.758796 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-40421908-bb4f-45a4-97e4-22d3823bb7c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:38:55.801259 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40421908-bb4f-45a4-97e4-22d3823bb7c3 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:38:55.911606 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:INSERT=2,keystone:DELETE=10,keystone:SELECT=88 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:38:55.928689 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca211cb-1ba7-4b29-aa2b-aa1516a5b732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:38:55.929345 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca211cb-1ba7-4b29-aa2b-aa1516a5b732 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:38:55.929616 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca211cb-1ba7-4b29-aa2b-aa1516a5b732 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:38:55.930183 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca211cb-1ba7-4b29-aa2b-aa1516a5b732 admin admin] PATH_INFO: `/v3/projects/3bfbebb864c6480185a2bb1faa6cd802` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:38:55.931390 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca211cb-1ba7-4b29-aa2b-aa1516a5b732 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3bfbebb864c6480185a2bb1faa6cd802)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:38:55.933336 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca211cb-1ba7-4b29-aa2b-aa1516a5b732 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:38:55.995558 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-6ca211cb-1ba7-4b29-aa2b-aa1516a5b732 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3bfbebb864c6480185a2bb1faa6cd802', 'request_id': 'req-6ca211cb-1ba7-4b29-aa2b-aa1516a5b732'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:38:56.002946 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-6ca211cb-1ba7-4b29-aa2b-aa1516a5b732 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3bfbebb864c6480185a2bb1faa6cd802', 'request_id': 'req-6ca211cb-1ba7-4b29-aa2b-aa1516a5b732'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:38:56.011316 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-6ca211cb-1ba7-4b29-aa2b-aa1516a5b732 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3bfbebb864c6480185a2bb1faa6cd802', 'request_id': 'req-6ca211cb-1ba7-4b29-aa2b-aa1516a5b732'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:38:56.026979 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-6ca211cb-1ba7-4b29-aa2b-aa1516a5b732 admin admin] The token cache is being invalidate because project 3bfbebb864c6480185a2bb1faa6cd802 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81501) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:38:56.027311 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-6ca211cb-1ba7-4b29-aa2b-aa1516a5b732 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:38:56.028091 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-6ca211cb-1ba7-4b29-aa2b-aa1516a5b732 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:38:56.034237 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1174/2346] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 11:38:55 2022] DELETE /identity/v3/projects/3bfbebb864c6480185a2bb1faa6cd802 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:38:56.039585 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4ff0e6-9fd1-4923-9e1a-9e1a898750c4 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:38:56.039866 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4ff0e6-9fd1-4923-9e1a-9e1a898750c4 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:38:56.040137 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4ff0e6-9fd1-4923-9e1a-9e1a898750c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:38:56.068597 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-8b4ff0e6-9fd1-4923-9e1a-9e1a898750c4 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:38:56.071588 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-8b4ff0e6-9fd1-4923-9e1a-9e1a898750c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:38:56.080989 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:38:56.164652 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1173/2347] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:38:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 11:38:56.172498 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f4f214-8994-4b4c-9718-24b056f33f47 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:38:56.173186 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f4f214-8994-4b4c-9718-24b056f33f47 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:38:56.173940 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f4f214-8994-4b4c-9718-24b056f33f47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:38:56.199354 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-d0f4f214-8994-4b4c-9718-24b056f33f47 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:38:56.200726 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-d0f4f214-8994-4b4c-9718-24b056f33f47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:38:56.209247 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1175/2348] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:38:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:38:56.213403 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4ff0e6-9fd1-4923-9e1a-9e1a898750c4 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:38:56.225766 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4ff0e6-9fd1-4923-9e1a-9e1a898750c4 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:38:56.230665 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5983c693-0b92-46dd-a35e-e7323bffbfca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:38:56.231281 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5983c693-0b92-46dd-a35e-e7323bffbfca admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:38:56.231783 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5983c693-0b92-46dd-a35e-e7323bffbfca admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:38:56.231985 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5983c693-0b92-46dd-a35e-e7323bffbfca admin admin] PATH_INFO: `/v3/domains` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:38:56.232605 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5983c693-0b92-46dd-a35e-e7323bffbfca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:38:56.232907 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5983c693-0b92-46dd-a35e-e7323bffbfca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:38:56.234645 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5983c693-0b92-46dd-a35e-e7323bffbfca admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:38:56.253744 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1174/2349] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 24 11:38:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:38:56.255161 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f4f214-8994-4b4c-9718-24b056f33f47 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:38:56.265467 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f4f214-8994-4b4c-9718-24b056f33f47 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:38:56.271369 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842457c1-ddb3-4ea9-84fa-64947ea5ab1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:38:56.273314 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842457c1-ddb3-4ea9-84fa-64947ea5ab1a admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:38:56.273726 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842457c1-ddb3-4ea9-84fa-64947ea5ab1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:38:56.274338 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842457c1-ddb3-4ea9-84fa-64947ea5ab1a admin admin] PATH_INFO: `/v3/projects` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:38:56.275168 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842457c1-ddb3-4ea9-84fa-64947ea5ab1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:38:56.277351 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842457c1-ddb3-4ea9-84fa-64947ea5ab1a admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:38:56.313698 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1176/2350] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 11:38:56 2022] POST /identity/v3/projects => generated 375 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:38:56.318135 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5983c693-0b92-46dd-a35e-e7323bffbfca admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:38:56.331754 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5983c693-0b92-46dd-a35e-e7323bffbfca admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:38:56.403582 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cf927d-8ef8-4ae1-9a13-ab9f055610b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:38:56.404206 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cf927d-8ef8-4ae1-9a13-ab9f055610b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:38:56.404484 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cf927d-8ef8-4ae1-9a13-ab9f055610b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:38:56.404773 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cf927d-8ef8-4ae1-9a13-ab9f055610b7 admin admin] PATH_INFO: `/v3/users` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:38:56.405431 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cf927d-8ef8-4ae1-9a13-ab9f055610b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:38:56.410061 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cf927d-8ef8-4ae1-9a13-ab9f055610b7 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:38:56.439081 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1175/2351] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 11:38:56 2022] POST /identity/v3/users => generated 288 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 11:38:56.443587 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842457c1-ddb3-4ea9-84fa-64947ea5ab1a admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:38:56.459470 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842457c1-ddb3-4ea9-84fa-64947ea5ab1a admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:38:56.464222 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fea3f04-7a7f-4555-9f2a-ab559f65d491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:38:56.464839 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fea3f04-7a7f-4555-9f2a-ab559f65d491 admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:38:56.465115 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fea3f04-7a7f-4555-9f2a-ab559f65d491 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:38:56.465384 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fea3f04-7a7f-4555-9f2a-ab559f65d491 admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:38:56.466034 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fea3f04-7a7f-4555-9f2a-ab559f65d491 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:38:56.471424 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fea3f04-7a7f-4555-9f2a-ab559f65d491 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:38:56.487774 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cf927d-8ef8-4ae1-9a13-ab9f055610b7 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:38:56.490134 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1177/2352] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:38:56 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:38:56.505071 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cf927d-8ef8-4ae1-9a13-ab9f055610b7 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:38:56.516841 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6bddee-1738-4fba-906b-4f9e870756c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:38:56.517815 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6bddee-1738-4fba-906b-4f9e870756c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:38:56.518282 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6bddee-1738-4fba-906b-4f9e870756c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:38:56.518753 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6bddee-1738-4fba-906b-4f9e870756c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:38:56.519641 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6bddee-1738-4fba-906b-4f9e870756c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:38:56.521731 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6bddee-1738-4fba-906b-4f9e870756c9 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:38:56.536904 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1176/2353] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:38:56 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 11:38:56.541781 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fea3f04-7a7f-4555-9f2a-ab559f65d491 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:38:56.553173 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fea3f04-7a7f-4555-9f2a-ab559f65d491 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:38:56.558571 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beca1d2e-15f2-47c4-8608-87c6e8830a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:38:56.559370 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beca1d2e-15f2-47c4-8608-87c6e8830a92 admin admin] REQUEST_METHOD: `PUT` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:38:56.559752 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beca1d2e-15f2-47c4-8608-87c6e8830a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:38:56.560119 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beca1d2e-15f2-47c4-8608-87c6e8830a92 admin admin] PATH_INFO: `/v3/projects/031647f24221422daf258bda1c85943b/users/6ad4d0f03ebe4925a098deee75384015/roles/27e3e65e24df4b86b0d3d18d3212101d` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:38:56.578182 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beca1d2e-15f2-47c4-8608-87c6e8830a92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=031647f24221422daf258bda1c85943b, user_id=6ad4d0f03ebe4925a098deee75384015, role_id=27e3e65e24df4b86b0d3d18d3212101d)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:38:56.581138 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beca1d2e-15f2-47c4-8608-87c6e8830a92 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:38:56.603600 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1178/2354] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 11:38:56 2022] PUT /identity/v3/projects/031647f24221422daf258bda1c85943b/users/6ad4d0f03ebe4925a098deee75384015/roles/27e3e65e24df4b86b0d3d18d3212101d => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:38:56.615273 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c3c592-8617-4898-9847-81c61322b854 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:38:56.615556 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c3c592-8617-4898-9847-81c61322b854 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:38:56.615832 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c3c592-8617-4898-9847-81c61322b854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:38:56.650799 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-36c3c592-8617-4898-9847-81c61322b854 None None] MFA Rules not processed for user `6ad4d0f03ebe4925a098deee75384015`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:38:56.652630 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-36c3c592-8617-4898-9847-81c61322b854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:38:56.739798 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1177/2355] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:38:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:38:56.744743 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beca1d2e-15f2-47c4-8608-87c6e8830a92 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:38:56.821700 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beca1d2e-15f2-47c4-8608-87c6e8830a92 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:38:56.827162 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a867c86-f79c-4dff-b306-08095424d5f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:38:56.827879 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a867c86-f79c-4dff-b306-08095424d5f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:38:56.828426 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a867c86-f79c-4dff-b306-08095424d5f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:38:56.828798 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a867c86-f79c-4dff-b306-08095424d5f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:38:56.832496 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a867c86-f79c-4dff-b306-08095424d5f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:38:56.832496 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a867c86-f79c-4dff-b306-08095424d5f9 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:38:56.866608 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1179/2356] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 11:38:56 2022] POST /identity/v3/projects => generated 377 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 11:38:56.870941 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c3c592-8617-4898-9847-81c61322b854 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:38:56.884743 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c3c592-8617-4898-9847-81c61322b854 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:38:56.889390 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:38:56.961738 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d9616d-8601-48e0-815e-403516ac662d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:38:56.962443 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d9616d-8601-48e0-815e-403516ac662d admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:38:56.962683 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d9616d-8601-48e0-815e-403516ac662d admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:38:56.962958 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d9616d-8601-48e0-815e-403516ac662d admin admin] PATH_INFO: `/v3/users` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:38:56.963603 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d9616d-8601-48e0-815e-403516ac662d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:38:56.965532 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d9616d-8601-48e0-815e-403516ac662d admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:38:56.989841 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1178/2357] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 11:38:56 2022] POST /identity/v3/users => generated 295 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 11:38:56.993982 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a867c86-f79c-4dff-b306-08095424d5f9 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:38:57.001905 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:38:57.008134 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a867c86-f79c-4dff-b306-08095424d5f9 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:38:57.014971 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f0b991-b98b-4d6f-935a-8efcc8f7a745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:38:57.016606 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f0b991-b98b-4d6f-935a-8efcc8f7a745 admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:38:57.017212 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f0b991-b98b-4d6f-935a-8efcc8f7a745 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:38:57.017928 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f0b991-b98b-4d6f-935a-8efcc8f7a745 admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:38:57.018647 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f0b991-b98b-4d6f-935a-8efcc8f7a745 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:38:57.020306 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f0b991-b98b-4d6f-935a-8efcc8f7a745 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:38:57.033029 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1180/2358] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:38:56 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:38:57.038252 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d9616d-8601-48e0-815e-403516ac662d admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:38:57.049123 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d9616d-8601-48e0-815e-403516ac662d admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:38:57.058009 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bed6a0-cdfc-49e6-83b6-e42028b80ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:38:57.058748 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bed6a0-cdfc-49e6-83b6-e42028b80ad5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:38:57.059029 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bed6a0-cdfc-49e6-83b6-e42028b80ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:38:57.059301 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bed6a0-cdfc-49e6-83b6-e42028b80ad5 admin admin] PATH_INFO: `/v3/projects/fc19c98143684aecb61b2e1e2ad07b58/users/3fd3130cea054edab62cb0d108451ac5/roles/30bb1e97257f4ca5b90c88545777317b` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:38:57.075943 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bed6a0-cdfc-49e6-83b6-e42028b80ad5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc19c98143684aecb61b2e1e2ad07b58, user_id=3fd3130cea054edab62cb0d108451ac5, role_id=30bb1e97257f4ca5b90c88545777317b)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:38:57.078610 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bed6a0-cdfc-49e6-83b6-e42028b80ad5 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:38:57.094404 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1179/2359] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 11:38:57 2022] PUT /identity/v3/projects/fc19c98143684aecb61b2e1e2ad07b58/users/3fd3130cea054edab62cb0d108451ac5/roles/30bb1e97257f4ca5b90c88545777317b => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:38:57.103182 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f0b991-b98b-4d6f-935a-8efcc8f7a745 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:38:57.117195 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f0b991-b98b-4d6f-935a-8efcc8f7a745 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:38:57.179545 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b691ddaf-07ea-4150-8216-be7b82f1f921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:38:57.180160 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b691ddaf-07ea-4150-8216-be7b82f1f921 admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:38:57.180437 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b691ddaf-07ea-4150-8216-be7b82f1f921 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:38:57.180735 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b691ddaf-07ea-4150-8216-be7b82f1f921 admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:38:57.181387 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b691ddaf-07ea-4150-8216-be7b82f1f921 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:38:57.183068 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b691ddaf-07ea-4150-8216-be7b82f1f921 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:38:57.197312 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1181/2360] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:38:57 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 11:38:57.198514 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bed6a0-cdfc-49e6-83b6-e42028b80ad5 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:38:57.213637 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bed6a0-cdfc-49e6-83b6-e42028b80ad5 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:38:57.220895 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df242ab4-d83e-414f-b680-485ea7fe520c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:38:57.221659 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df242ab4-d83e-414f-b680-485ea7fe520c admin admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:38:57.221942 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df242ab4-d83e-414f-b680-485ea7fe520c admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:38:57.222207 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df242ab4-d83e-414f-b680-485ea7fe520c admin admin] PATH_INFO: `/v3/projects/fc19c98143684aecb61b2e1e2ad07b58/users/3fd3130cea054edab62cb0d108451ac5/roles/30bb1e97257f4ca5b90c88545777317b` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:38:57.224189 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df242ab4-d83e-414f-b680-485ea7fe520c admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc19c98143684aecb61b2e1e2ad07b58, user_id=3fd3130cea054edab62cb0d108451ac5, role_id=30bb1e97257f4ca5b90c88545777317b)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:38:57.226954 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df242ab4-d83e-414f-b680-485ea7fe520c admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:38:57.249809 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1180/2361] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 11:38:57 2022] PUT /identity/v3/projects/fc19c98143684aecb61b2e1e2ad07b58/users/3fd3130cea054edab62cb0d108451ac5/roles/30bb1e97257f4ca5b90c88545777317b => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:38:57.251736 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7538ace-122f-40b2-9376-a20b4ff41541 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:38:57.252247 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7538ace-122f-40b2-9376-a20b4ff41541 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:38:57.252626 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7538ace-122f-40b2-9376-a20b4ff41541 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:38:57.285045 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-b7538ace-122f-40b2-9376-a20b4ff41541 None None] MFA Rules not processed for user `3fd3130cea054edab62cb0d108451ac5`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:38:57.286643 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-b7538ace-122f-40b2-9376-a20b4ff41541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:38:57.374991 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1182/2362] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:38:57 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:38:57.387179 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df242ab4-d83e-414f-b680-485ea7fe520c admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:38:57.389167 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-df242ab4-d83e-414f-b680-485ea7fe520c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:38:57.486199 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df242ab4-d83e-414f-b680-485ea7fe520c admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:38:57.490678 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b285de-d425-47ae-8ff2-ee3fa4749966 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92862b76ba3b4513b5dc5b5c962faac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:38:57.491336 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b285de-d425-47ae-8ff2-ee3fa4749966 service cinder] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:38:57.491614 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b285de-d425-47ae-8ff2-ee3fa4749966 service cinder] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:38:57.491877 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b285de-d425-47ae-8ff2-ee3fa4749966 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:38:57.549977 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b285de-d425-47ae-8ff2-ee3fa4749966 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:38:57.551463 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b285de-d425-47ae-8ff2-ee3fa4749966 service cinder] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:38:57.563507 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1181/2363] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:38:57 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:39:00.218875 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7538ace-122f-40b2-9376-a20b4ff41541 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:39:00.229731 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7538ace-122f-40b2-9376-a20b4ff41541 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:39:00.234159 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe936d1-5c33-4182-9d22-2ee943cbcd0f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92862b76ba3b4513b5dc5b5c962faac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:39:00.234807 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe936d1-5c33-4182-9d22-2ee943cbcd0f service cinder] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:00.235085 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe936d1-5c33-4182-9d22-2ee943cbcd0f service cinder] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:00.235351 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe936d1-5c33-4182-9d22-2ee943cbcd0f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:00.245134 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe936d1-5c33-4182-9d22-2ee943cbcd0f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:39:00.246641 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe936d1-5c33-4182-9d22-2ee943cbcd0f service cinder] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:39:00.256524 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1183/2364] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:39:00 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:39:02.560531 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad4198e-86bb-496d-a85a-f6a5a2d582f5 None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:02.561172 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad4198e-86bb-496d-a85a-f6a5a2d582f5 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:02.561172 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad4198e-86bb-496d-a85a-f6a5a2d582f5 None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:02.562724 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1182/2365] 10.222.0.27 () {54 vars in 921 bytes} [Wed Aug 24 11:39:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:39:02.568456 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c342759-d625-4383-8fb6-e390f72ba8fc None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:02.568933 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c342759-d625-4383-8fb6-e390f72ba8fc None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:02.569035 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c342759-d625-4383-8fb6-e390f72ba8fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:02.589618 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-3c342759-d625-4383-8fb6-e390f72ba8fc None None] MFA Rules not processed for user `282ec32864d046b2bea170f6a3845cc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:39:02.590959 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-3c342759-d625-4383-8fb6-e390f72ba8fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:39:02.644971 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:39:02.662649 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1184/2366] 10.222.0.27 () {58 vars in 1018 bytes} [Wed Aug 24 11:39:02 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:39:02.674748 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad4198e-86bb-496d-a85a-f6a5a2d582f5 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:39:02.676763 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-fad4198e-86bb-496d-a85a-f6a5a2d582f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:39:02.692784 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:39:02.738674 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad4198e-86bb-496d-a85a-f6a5a2d582f5 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:39:02.742553 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276176f8-9345-47c9-be64-9393a2f1c573 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abffba24649e49d28a01cbee51924ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:39:02.743160 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276176f8-9345-47c9-be64-9393a2f1c573 service glance] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:02.743438 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276176f8-9345-47c9-be64-9393a2f1c573 service glance] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:02.743711 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276176f8-9345-47c9-be64-9393a2f1c573 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:02.754246 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276176f8-9345-47c9-be64-9393a2f1c573 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:39:02.755690 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276176f8-9345-47c9-be64-9393a2f1c573 service glance] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:39:02.769823 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1183/2367] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:39:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 11:39:02.842391 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807f3bc9-bb21-4142-ab18-a5b5ebd57e1f None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:02.842719 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807f3bc9-bb21-4142-ab18-a5b5ebd57e1f None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:02.843000 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807f3bc9-bb21-4142-ab18-a5b5ebd57e1f None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:02.844377 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1185/2368] 10.222.0.27 () {54 vars in 921 bytes} [Wed Aug 24 11:39:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:39:02.849110 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67e4d87-cd52-413d-95c2-19527abdf67e None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:02.849389 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67e4d87-cd52-413d-95c2-19527abdf67e None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:02.849653 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67e4d87-cd52-413d-95c2-19527abdf67e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:02.870713 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-c67e4d87-cd52-413d-95c2-19527abdf67e None None] MFA Rules not processed for user `e2d061d25d83443c9232218c90792d51`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:39:02.872015 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-c67e4d87-cd52-413d-95c2-19527abdf67e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:39:02.932437 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1184/2369] 10.222.0.27 () {58 vars in 1018 bytes} [Wed Aug 24 11:39:02 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 11:39:02.945659 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807f3bc9-bb21-4142-ab18-a5b5ebd57e1f None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:39:02.947566 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-807f3bc9-bb21-4142-ab18-a5b5ebd57e1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:39:02.961786 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807f3bc9-bb21-4142-ab18-a5b5ebd57e1f None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:39:02.965961 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cf700d-3259-4f6e-aa30-7d6967191634 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2d061d25d83443c9232218c90792d51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:39:02.967230 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cf700d-3259-4f6e-aa30-7d6967191634 service neutron] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:02.967620 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cf700d-3259-4f6e-aa30-7d6967191634 service neutron] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:02.967903 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cf700d-3259-4f6e-aa30-7d6967191634 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:02.978968 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cf700d-3259-4f6e-aa30-7d6967191634 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:39:02.981656 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cf700d-3259-4f6e-aa30-7d6967191634 service neutron] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:39:02.993331 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1186/2370] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:39:02 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 11:39:03.099854 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b89331b-221d-466d-9844-cd47e9e04630 None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:03.100346 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b89331b-221d-466d-9844-cd47e9e04630 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:03.101107 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b89331b-221d-466d-9844-cd47e9e04630 None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:03.103260 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1185/2371] 10.222.0.27 () {54 vars in 921 bytes} [Wed Aug 24 11:39:03 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:39:03.111479 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012fe570-e8da-4c9f-b7f8-c842c748268a None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:03.111877 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012fe570-e8da-4c9f-b7f8-c842c748268a None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:03.112150 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012fe570-e8da-4c9f-b7f8-c842c748268a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:03.134880 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-012fe570-e8da-4c9f-b7f8-c842c748268a None None] MFA Rules not processed for user `282ec32864d046b2bea170f6a3845cc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:39:03.136257 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-012fe570-e8da-4c9f-b7f8-c842c748268a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:39:03.145951 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1187/2372] 10.222.0.27 () {58 vars in 1018 bytes} [Wed Aug 24 11:39:03 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:39:03.156879 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b89331b-221d-466d-9844-cd47e9e04630 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:39:03.168351 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b89331b-221d-466d-9844-cd47e9e04630 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:39:03.171945 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d1d7f6-4ea7-4cd0-a320-4b4ea9296583 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2d061d25d83443c9232218c90792d51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:39:03.173018 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d1d7f6-4ea7-4cd0-a320-4b4ea9296583 service neutron] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:03.173018 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d1d7f6-4ea7-4cd0-a320-4b4ea9296583 service neutron] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:03.173199 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d1d7f6-4ea7-4cd0-a320-4b4ea9296583 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:03.183403 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d1d7f6-4ea7-4cd0-a320-4b4ea9296583 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:39:03.184828 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d1d7f6-4ea7-4cd0-a320-4b4ea9296583 service neutron] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:39:03.195719 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1186/2373] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:39:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:39:03.261672 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012fe570-e8da-4c9f-b7f8-c842c748268a None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:39:03.263931 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-012fe570-e8da-4c9f-b7f8-c842c748268a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:39:03.335210 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012fe570-e8da-4c9f-b7f8-c842c748268a None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:39:03.340575 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a657c7-28aa-4f2a-91ad-e9f0173b7de7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad45431e70ff48a9b90905a97d473d81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:39:03.341195 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a657c7-28aa-4f2a-91ad-e9f0173b7de7 service placement] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:03.341496 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a657c7-28aa-4f2a-91ad-e9f0173b7de7 service placement] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:03.341770 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a657c7-28aa-4f2a-91ad-e9f0173b7de7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:03.343678 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-83a657c7-28aa-4f2a-91ad-e9f0173b7de7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:39:03.355318 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a657c7-28aa-4f2a-91ad-e9f0173b7de7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:39:03.357005 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a657c7-28aa-4f2a-91ad-e9f0173b7de7 service placement] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:39:03.367076 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1188/2374] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:39:03 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:39:04.997003 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5495ecae-f857-46fd-9f30-df95c24bae7d None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:04.997527 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5495ecae-f857-46fd-9f30-df95c24bae7d None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:04.997527 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5495ecae-f857-46fd-9f30-df95c24bae7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:05.017065 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-5495ecae-f857-46fd-9f30-df95c24bae7d None None] MFA Rules not processed for user `a5915030f01941fc89f92228ff57c7f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:39:05.018293 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-5495ecae-f857-46fd-9f30-df95c24bae7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:39:05.074275 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1187/2375] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Aug 24 11:39:04 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:39:05.086795 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a657c7-28aa-4f2a-91ad-e9f0173b7de7 service placement] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:39:05.088229 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-83a657c7-28aa-4f2a-91ad-e9f0173b7de7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:39:05.159240 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a657c7-28aa-4f2a-91ad-e9f0173b7de7 service placement] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:39:05.165086 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe64338-0c46-4e17-a13c-71e4114a5a17 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1069558c085449f9e4c9f06013b2a85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:39:05.165699 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe64338-0c46-4e17-a13c-71e4114a5a17 service swift] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:05.165975 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe64338-0c46-4e17-a13c-71e4114a5a17 service swift] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:05.166242 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe64338-0c46-4e17-a13c-71e4114a5a17 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:05.175060 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe64338-0c46-4e17-a13c-71e4114a5a17 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:39:05.176706 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe64338-0c46-4e17-a13c-71e4114a5a17 service swift] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:39:05.185460 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1189/2376] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Aug 24 11:39:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 11:39:13.047495 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5495ecae-f857-46fd-9f30-df95c24bae7d None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:39:13.108589 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:39:13.113017 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5495ecae-f857-46fd-9f30-df95c24bae7d None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:39:13.119140 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb77cea-7a6b-410b-b3a3-496bfd5ca309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:39:13.119888 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb77cea-7a6b-410b-b3a3-496bfd5ca309 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:13.120164 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb77cea-7a6b-410b-b3a3-496bfd5ca309 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:13.120502 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb77cea-7a6b-410b-b3a3-496bfd5ca309 admin admin] PATH_INFO: `/v3/users/6ad4d0f03ebe4925a098deee75384015` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:13.121879 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb77cea-7a6b-410b-b3a3-496bfd5ca309 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ad4d0f03ebe4925a098deee75384015)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:39:13.123853 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb77cea-7a6b-410b-b3a3-496bfd5ca309 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:39:13.186887 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-adb77cea-7a6b-410b-b3a3-496bfd5ca309 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ad4d0f03ebe4925a098deee75384015'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:39:13.187562 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-adb77cea-7a6b-410b-b3a3-496bfd5ca309 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ad4d0f03ebe4925a098deee75384015'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:39:13.197445 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-adb77cea-7a6b-410b-b3a3-496bfd5ca309 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ad4d0f03ebe4925a098deee75384015'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:39:13.205456 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-adb77cea-7a6b-410b-b3a3-496bfd5ca309 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ad4d0f03ebe4925a098deee75384015'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:39:13.206130 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-adb77cea-7a6b-410b-b3a3-496bfd5ca309 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ad4d0f03ebe4925a098deee75384015'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:39:13.226058 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1188/2377] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 11:39:13 2022] DELETE /identity/v3/users/6ad4d0f03ebe4925a098deee75384015 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:39:13.235279 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952ce78d-f9a3-4a31-9976-6fa59ed792f7 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:13.236111 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952ce78d-f9a3-4a31-9976-6fa59ed792f7 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:13.236111 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952ce78d-f9a3-4a31-9976-6fa59ed792f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:13.265953 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-952ce78d-f9a3-4a31-9976-6fa59ed792f7 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:39:13.267892 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-952ce78d-f9a3-4a31-9976-6fa59ed792f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:39:13.322416 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:39:13.337478 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1190/2378] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:39:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:39:13.347966 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb77cea-7a6b-410b-b3a3-496bfd5ca309 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:39:13.349695 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-adb77cea-7a6b-410b-b3a3-496bfd5ca309 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:39:13.422584 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb77cea-7a6b-410b-b3a3-496bfd5ca309 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:39:13.427461 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a4bfbe-0681-45f3-9686-f10a412f692e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2d061d25d83443c9232218c90792d51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:39:13.428286 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a4bfbe-0681-45f3-9686-f10a412f692e service neutron] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:13.428740 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a4bfbe-0681-45f3-9686-f10a412f692e service neutron] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:13.429114 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a4bfbe-0681-45f3-9686-f10a412f692e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:13.450719 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a4bfbe-0681-45f3-9686-f10a412f692e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:39:13.452492 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a4bfbe-0681-45f3-9686-f10a412f692e service neutron] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:39:13.465760 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1189/2379] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:39:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:39:13.736606 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952ce78d-f9a3-4a31-9976-6fa59ed792f7 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:39:13.738630 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-952ce78d-f9a3-4a31-9976-6fa59ed792f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:39:13.756013 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952ce78d-f9a3-4a31-9976-6fa59ed792f7 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:39:13.761653 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00921549-508a-46df-b49e-8a8bca17098d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:39:13.762540 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00921549-508a-46df-b49e-8a8bca17098d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:13.762921 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00921549-508a-46df-b49e-8a8bca17098d admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:13.763556 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00921549-508a-46df-b49e-8a8bca17098d admin admin] PATH_INFO: `/v3/projects/031647f24221422daf258bda1c85943b` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:13.764606 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00921549-508a-46df-b49e-8a8bca17098d admin admin] RBAC: Authorizing `identity:delete_project(project_id=031647f24221422daf258bda1c85943b)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:39:13.769616 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00921549-508a-46df-b49e-8a8bca17098d admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:39:13.838697 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-00921549-508a-46df-b49e-8a8bca17098d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '031647f24221422daf258bda1c85943b', 'request_id': 'req-00921549-508a-46df-b49e-8a8bca17098d'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:39:13.845278 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-00921549-508a-46df-b49e-8a8bca17098d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '031647f24221422daf258bda1c85943b', 'request_id': 'req-00921549-508a-46df-b49e-8a8bca17098d'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:39:13.851465 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-00921549-508a-46df-b49e-8a8bca17098d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '031647f24221422daf258bda1c85943b', 'request_id': 'req-00921549-508a-46df-b49e-8a8bca17098d'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:39:13.866007 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-00921549-508a-46df-b49e-8a8bca17098d admin admin] The token cache is being invalidate because project 031647f24221422daf258bda1c85943b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81501) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:39:13.866385 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-00921549-508a-46df-b49e-8a8bca17098d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:39:13.867314 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-00921549-508a-46df-b49e-8a8bca17098d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:39:13.869273 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1191/2380] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 11:39:13 2022] DELETE /identity/v3/projects/031647f24221422daf258bda1c85943b => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:39:13.873464 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a4bfbe-0681-45f3-9686-f10a412f692e service neutron] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:39:13.883685 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a4bfbe-0681-45f3-9686-f10a412f692e service neutron] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:39:13.947799 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d62a3ea-e6e0-4905-bf37-2f46c16e6419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:39:13.948441 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d62a3ea-e6e0-4905-bf37-2f46c16e6419 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:13.948743 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d62a3ea-e6e0-4905-bf37-2f46c16e6419 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:13.949012 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d62a3ea-e6e0-4905-bf37-2f46c16e6419 admin admin] PATH_INFO: `/v3/users/3fd3130cea054edab62cb0d108451ac5` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:13.950145 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d62a3ea-e6e0-4905-bf37-2f46c16e6419 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3fd3130cea054edab62cb0d108451ac5)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:39:13.952118 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d62a3ea-e6e0-4905-bf37-2f46c16e6419 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:39:13.977008 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:39:14.008264 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-7d62a3ea-e6e0-4905-bf37-2f46c16e6419 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3fd3130cea054edab62cb0d108451ac5'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:39:14.008972 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-7d62a3ea-e6e0-4905-bf37-2f46c16e6419 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3fd3130cea054edab62cb0d108451ac5'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:39:14.017541 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-7d62a3ea-e6e0-4905-bf37-2f46c16e6419 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3fd3130cea054edab62cb0d108451ac5'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:39:14.025825 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-7d62a3ea-e6e0-4905-bf37-2f46c16e6419 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3fd3130cea054edab62cb0d108451ac5'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:39:14.026619 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-7d62a3ea-e6e0-4905-bf37-2f46c16e6419 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3fd3130cea054edab62cb0d108451ac5'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:39:14.044472 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1190/2381] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 11:39:13 2022] DELETE /identity/v3/users/3fd3130cea054edab62cb0d108451ac5 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:39:14.343714 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00921549-508a-46df-b49e-8a8bca17098d admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:39:14.346023 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-00921549-508a-46df-b49e-8a8bca17098d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:39:14.362811 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00921549-508a-46df-b49e-8a8bca17098d admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:39:14.431817 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd662de5-c7c3-4213-93da-df769e13299a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:39:14.432537 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd662de5-c7c3-4213-93da-df769e13299a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:14.432811 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd662de5-c7c3-4213-93da-df769e13299a admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:14.433078 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd662de5-c7c3-4213-93da-df769e13299a admin admin] PATH_INFO: `/v3/projects/fc19c98143684aecb61b2e1e2ad07b58` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:14.434270 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd662de5-c7c3-4213-93da-df769e13299a admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc19c98143684aecb61b2e1e2ad07b58)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:39:14.436381 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd662de5-c7c3-4213-93da-df769e13299a admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:39:14.491202 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-bd662de5-c7c3-4213-93da-df769e13299a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc19c98143684aecb61b2e1e2ad07b58', 'request_id': 'req-bd662de5-c7c3-4213-93da-df769e13299a'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:39:14.499033 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-bd662de5-c7c3-4213-93da-df769e13299a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc19c98143684aecb61b2e1e2ad07b58', 'request_id': 'req-bd662de5-c7c3-4213-93da-df769e13299a'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:39:14.505222 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-bd662de5-c7c3-4213-93da-df769e13299a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc19c98143684aecb61b2e1e2ad07b58', 'request_id': 'req-bd662de5-c7c3-4213-93da-df769e13299a'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:39:14.519169 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-bd662de5-c7c3-4213-93da-df769e13299a admin admin] The token cache is being invalidate because project fc19c98143684aecb61b2e1e2ad07b58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81501) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:39:14.519573 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-bd662de5-c7c3-4213-93da-df769e13299a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:39:14.520302 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-bd662de5-c7c3-4213-93da-df769e13299a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:39:14.522133 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1192/2382] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 11:39:14 2022] DELETE /identity/v3/projects/fc19c98143684aecb61b2e1e2ad07b58 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:39:14.527828 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca598006-8a8e-4f47-905f-924c00719a43 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:14.528402 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca598006-8a8e-4f47-905f-924c00719a43 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:14.528402 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca598006-8a8e-4f47-905f-924c00719a43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:14.548832 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-ca598006-8a8e-4f47-905f-924c00719a43 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:39:14.550079 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-ca598006-8a8e-4f47-905f-924c00719a43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:39:14.614825 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1191/2383] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:39:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:39:14.623433 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc82d3c-3bea-4dbb-a8d0-c6fcd38e88ef None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:14.623779 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc82d3c-3bea-4dbb-a8d0-c6fcd38e88ef None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:14.624142 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc82d3c-3bea-4dbb-a8d0-c6fcd38e88ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:14.634135 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:39:14.665210 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-ddc82d3c-3bea-4dbb-a8d0-c6fcd38e88ef None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:39:14.666563 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-ddc82d3c-3bea-4dbb-a8d0-c6fcd38e88ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:39:14.674734 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1193/2384] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:39:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:39:14.679428 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca598006-8a8e-4f47-905f-924c00719a43 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:39:14.690443 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca598006-8a8e-4f47-905f-924c00719a43 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:39:14.696279 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313271d4-6ef5-413a-90f6-d2fd39750d81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:39:14.696981 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313271d4-6ef5-413a-90f6-d2fd39750d81 admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:14.697331 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313271d4-6ef5-413a-90f6-d2fd39750d81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:14.697603 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313271d4-6ef5-413a-90f6-d2fd39750d81 admin admin] PATH_INFO: `/v3/domains` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:14.698328 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313271d4-6ef5-413a-90f6-d2fd39750d81 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:39:14.698732 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313271d4-6ef5-413a-90f6-d2fd39750d81 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:39:14.700620 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313271d4-6ef5-413a-90f6-d2fd39750d81 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:39:14.718396 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1192/2385] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 24 11:39:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:39:14.720139 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc82d3c-3bea-4dbb-a8d0-c6fcd38e88ef None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:39:14.730749 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc82d3c-3bea-4dbb-a8d0-c6fcd38e88ef None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:39:14.735609 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473380b2-4bbc-4097-b660-b9cf3bb4184a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:39:14.736218 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473380b2-4bbc-4097-b660-b9cf3bb4184a admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:14.736496 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473380b2-4bbc-4097-b660-b9cf3bb4184a admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:14.736778 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473380b2-4bbc-4097-b660-b9cf3bb4184a admin admin] PATH_INFO: `/v3/projects` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:14.737395 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473380b2-4bbc-4097-b660-b9cf3bb4184a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:39:14.739452 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473380b2-4bbc-4097-b660-b9cf3bb4184a admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:39:14.772946 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1194/2386] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 11:39:14 2022] POST /identity/v3/projects => generated 407 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:39:14.774083 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313271d4-6ef5-413a-90f6-d2fd39750d81 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:39:14.784079 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313271d4-6ef5-413a-90f6-d2fd39750d81 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:39:14.857472 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cb0605-adc3-4ced-af1b-9b74038366fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:39:14.858190 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cb0605-adc3-4ced-af1b-9b74038366fb admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:14.858564 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cb0605-adc3-4ced-af1b-9b74038366fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:14.858899 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cb0605-adc3-4ced-af1b-9b74038366fb admin admin] PATH_INFO: `/v3/users` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:14.859617 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cb0605-adc3-4ced-af1b-9b74038366fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:39:14.861695 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cb0605-adc3-4ced-af1b-9b74038366fb admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:39:14.888990 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1193/2387] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 11:39:14 2022] POST /identity/v3/users => generated 304 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 11:39:14.890192 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473380b2-4bbc-4097-b660-b9cf3bb4184a admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:39:14.900602 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473380b2-4bbc-4097-b660-b9cf3bb4184a admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:39:14.905268 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bb9259-7b56-4212-b4a7-44314726c79d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:39:14.905877 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bb9259-7b56-4212-b4a7-44314726c79d admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:14.906149 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bb9259-7b56-4212-b4a7-44314726c79d admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:14.906448 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bb9259-7b56-4212-b4a7-44314726c79d admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:14.908249 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bb9259-7b56-4212-b4a7-44314726c79d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:39:14.909885 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bb9259-7b56-4212-b4a7-44314726c79d admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:39:14.924295 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1195/2388] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:39:14 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 11:39:14.929003 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cb0605-adc3-4ced-af1b-9b74038366fb admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:39:14.941399 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cb0605-adc3-4ced-af1b-9b74038366fb admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:39:14.952502 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fa533a-4296-462a-95b2-98ae9626f203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:39:14.953125 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fa533a-4296-462a-95b2-98ae9626f203 admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:14.953403 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fa533a-4296-462a-95b2-98ae9626f203 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:14.953672 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fa533a-4296-462a-95b2-98ae9626f203 admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:14.954378 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fa533a-4296-462a-95b2-98ae9626f203 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:39:14.956412 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fa533a-4296-462a-95b2-98ae9626f203 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:39:14.987114 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1194/2389] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:39:14 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:39:14.990950 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bb9259-7b56-4212-b4a7-44314726c79d admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:39:15.001858 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bb9259-7b56-4212-b4a7-44314726c79d admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:39:15.007000 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a241e7cd-32c5-4ffe-9269-f355991805a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:39:15.007793 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a241e7cd-32c5-4ffe-9269-f355991805a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:15.008163 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a241e7cd-32c5-4ffe-9269-f355991805a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:15.008530 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a241e7cd-32c5-4ffe-9269-f355991805a0 admin admin] PATH_INFO: `/v3/projects/3312cf39d42e4f86942e6bb7364ba72d/users/a3678910c77b45a58825a98bc6dc83e0/roles/27e3e65e24df4b86b0d3d18d3212101d` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:15.027502 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a241e7cd-32c5-4ffe-9269-f355991805a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3312cf39d42e4f86942e6bb7364ba72d, user_id=a3678910c77b45a58825a98bc6dc83e0, role_id=27e3e65e24df4b86b0d3d18d3212101d)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:39:15.030415 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a241e7cd-32c5-4ffe-9269-f355991805a0 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:39:15.044059 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1196/2390] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 11:39:14 2022] PUT /identity/v3/projects/3312cf39d42e4f86942e6bb7364ba72d/users/a3678910c77b45a58825a98bc6dc83e0/roles/27e3e65e24df4b86b0d3d18d3212101d => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 11:39:15.055739 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cd1cf0-cf48-41dc-8b84-c4d2882b59c1 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:15.056025 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cd1cf0-cf48-41dc-8b84-c4d2882b59c1 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:15.056294 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cd1cf0-cf48-41dc-8b84-c4d2882b59c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:15.064742 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:39:15.088491 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-d2cd1cf0-cf48-41dc-8b84-c4d2882b59c1 None None] MFA Rules not processed for user `a3678910c77b45a58825a98bc6dc83e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:39:15.089716 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-d2cd1cf0-cf48-41dc-8b84-c4d2882b59c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:39:15.162885 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1195/2391] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:39:15 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:39:15.167479 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a241e7cd-32c5-4ffe-9269-f355991805a0 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:39:15.234687 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a241e7cd-32c5-4ffe-9269-f355991805a0 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:39:15.239575 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae78d1bf-38ee-4146-bf95-fb244f3bbc4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:39:15.240246 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae78d1bf-38ee-4146-bf95-fb244f3bbc4d admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:15.240550 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae78d1bf-38ee-4146-bf95-fb244f3bbc4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:15.240819 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae78d1bf-38ee-4146-bf95-fb244f3bbc4d admin admin] PATH_INFO: `/v3/projects` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:15.241465 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae78d1bf-38ee-4146-bf95-fb244f3bbc4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:39:15.243862 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae78d1bf-38ee-4146-bf95-fb244f3bbc4d admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:39:15.272493 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1197/2392] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 11:39:15 2022] POST /identity/v3/projects => generated 407 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:39:15.276784 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cd1cf0-cf48-41dc-8b84-c4d2882b59c1 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:39:15.288564 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cd1cf0-cf48-41dc-8b84-c4d2882b59c1 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:39:15.341025 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae78d1bf-38ee-4146-bf95-fb244f3bbc4d admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:39:15.342933 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-ae78d1bf-38ee-4146-bf95-fb244f3bbc4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:39:15.348816 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcd5a77-f34d-4922-9e39-fc819a6be90c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:39:15.349427 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcd5a77-f34d-4922-9e39-fc819a6be90c admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:15.349708 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcd5a77-f34d-4922-9e39-fc819a6be90c admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:15.349980 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcd5a77-f34d-4922-9e39-fc819a6be90c admin admin] PATH_INFO: `/v3/users` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:15.350783 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcd5a77-f34d-4922-9e39-fc819a6be90c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:39:15.352603 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcd5a77-f34d-4922-9e39-fc819a6be90c admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:39:15.379840 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1196/2393] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 11:39:15 2022] POST /identity/v3/users => generated 310 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:39:15.380970 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcd5a77-f34d-4922-9e39-fc819a6be90c admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:39:15.391220 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcd5a77-f34d-4922-9e39-fc819a6be90c admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:39:15.395974 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaca06a-5616-4480-bc9b-9b268311c876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:39:15.396567 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaca06a-5616-4480-bc9b-9b268311c876 admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:15.396825 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaca06a-5616-4480-bc9b-9b268311c876 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:15.397100 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaca06a-5616-4480-bc9b-9b268311c876 admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:15.397734 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaca06a-5616-4480-bc9b-9b268311c876 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:39:15.399384 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaca06a-5616-4480-bc9b-9b268311c876 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:39:15.419491 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1197/2394] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:39:15 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 11:39:15.421240 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaca06a-5616-4480-bc9b-9b268311c876 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:39:15.428588 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae78d1bf-38ee-4146-bf95-fb244f3bbc4d admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:39:15.433047 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaca06a-5616-4480-bc9b-9b268311c876 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:39:15.434896 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb251f62-da14-43f5-b8c9-5901e0a9e5d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '282ec32864d046b2bea170f6a3845cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:39:15.435506 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb251f62-da14-43f5-b8c9-5901e0a9e5d5 service nova] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:15.435780 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb251f62-da14-43f5-b8c9-5901e0a9e5d5 service nova] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:15.436063 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb251f62-da14-43f5-b8c9-5901e0a9e5d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:15.437836 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-bb251f62-da14-43f5-b8c9-5901e0a9e5d5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:39:15.438344 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6912735-a9cb-4ff6-94d4-b1fe1a2cf3bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:39:15.439034 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6912735-a9cb-4ff6-94d4-b1fe1a2cf3bd admin admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:15.439308 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6912735-a9cb-4ff6-94d4-b1fe1a2cf3bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:15.439578 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6912735-a9cb-4ff6-94d4-b1fe1a2cf3bd admin admin] PATH_INFO: `/v3/projects/f1550bfd2e154fc5ae1611713828e733/users/d5e7245d68e640109bdd8b0ff837ed6d/roles/30bb1e97257f4ca5b90c88545777317b` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:15.455638 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6912735-a9cb-4ff6-94d4-b1fe1a2cf3bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1550bfd2e154fc5ae1611713828e733, user_id=d5e7245d68e640109bdd8b0ff837ed6d, role_id=30bb1e97257f4ca5b90c88545777317b)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:39:15.458614 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6912735-a9cb-4ff6-94d4-b1fe1a2cf3bd admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:39:15.460330 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:39:15.484226 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1198/2395] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 11:39:15 2022] PUT /identity/v3/projects/f1550bfd2e154fc5ae1611713828e733/users/d5e7245d68e640109bdd8b0ff837ed6d/roles/30bb1e97257f4ca5b90c88545777317b => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:39:15.489982 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6912735-a9cb-4ff6-94d4-b1fe1a2cf3bd admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:39:15.502298 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb251f62-da14-43f5-b8c9-5901e0a9e5d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:39:15.504099 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb251f62-da14-43f5-b8c9-5901e0a9e5d5 service nova] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:39:15.516334 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1198/2396] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:39:15 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 11:39:15.550485 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:39:15.572351 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6912735-a9cb-4ff6-94d4-b1fe1a2cf3bd admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:39:15.578124 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddea5fe4-42c7-4c85-939b-a437f9ef03a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:39:15.579055 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddea5fe4-42c7-4c85-939b-a437f9ef03a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:15.579460 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddea5fe4-42c7-4c85-939b-a437f9ef03a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:15.579880 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddea5fe4-42c7-4c85-939b-a437f9ef03a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:15.580850 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddea5fe4-42c7-4c85-939b-a437f9ef03a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:39:15.583628 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddea5fe4-42c7-4c85-939b-a437f9ef03a9 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:39:15.594040 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1199/2397] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:39:15 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:39:15.598304 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb251f62-da14-43f5-b8c9-5901e0a9e5d5 service nova] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:39:15.609224 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb251f62-da14-43f5-b8c9-5901e0a9e5d5 service nova] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:39:15.613858 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c81effe-bc42-4451-bca2-79d26a982ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:39:15.614574 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c81effe-bc42-4451-bca2-79d26a982ddb admin admin] REQUEST_METHOD: `PUT` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:15.614838 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c81effe-bc42-4451-bca2-79d26a982ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:15.615109 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c81effe-bc42-4451-bca2-79d26a982ddb admin admin] PATH_INFO: `/v3/projects/f1550bfd2e154fc5ae1611713828e733/users/d5e7245d68e640109bdd8b0ff837ed6d/roles/30bb1e97257f4ca5b90c88545777317b` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:15.616976 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c81effe-bc42-4451-bca2-79d26a982ddb admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1550bfd2e154fc5ae1611713828e733, user_id=d5e7245d68e640109bdd8b0ff837ed6d, role_id=30bb1e97257f4ca5b90c88545777317b)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:39:15.620006 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c81effe-bc42-4451-bca2-79d26a982ddb admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:39:15.631307 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1199/2398] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 11:39:15 2022] PUT /identity/v3/projects/f1550bfd2e154fc5ae1611713828e733/users/d5e7245d68e640109bdd8b0ff837ed6d/roles/30bb1e97257f4ca5b90c88545777317b => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:39:15.643159 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db68841-e12f-41db-931e-fa8b232625c5 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:15.643618 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db68841-e12f-41db-931e-fa8b232625c5 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:15.643988 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db68841-e12f-41db-931e-fa8b232625c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:15.689953 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-4db68841-e12f-41db-931e-fa8b232625c5 None None] MFA Rules not processed for user `d5e7245d68e640109bdd8b0ff837ed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:39:15.691800 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-4db68841-e12f-41db-931e-fa8b232625c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:39:15.771574 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1200/2399] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:39:15 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:39:15.784929 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c81effe-bc42-4451-bca2-79d26a982ddb admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:39:15.787697 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-9c81effe-bc42-4451-bca2-79d26a982ddb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:39:15.884251 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c81effe-bc42-4451-bca2-79d26a982ddb admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:39:15.888613 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baae3187-d6fc-4c94-80a3-8281ba66ee87 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92862b76ba3b4513b5dc5b5c962faac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:39:15.889277 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baae3187-d6fc-4c94-80a3-8281ba66ee87 service cinder] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:15.889568 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baae3187-d6fc-4c94-80a3-8281ba66ee87 service cinder] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:15.889827 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baae3187-d6fc-4c94-80a3-8281ba66ee87 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:15.900562 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baae3187-d6fc-4c94-80a3-8281ba66ee87 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:39:15.902029 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baae3187-d6fc-4c94-80a3-8281ba66ee87 service cinder] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:39:15.912255 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1200/2400] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:39:15 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:39:16.064595 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db68841-e12f-41db-931e-fa8b232625c5 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:39:16.075027 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db68841-e12f-41db-931e-fa8b232625c5 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:39:16.078866 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0414fce3-0724-46e1-ac13-fc3b5e049acb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92862b76ba3b4513b5dc5b5c962faac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:39:16.079469 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0414fce3-0724-46e1-ac13-fc3b5e049acb service cinder] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:16.079745 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0414fce3-0724-46e1-ac13-fc3b5e049acb service cinder] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:16.080016 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0414fce3-0724-46e1-ac13-fc3b5e049acb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:16.141625 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0414fce3-0724-46e1-ac13-fc3b5e049acb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:39:16.143151 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0414fce3-0724-46e1-ac13-fc3b5e049acb service cinder] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:39:16.152060 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1201/2401] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:39:16 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:39:21.189867 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baae3187-d6fc-4c94-80a3-8281ba66ee87 service cinder] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:39:21.263905 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baae3187-d6fc-4c94-80a3-8281ba66ee87 service cinder] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:39:21.269253 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6e388f-4ced-4f1d-be1f-0da5de1a1646 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '282ec32864d046b2bea170f6a3845cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:39:21.269888 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6e388f-4ced-4f1d-be1f-0da5de1a1646 service nova] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:21.270164 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6e388f-4ced-4f1d-be1f-0da5de1a1646 service nova] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:21.270465 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6e388f-4ced-4f1d-be1f-0da5de1a1646 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:21.272246 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-4f6e388f-4ced-4f1d-be1f-0da5de1a1646 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:39:21.284117 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6e388f-4ced-4f1d-be1f-0da5de1a1646 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:39:21.285753 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6e388f-4ced-4f1d-be1f-0da5de1a1646 service nova] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:39:21.296246 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1201/2402] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:39:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:39:21.503315 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0414fce3-0724-46e1-ac13-fc3b5e049acb service cinder] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:39:21.569643 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0414fce3-0724-46e1-ac13-fc3b5e049acb service cinder] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:39:21.574245 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040cd738-856f-4439-a14b-282763c09d2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:39:21.574904 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040cd738-856f-4439-a14b-282763c09d2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:21.575182 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040cd738-856f-4439-a14b-282763c09d2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:21.575453 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040cd738-856f-4439-a14b-282763c09d2b admin admin] PATH_INFO: `/v3/users/a3678910c77b45a58825a98bc6dc83e0` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:21.576586 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040cd738-856f-4439-a14b-282763c09d2b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3678910c77b45a58825a98bc6dc83e0)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:39:21.578569 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040cd738-856f-4439-a14b-282763c09d2b admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:39:21.589349 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:39:21.630318 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-040cd738-856f-4439-a14b-282763c09d2b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3678910c77b45a58825a98bc6dc83e0'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:39:21.631092 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-040cd738-856f-4439-a14b-282763c09d2b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3678910c77b45a58825a98bc6dc83e0'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:39:21.640539 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-040cd738-856f-4439-a14b-282763c09d2b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3678910c77b45a58825a98bc6dc83e0'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:39:21.650191 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-040cd738-856f-4439-a14b-282763c09d2b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3678910c77b45a58825a98bc6dc83e0'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:39:21.651060 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-040cd738-856f-4439-a14b-282763c09d2b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3678910c77b45a58825a98bc6dc83e0'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:39:21.669648 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1202/2403] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 11:39:21 2022] DELETE /identity/v3/users/a3678910c77b45a58825a98bc6dc83e0 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:39:21.674331 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b671c2-faac-4c00-afa0-b8f023260d96 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:21.674678 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b671c2-faac-4c00-afa0-b8f023260d96 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:21.674952 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b671c2-faac-4c00-afa0-b8f023260d96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:21.695639 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-b6b671c2-faac-4c00-afa0-b8f023260d96 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:39:21.696865 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-b6b671c2-faac-4c00-afa0-b8f023260d96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:39:21.730976 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:39:21.760513 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1202/2404] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:39:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:39:21.770530 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040cd738-856f-4439-a14b-282763c09d2b admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:39:21.772058 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-040cd738-856f-4439-a14b-282763c09d2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:39:21.830220 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040cd738-856f-4439-a14b-282763c09d2b admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:39:21.833804 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac56e99-928e-43d7-a21d-ed8aa27d78af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2d061d25d83443c9232218c90792d51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:39:21.834444 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac56e99-928e-43d7-a21d-ed8aa27d78af service neutron] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:21.834727 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac56e99-928e-43d7-a21d-ed8aa27d78af service neutron] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:21.834998 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac56e99-928e-43d7-a21d-ed8aa27d78af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:21.843869 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac56e99-928e-43d7-a21d-ed8aa27d78af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:39:21.845308 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac56e99-928e-43d7-a21d-ed8aa27d78af service neutron] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:39:21.854701 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1203/2405] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:39:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:39:22.154553 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b671c2-faac-4c00-afa0-b8f023260d96 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:39:22.156043 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-b6b671c2-faac-4c00-afa0-b8f023260d96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:39:22.168642 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b671c2-faac-4c00-afa0-b8f023260d96 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:39:22.173715 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d3c52b-4b1c-444b-88f0-2017b3566d8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:39:22.174395 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d3c52b-4b1c-444b-88f0-2017b3566d8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:22.174726 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d3c52b-4b1c-444b-88f0-2017b3566d8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:22.174956 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d3c52b-4b1c-444b-88f0-2017b3566d8d admin admin] PATH_INFO: `/v3/projects/3312cf39d42e4f86942e6bb7364ba72d` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:22.176116 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d3c52b-4b1c-444b-88f0-2017b3566d8d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3312cf39d42e4f86942e6bb7364ba72d)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:39:22.178176 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d3c52b-4b1c-444b-88f0-2017b3566d8d admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:39:22.226750 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-37d3c52b-4b1c-444b-88f0-2017b3566d8d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3312cf39d42e4f86942e6bb7364ba72d', 'request_id': 'req-37d3c52b-4b1c-444b-88f0-2017b3566d8d'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:39:22.233064 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-37d3c52b-4b1c-444b-88f0-2017b3566d8d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3312cf39d42e4f86942e6bb7364ba72d', 'request_id': 'req-37d3c52b-4b1c-444b-88f0-2017b3566d8d'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:39:22.239064 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-37d3c52b-4b1c-444b-88f0-2017b3566d8d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3312cf39d42e4f86942e6bb7364ba72d', 'request_id': 'req-37d3c52b-4b1c-444b-88f0-2017b3566d8d'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:39:22.254219 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-37d3c52b-4b1c-444b-88f0-2017b3566d8d admin admin] The token cache is being invalidate because project 3312cf39d42e4f86942e6bb7364ba72d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81501) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:39:22.254502 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-37d3c52b-4b1c-444b-88f0-2017b3566d8d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:39:22.255141 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-37d3c52b-4b1c-444b-88f0-2017b3566d8d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:39:22.256697 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1203/2406] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 11:39:22 2022] DELETE /identity/v3/projects/3312cf39d42e4f86942e6bb7364ba72d => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:39:22.260836 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac56e99-928e-43d7-a21d-ed8aa27d78af service neutron] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:39:22.270798 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac56e99-928e-43d7-a21d-ed8aa27d78af service neutron] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:39:22.329543 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22b42c6-d9e6-49d0-bbba-f7e6a85b9b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:39:22.330293 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22b42c6-d9e6-49d0-bbba-f7e6a85b9b14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:22.330611 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22b42c6-d9e6-49d0-bbba-f7e6a85b9b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:22.330878 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22b42c6-d9e6-49d0-bbba-f7e6a85b9b14 admin admin] PATH_INFO: `/v3/users/d5e7245d68e640109bdd8b0ff837ed6d` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:22.332005 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22b42c6-d9e6-49d0-bbba-f7e6a85b9b14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5e7245d68e640109bdd8b0ff837ed6d)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:39:22.334016 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22b42c6-d9e6-49d0-bbba-f7e6a85b9b14 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:39:22.378231 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:DELETE=15,keystone:SELECT=84,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:39:22.392635 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-e22b42c6-d9e6-49d0-bbba-f7e6a85b9b14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5e7245d68e640109bdd8b0ff837ed6d'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:39:22.393288 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-e22b42c6-d9e6-49d0-bbba-f7e6a85b9b14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5e7245d68e640109bdd8b0ff837ed6d'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:39:22.403597 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-e22b42c6-d9e6-49d0-bbba-f7e6a85b9b14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5e7245d68e640109bdd8b0ff837ed6d'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:39:22.410893 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-e22b42c6-d9e6-49d0-bbba-f7e6a85b9b14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5e7245d68e640109bdd8b0ff837ed6d'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:39:22.411593 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-e22b42c6-d9e6-49d0-bbba-f7e6a85b9b14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5e7245d68e640109bdd8b0ff837ed6d'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:39:22.432092 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1204/2407] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 11:39:22 2022] DELETE /identity/v3/users/d5e7245d68e640109bdd8b0ff837ed6d => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:39:22.724873 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d3c52b-4b1c-444b-88f0-2017b3566d8d admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:39:22.727388 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-37d3c52b-4b1c-444b-88f0-2017b3566d8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:39:22.746164 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d3c52b-4b1c-444b-88f0-2017b3566d8d admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:39:22.817630 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79e17c8-b990-4d95-b4ab-20af73156847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:39:22.818280 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79e17c8-b990-4d95-b4ab-20af73156847 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:22.818675 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79e17c8-b990-4d95-b4ab-20af73156847 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:22.818953 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79e17c8-b990-4d95-b4ab-20af73156847 admin admin] PATH_INFO: `/v3/projects/f1550bfd2e154fc5ae1611713828e733` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:22.820122 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79e17c8-b990-4d95-b4ab-20af73156847 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1550bfd2e154fc5ae1611713828e733)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:39:22.822116 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79e17c8-b990-4d95-b4ab-20af73156847 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:39:22.876291 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-b79e17c8-b990-4d95-b4ab-20af73156847 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1550bfd2e154fc5ae1611713828e733', 'request_id': 'req-b79e17c8-b990-4d95-b4ab-20af73156847'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:39:22.882780 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-b79e17c8-b990-4d95-b4ab-20af73156847 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1550bfd2e154fc5ae1611713828e733', 'request_id': 'req-b79e17c8-b990-4d95-b4ab-20af73156847'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:39:22.888658 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-b79e17c8-b990-4d95-b4ab-20af73156847 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1550bfd2e154fc5ae1611713828e733', 'request_id': 'req-b79e17c8-b990-4d95-b4ab-20af73156847'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:39:22.890481 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:39:22.903316 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-b79e17c8-b990-4d95-b4ab-20af73156847 admin admin] The token cache is being invalidate because project f1550bfd2e154fc5ae1611713828e733 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81501) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:39:22.903604 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-b79e17c8-b990-4d95-b4ab-20af73156847 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:39:22.904232 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-b79e17c8-b990-4d95-b4ab-20af73156847 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:39:22.905774 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1204/2408] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 11:39:22 2022] DELETE /identity/v3/projects/f1550bfd2e154fc5ae1611713828e733 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:39:22.910749 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e1bce5-d4f2-47ab-b72a-80c06126e0b0 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:22.911241 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e1bce5-d4f2-47ab-b72a-80c06126e0b0 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:22.911342 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e1bce5-d4f2-47ab-b72a-80c06126e0b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:22.930484 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-95e1bce5-d4f2-47ab-b72a-80c06126e0b0 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:39:22.931876 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-95e1bce5-d4f2-47ab-b72a-80c06126e0b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:39:22.993624 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1205/2409] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:39:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 11:39:23.002631 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edc2759-1c4e-4346-ac66-d7a8660d2448 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:23.002917 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edc2759-1c4e-4346-ac66-d7a8660d2448 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:23.003189 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edc2759-1c4e-4346-ac66-d7a8660d2448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:23.023819 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-5edc2759-1c4e-4346-ac66-d7a8660d2448 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:39:23.025008 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-5edc2759-1c4e-4346-ac66-d7a8660d2448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:39:23.034027 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1205/2410] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:39:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:39:23.038596 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e1bce5-d4f2-47ab-b72a-80c06126e0b0 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:39:23.049031 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e1bce5-d4f2-47ab-b72a-80c06126e0b0 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:39:23.054169 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71989ba-64f4-42b9-b680-159ac4ca1f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:39:23.054822 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71989ba-64f4-42b9-b680-159ac4ca1f70 admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:23.055075 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71989ba-64f4-42b9-b680-159ac4ca1f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:23.055349 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71989ba-64f4-42b9-b680-159ac4ca1f70 admin admin] PATH_INFO: `/v3/domains` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:23.056037 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71989ba-64f4-42b9-b680-159ac4ca1f70 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:39:23.056337 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71989ba-64f4-42b9-b680-159ac4ca1f70 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:39:23.057973 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71989ba-64f4-42b9-b680-159ac4ca1f70 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:39:23.076908 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1206/2411] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 24 11:39:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:39:23.082577 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edc2759-1c4e-4346-ac66-d7a8660d2448 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:39:23.094333 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edc2759-1c4e-4346-ac66-d7a8660d2448 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:39:23.113676 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a211f457-bc9f-4950-b18d-231da6168a8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:39:23.114708 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a211f457-bc9f-4950-b18d-231da6168a8d admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:23.115355 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a211f457-bc9f-4950-b18d-231da6168a8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:23.115754 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a211f457-bc9f-4950-b18d-231da6168a8d admin admin] PATH_INFO: `/v3/projects` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:23.116956 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a211f457-bc9f-4950-b18d-231da6168a8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:39:23.119515 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a211f457-bc9f-4950-b18d-231da6168a8d admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:39:23.150617 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1206/2412] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 11:39:23 2022] POST /identity/v3/projects => generated 383 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:39:23.155109 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71989ba-64f4-42b9-b680-159ac4ca1f70 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:39:23.165236 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71989ba-64f4-42b9-b680-159ac4ca1f70 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:39:23.224597 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7511a4-59eb-478d-ba70-4734950c9e2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:39:23.225552 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7511a4-59eb-478d-ba70-4734950c9e2d admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:23.225827 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7511a4-59eb-478d-ba70-4734950c9e2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:23.226098 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7511a4-59eb-478d-ba70-4734950c9e2d admin admin] PATH_INFO: `/v3/users` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:23.226763 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7511a4-59eb-478d-ba70-4734950c9e2d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:39:23.228685 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7511a4-59eb-478d-ba70-4734950c9e2d admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:39:23.250857 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1207/2413] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 11:39:23 2022] POST /identity/v3/users => generated 292 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:39:23.255703 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a211f457-bc9f-4950-b18d-231da6168a8d admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:39:23.266551 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a211f457-bc9f-4950-b18d-231da6168a8d admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:39:23.271725 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb278e9-5fc6-4d9c-9884-4830c08ff970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:39:23.272339 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb278e9-5fc6-4d9c-9884-4830c08ff970 admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:23.272608 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb278e9-5fc6-4d9c-9884-4830c08ff970 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:23.272881 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb278e9-5fc6-4d9c-9884-4830c08ff970 admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:23.273531 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb278e9-5fc6-4d9c-9884-4830c08ff970 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:39:23.275215 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb278e9-5fc6-4d9c-9884-4830c08ff970 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:39:23.285644 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1207/2414] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:39:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 11:39:23.289787 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7511a4-59eb-478d-ba70-4734950c9e2d admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:39:23.299802 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7511a4-59eb-478d-ba70-4734950c9e2d admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:39:23.304682 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4ee442-0a9e-48d4-99c3-b4253280d520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:39:23.305321 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4ee442-0a9e-48d4-99c3-b4253280d520 admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:23.305625 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4ee442-0a9e-48d4-99c3-b4253280d520 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:23.305962 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4ee442-0a9e-48d4-99c3-b4253280d520 admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:23.306683 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4ee442-0a9e-48d4-99c3-b4253280d520 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:39:23.308371 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4ee442-0a9e-48d4-99c3-b4253280d520 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:39:23.319785 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1208/2415] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:39:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 11:39:23.324159 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb278e9-5fc6-4d9c-9884-4830c08ff970 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:39:23.335427 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb278e9-5fc6-4d9c-9884-4830c08ff970 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:39:23.347508 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfa674e-901c-40dc-a171-caff91dcf7ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:39:23.347508 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfa674e-901c-40dc-a171-caff91dcf7ca admin admin] REQUEST_METHOD: `PUT` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:23.347816 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfa674e-901c-40dc-a171-caff91dcf7ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:23.348085 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfa674e-901c-40dc-a171-caff91dcf7ca admin admin] PATH_INFO: `/v3/projects/79b97933e1b64661b7e308af605fc965/users/26a1050f3cfa4d82aa97e21a180626f7/roles/27e3e65e24df4b86b0d3d18d3212101d` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:23.367663 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfa674e-901c-40dc-a171-caff91dcf7ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=79b97933e1b64661b7e308af605fc965, user_id=26a1050f3cfa4d82aa97e21a180626f7, role_id=27e3e65e24df4b86b0d3d18d3212101d)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:39:23.371392 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfa674e-901c-40dc-a171-caff91dcf7ca admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:39:23.386486 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1208/2416] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 11:39:23 2022] PUT /identity/v3/projects/79b97933e1b64661b7e308af605fc965/users/26a1050f3cfa4d82aa97e21a180626f7/roles/27e3e65e24df4b86b0d3d18d3212101d => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 11:39:23.397102 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41e23df-2ada-4058-ab48-0232fe9b4e53 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:23.397876 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41e23df-2ada-4058-ab48-0232fe9b4e53 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:23.397876 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41e23df-2ada-4058-ab48-0232fe9b4e53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:23.434691 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-b41e23df-2ada-4058-ab48-0232fe9b4e53 None None] MFA Rules not processed for user `26a1050f3cfa4d82aa97e21a180626f7`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:39:23.435983 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-b41e23df-2ada-4058-ab48-0232fe9b4e53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:39:23.440410 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:39:23.510144 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1209/2417] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:39:23 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:39:23.514937 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfa674e-901c-40dc-a171-caff91dcf7ca admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:39:23.576158 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfa674e-901c-40dc-a171-caff91dcf7ca admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:39:23.581030 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fdbc5f-e75d-4665-9286-03fa33886be7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:39:23.581653 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fdbc5f-e75d-4665-9286-03fa33886be7 admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:23.581932 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fdbc5f-e75d-4665-9286-03fa33886be7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:23.582206 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fdbc5f-e75d-4665-9286-03fa33886be7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:23.582876 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fdbc5f-e75d-4665-9286-03fa33886be7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:39:23.584879 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fdbc5f-e75d-4665-9286-03fa33886be7 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:39:23.616893 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1209/2418] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 11:39:23 2022] POST /identity/v3/projects => generated 383 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:39:23.621419 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41e23df-2ada-4058-ab48-0232fe9b4e53 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:39:23.633753 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41e23df-2ada-4058-ab48-0232fe9b4e53 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:39:23.704739 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dca90a5-0030-48cd-9a1b-1e9532fe48da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:39:23.705376 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dca90a5-0030-48cd-9a1b-1e9532fe48da admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:23.705648 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dca90a5-0030-48cd-9a1b-1e9532fe48da admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:23.705912 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dca90a5-0030-48cd-9a1b-1e9532fe48da admin admin] PATH_INFO: `/v3/users` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:23.706619 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dca90a5-0030-48cd-9a1b-1e9532fe48da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:39:23.709044 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dca90a5-0030-48cd-9a1b-1e9532fe48da admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:39:23.742330 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1210/2419] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 11:39:23 2022] POST /identity/v3/users => generated 298 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:39:23.746195 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fdbc5f-e75d-4665-9286-03fa33886be7 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:39:23.759224 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fdbc5f-e75d-4665-9286-03fa33886be7 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:39:23.770864 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd7fdfa-a449-45c6-869f-4646b6483408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:39:23.771586 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd7fdfa-a449-45c6-869f-4646b6483408 admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:23.771869 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd7fdfa-a449-45c6-869f-4646b6483408 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:23.772142 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd7fdfa-a449-45c6-869f-4646b6483408 admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:23.773015 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd7fdfa-a449-45c6-869f-4646b6483408 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:39:23.774902 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd7fdfa-a449-45c6-869f-4646b6483408 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:39:23.790050 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1210/2420] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:39:23 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:39:23.794055 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dca90a5-0030-48cd-9a1b-1e9532fe48da admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:39:23.805526 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dca90a5-0030-48cd-9a1b-1e9532fe48da admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:39:23.811087 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d85871-c84f-4b0a-9b69-1cf8047d7b1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:39:23.812090 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d85871-c84f-4b0a-9b69-1cf8047d7b1f admin admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:23.812592 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d85871-c84f-4b0a-9b69-1cf8047d7b1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:23.813082 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d85871-c84f-4b0a-9b69-1cf8047d7b1f admin admin] PATH_INFO: `/v3/projects/502e5e66936c4b03bff6279b8e176ae1/users/981bf6dfc7004c039f2ec52e72d71f97/roles/30bb1e97257f4ca5b90c88545777317b` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:23.832344 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d85871-c84f-4b0a-9b69-1cf8047d7b1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=502e5e66936c4b03bff6279b8e176ae1, user_id=981bf6dfc7004c039f2ec52e72d71f97, role_id=30bb1e97257f4ca5b90c88545777317b)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:39:23.835937 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d85871-c84f-4b0a-9b69-1cf8047d7b1f admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:39:23.858412 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1211/2421] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 11:39:23 2022] PUT /identity/v3/projects/502e5e66936c4b03bff6279b8e176ae1/users/981bf6dfc7004c039f2ec52e72d71f97/roles/30bb1e97257f4ca5b90c88545777317b => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:39:23.863456 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd7fdfa-a449-45c6-869f-4646b6483408 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:39:23.880176 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd7fdfa-a449-45c6-869f-4646b6483408 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:39:23.915616 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7a79ef-27f3-45e7-8201-d6f19ed7f23c None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:23.916130 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7a79ef-27f3-45e7-8201-d6f19ed7f23c None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:23.916130 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7a79ef-27f3-45e7-8201-d6f19ed7f23c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:23.945210 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-3f7a79ef-27f3-45e7-8201-d6f19ed7f23c None None] MFA Rules not processed for user `a5915030f01941fc89f92228ff57c7f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:39:23.947113 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-3f7a79ef-27f3-45e7-8201-d6f19ed7f23c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:39:23.965644 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702e1f17-5ae8-4591-a4c0-9db17e7aba2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:39:23.966387 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702e1f17-5ae8-4591-a4c0-9db17e7aba2d admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:23.966717 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702e1f17-5ae8-4591-a4c0-9db17e7aba2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:23.967074 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702e1f17-5ae8-4591-a4c0-9db17e7aba2d admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:23.968335 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702e1f17-5ae8-4591-a4c0-9db17e7aba2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:39:23.969583 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702e1f17-5ae8-4591-a4c0-9db17e7aba2d admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:39:23.973482 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:INSERT=4,keystone:DELETE=1,keystone:SELECT=95 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:39:23.983001 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1211/2422] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:39:23 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:39:23.984419 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702e1f17-5ae8-4591-a4c0-9db17e7aba2d admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:39:23.987612 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-702e1f17-5ae8-4591-a4c0-9db17e7aba2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:39:24.025200 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1212/2423] 10.222.0.27 () {58 vars in 967 bytes} [Wed Aug 24 11:39:23 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 11:39:24.029212 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7a79ef-27f3-45e7-8201-d6f19ed7f23c None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:39:24.044326 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7a79ef-27f3-45e7-8201-d6f19ed7f23c None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:39:24.049772 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9487f3a-ca77-4df9-bea7-f93a0a59082a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:39:24.050581 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9487f3a-ca77-4df9-bea7-f93a0a59082a admin admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:24.051039 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9487f3a-ca77-4df9-bea7-f93a0a59082a admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:24.051176 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9487f3a-ca77-4df9-bea7-f93a0a59082a admin admin] PATH_INFO: `/v3/projects/502e5e66936c4b03bff6279b8e176ae1/users/981bf6dfc7004c039f2ec52e72d71f97/roles/30bb1e97257f4ca5b90c88545777317b` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:24.053057 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9487f3a-ca77-4df9-bea7-f93a0a59082a admin admin] RBAC: Authorizing `identity:create_grant(project_id=502e5e66936c4b03bff6279b8e176ae1, user_id=981bf6dfc7004c039f2ec52e72d71f97, role_id=30bb1e97257f4ca5b90c88545777317b)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:39:24.055968 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9487f3a-ca77-4df9-bea7-f93a0a59082a admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:39:24.069144 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1213/2424] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 11:39:24 2022] PUT /identity/v3/projects/502e5e66936c4b03bff6279b8e176ae1/users/981bf6dfc7004c039f2ec52e72d71f97/roles/30bb1e97257f4ca5b90c88545777317b => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:39:24.071976 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9487f3a-ca77-4df9-bea7-f93a0a59082a admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:39:24.082310 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-c9487f3a-ca77-4df9-bea7-f93a0a59082a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:39:24.088120 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:39:24.090254 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702e1f17-5ae8-4591-a4c0-9db17e7aba2d admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:39:24.182242 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48803b8a-2486-42af-84e8-c9838b25c2dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '282ec32864d046b2bea170f6a3845cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:39:24.182906 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48803b8a-2486-42af-84e8-c9838b25c2dd service nova] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:24.183244 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48803b8a-2486-42af-84e8-c9838b25c2dd service nova] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:24.183581 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48803b8a-2486-42af-84e8-c9838b25c2dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:24.185623 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-48803b8a-2486-42af-84e8-c9838b25c2dd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:39:24.204443 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48803b8a-2486-42af-84e8-c9838b25c2dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:39:24.207163 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48803b8a-2486-42af-84e8-c9838b25c2dd service nova] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:39:24.218143 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9487f3a-ca77-4df9-bea7-f93a0a59082a admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:39:24.223659 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543621f5-8549-437e-a20c-8504222af57f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1069558c085449f9e4c9f06013b2a85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:39:24.224648 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543621f5-8549-437e-a20c-8504222af57f service swift] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:24.224933 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543621f5-8549-437e-a20c-8504222af57f service swift] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:24.226144 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543621f5-8549-437e-a20c-8504222af57f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:24.235207 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1212/2425] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:39:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:39:24.237708 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1778f05b-5edb-408b-b504-8a80a54da534 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:24.238670 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1778f05b-5edb-408b-b504-8a80a54da534 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:24.239030 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1778f05b-5edb-408b-b504-8a80a54da534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:24.279673 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-1778f05b-5edb-408b-b504-8a80a54da534 None None] MFA Rules not processed for user `981bf6dfc7004c039f2ec52e72d71f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:39:24.280997 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-1778f05b-5edb-408b-b504-8a80a54da534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:39:24.369488 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1213/2426] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:39:24 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:39:24.382915 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1778f05b-5edb-408b-b504-8a80a54da534 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:39:24.385180 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-1778f05b-5edb-408b-b504-8a80a54da534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:39:24.401586 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:39:24.477695 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1778f05b-5edb-408b-b504-8a80a54da534 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:39:24.481928 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6afefd-6872-44cd-ade2-bcae12708b3e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92862b76ba3b4513b5dc5b5c962faac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:39:24.482760 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6afefd-6872-44cd-ade2-bcae12708b3e service cinder] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:24.482985 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6afefd-6872-44cd-ade2-bcae12708b3e service cinder] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:24.483311 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6afefd-6872-44cd-ade2-bcae12708b3e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:24.495190 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6afefd-6872-44cd-ade2-bcae12708b3e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:39:24.497202 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6afefd-6872-44cd-ade2-bcae12708b3e service cinder] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:39:24.509154 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1214/2427] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:39:24 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 11:39:24.516821 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543621f5-8549-437e-a20c-8504222af57f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:39:24.518739 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543621f5-8549-437e-a20c-8504222af57f service swift] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:39:24.531179 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1214/2428] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Aug 24 11:39:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 11:39:24.606029 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6afefd-6872-44cd-ade2-bcae12708b3e service cinder] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:39:24.614956 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6afefd-6872-44cd-ade2-bcae12708b3e service cinder] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:39:24.619249 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9637b19c-2e79-4baf-90a7-154e17d93bf3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92862b76ba3b4513b5dc5b5c962faac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:39:24.620013 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9637b19c-2e79-4baf-90a7-154e17d93bf3 service cinder] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:24.620105 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9637b19c-2e79-4baf-90a7-154e17d93bf3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:24.620365 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9637b19c-2e79-4baf-90a7-154e17d93bf3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:24.691396 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9637b19c-2e79-4baf-90a7-154e17d93bf3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:39:24.692957 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9637b19c-2e79-4baf-90a7-154e17d93bf3 service cinder] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:39:24.702973 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1215/2429] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:39:24 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:39:25.037160 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543621f5-8549-437e-a20c-8504222af57f service swift] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:39:25.101763 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543621f5-8549-437e-a20c-8504222af57f service swift] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:39:25.107531 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12082096-3142-4eb9-af2c-14076fb46380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:39:25.108165 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12082096-3142-4eb9-af2c-14076fb46380 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:25.108438 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12082096-3142-4eb9-af2c-14076fb46380 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:25.108701 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12082096-3142-4eb9-af2c-14076fb46380 admin admin] PATH_INFO: `/v3/users/26a1050f3cfa4d82aa97e21a180626f7` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:25.110023 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12082096-3142-4eb9-af2c-14076fb46380 admin admin] RBAC: Authorizing `identity:delete_user(user_id=26a1050f3cfa4d82aa97e21a180626f7)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:39:25.112009 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12082096-3142-4eb9-af2c-14076fb46380 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:39:25.158503 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:39:25.160657 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-12082096-3142-4eb9-af2c-14076fb46380 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26a1050f3cfa4d82aa97e21a180626f7'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:39:25.161308 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-12082096-3142-4eb9-af2c-14076fb46380 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26a1050f3cfa4d82aa97e21a180626f7'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:39:25.170315 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-12082096-3142-4eb9-af2c-14076fb46380 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26a1050f3cfa4d82aa97e21a180626f7'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:39:25.177872 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-12082096-3142-4eb9-af2c-14076fb46380 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26a1050f3cfa4d82aa97e21a180626f7'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:39:25.178752 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-12082096-3142-4eb9-af2c-14076fb46380 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26a1050f3cfa4d82aa97e21a180626f7'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:39:25.204136 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1215/2430] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 11:39:25 2022] DELETE /identity/v3/users/26a1050f3cfa4d82aa97e21a180626f7 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:39:25.210098 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e924a784-d009-4e31-9548-aa417271a313 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:25.210495 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e924a784-d009-4e31-9548-aa417271a313 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:25.211119 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e924a784-d009-4e31-9548-aa417271a313 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:25.232139 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-e924a784-d009-4e31-9548-aa417271a313 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:39:25.233319 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-e924a784-d009-4e31-9548-aa417271a313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:39:25.292301 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1216/2431] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:39:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:39:25.302240 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12082096-3142-4eb9-af2c-14076fb46380 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:39:25.303767 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-12082096-3142-4eb9-af2c-14076fb46380 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:39:25.367673 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12082096-3142-4eb9-af2c-14076fb46380 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:39:25.372266 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c370bfb-18f7-4360-bd60-507aba25acbf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2d061d25d83443c9232218c90792d51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:39:25.372879 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c370bfb-18f7-4360-bd60-507aba25acbf service neutron] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:25.373158 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c370bfb-18f7-4360-bd60-507aba25acbf service neutron] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:25.373418 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c370bfb-18f7-4360-bd60-507aba25acbf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:25.384031 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c370bfb-18f7-4360-bd60-507aba25acbf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:39:25.385460 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c370bfb-18f7-4360-bd60-507aba25acbf service neutron] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:39:25.395277 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1216/2432] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:39:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:39:25.664433 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e924a784-d009-4e31-9548-aa417271a313 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:39:25.666291 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-e924a784-d009-4e31-9548-aa417271a313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:39:25.685247 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e924a784-d009-4e31-9548-aa417271a313 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:39:25.690452 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da71031-2664-4923-b617-b5996c7e75b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:39:25.691093 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da71031-2664-4923-b617-b5996c7e75b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:25.692609 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da71031-2664-4923-b617-b5996c7e75b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:25.692609 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da71031-2664-4923-b617-b5996c7e75b9 admin admin] PATH_INFO: `/v3/projects/79b97933e1b64661b7e308af605fc965` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:25.693105 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da71031-2664-4923-b617-b5996c7e75b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=79b97933e1b64661b7e308af605fc965)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:39:25.694866 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da71031-2664-4923-b617-b5996c7e75b9 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:39:25.743905 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:39:25.748451 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-7da71031-2664-4923-b617-b5996c7e75b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79b97933e1b64661b7e308af605fc965', 'request_id': 'req-7da71031-2664-4923-b617-b5996c7e75b9'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:39:25.755428 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-7da71031-2664-4923-b617-b5996c7e75b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79b97933e1b64661b7e308af605fc965', 'request_id': 'req-7da71031-2664-4923-b617-b5996c7e75b9'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:39:25.761287 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-7da71031-2664-4923-b617-b5996c7e75b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79b97933e1b64661b7e308af605fc965', 'request_id': 'req-7da71031-2664-4923-b617-b5996c7e75b9'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:39:25.775478 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-7da71031-2664-4923-b617-b5996c7e75b9 admin admin] The token cache is being invalidate because project 79b97933e1b64661b7e308af605fc965 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81501) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:39:25.775762 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-7da71031-2664-4923-b617-b5996c7e75b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:39:25.776370 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-7da71031-2664-4923-b617-b5996c7e75b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:39:25.777894 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1217/2433] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 11:39:25 2022] DELETE /identity/v3/projects/79b97933e1b64661b7e308af605fc965 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:39:25.781996 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c370bfb-18f7-4360-bd60-507aba25acbf service neutron] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:39:25.791657 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c370bfb-18f7-4360-bd60-507aba25acbf service neutron] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:39:25.848354 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0038855b-a7f6-43c0-abda-8f39746b1a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:39:25.849171 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0038855b-a7f6-43c0-abda-8f39746b1a1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:25.849428 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0038855b-a7f6-43c0-abda-8f39746b1a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:25.849721 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0038855b-a7f6-43c0-abda-8f39746b1a1f admin admin] PATH_INFO: `/v3/users/981bf6dfc7004c039f2ec52e72d71f97` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:25.850925 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0038855b-a7f6-43c0-abda-8f39746b1a1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=981bf6dfc7004c039f2ec52e72d71f97)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:39:25.852891 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0038855b-a7f6-43c0-abda-8f39746b1a1f admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:39:25.903658 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-0038855b-a7f6-43c0-abda-8f39746b1a1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '981bf6dfc7004c039f2ec52e72d71f97'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:39:25.904430 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-0038855b-a7f6-43c0-abda-8f39746b1a1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '981bf6dfc7004c039f2ec52e72d71f97'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:39:25.913666 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-0038855b-a7f6-43c0-abda-8f39746b1a1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '981bf6dfc7004c039f2ec52e72d71f97'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:39:25.922348 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-0038855b-a7f6-43c0-abda-8f39746b1a1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '981bf6dfc7004c039f2ec52e72d71f97'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:39:25.923132 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-0038855b-a7f6-43c0-abda-8f39746b1a1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '981bf6dfc7004c039f2ec52e72d71f97'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:39:25.928536 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:39:25.948921 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1217/2434] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 11:39:25 2022] DELETE /identity/v3/users/981bf6dfc7004c039f2ec52e72d71f97 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 11:39:26.405478 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da71031-2664-4923-b617-b5996c7e75b9 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:39:26.407050 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-7da71031-2664-4923-b617-b5996c7e75b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:39:26.420293 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da71031-2664-4923-b617-b5996c7e75b9 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:39:26.484938 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800e86f1-cb33-4673-8bd7-28684ed6c3b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:39:26.485602 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800e86f1-cb33-4673-8bd7-28684ed6c3b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:26.485862 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800e86f1-cb33-4673-8bd7-28684ed6c3b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:26.486127 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800e86f1-cb33-4673-8bd7-28684ed6c3b5 admin admin] PATH_INFO: `/v3/projects/502e5e66936c4b03bff6279b8e176ae1` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:26.487292 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800e86f1-cb33-4673-8bd7-28684ed6c3b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=502e5e66936c4b03bff6279b8e176ae1)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:39:26.489261 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800e86f1-cb33-4673-8bd7-28684ed6c3b5 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:39:26.539805 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-800e86f1-cb33-4673-8bd7-28684ed6c3b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '502e5e66936c4b03bff6279b8e176ae1', 'request_id': 'req-800e86f1-cb33-4673-8bd7-28684ed6c3b5'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:39:26.546440 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-800e86f1-cb33-4673-8bd7-28684ed6c3b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '502e5e66936c4b03bff6279b8e176ae1', 'request_id': 'req-800e86f1-cb33-4673-8bd7-28684ed6c3b5'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:39:26.553711 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-800e86f1-cb33-4673-8bd7-28684ed6c3b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '502e5e66936c4b03bff6279b8e176ae1', 'request_id': 'req-800e86f1-cb33-4673-8bd7-28684ed6c3b5'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:39:26.567243 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-800e86f1-cb33-4673-8bd7-28684ed6c3b5 admin admin] The token cache is being invalidate because project 502e5e66936c4b03bff6279b8e176ae1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81501) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:39:26.567536 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-800e86f1-cb33-4673-8bd7-28684ed6c3b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:39:26.568164 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-800e86f1-cb33-4673-8bd7-28684ed6c3b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:39:26.569688 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1218/2435] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 11:39:26 2022] DELETE /identity/v3/projects/502e5e66936c4b03bff6279b8e176ae1 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:39:26.574699 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f4e78c-da22-4773-b55f-a4100d42e9cc None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:26.575175 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f4e78c-da22-4773-b55f-a4100d42e9cc None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:26.575287 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f4e78c-da22-4773-b55f-a4100d42e9cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:26.602049 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-07f4e78c-da22-4773-b55f-a4100d42e9cc None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:39:26.603422 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-07f4e78c-da22-4773-b55f-a4100d42e9cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:39:26.666209 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1218/2436] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:39:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:39:26.675147 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71ce4a1-bb2f-4570-8e38-78407a7b095b None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:26.675427 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71ce4a1-bb2f-4570-8e38-78407a7b095b None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:26.675688 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71ce4a1-bb2f-4570-8e38-78407a7b095b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:26.696248 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-d71ce4a1-bb2f-4570-8e38-78407a7b095b None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:39:26.697597 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-d71ce4a1-bb2f-4570-8e38-78407a7b095b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:39:26.706878 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1219/2437] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:39:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 11:39:26.711949 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f4e78c-da22-4773-b55f-a4100d42e9cc None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:39:26.722665 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f4e78c-da22-4773-b55f-a4100d42e9cc None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:39:26.728148 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0326744-953b-4f3f-a162-add805789c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:39:26.728754 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0326744-953b-4f3f-a162-add805789c26 admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:26.729028 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0326744-953b-4f3f-a162-add805789c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:26.729295 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0326744-953b-4f3f-a162-add805789c26 admin admin] PATH_INFO: `/v3/domains` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:26.729947 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0326744-953b-4f3f-a162-add805789c26 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:39:26.730246 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0326744-953b-4f3f-a162-add805789c26 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:39:26.731909 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0326744-953b-4f3f-a162-add805789c26 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:39:26.745462 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1219/2438] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 24 11:39:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:39:26.750310 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71ce4a1-bb2f-4570-8e38-78407a7b095b None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:39:26.760501 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71ce4a1-bb2f-4570-8e38-78407a7b095b None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:39:26.765376 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bcb328-46bb-46a7-aa22-d905871d2991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:39:26.766091 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bcb328-46bb-46a7-aa22-d905871d2991 admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:26.766469 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bcb328-46bb-46a7-aa22-d905871d2991 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:26.766808 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bcb328-46bb-46a7-aa22-d905871d2991 admin admin] PATH_INFO: `/v3/projects` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:26.767536 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bcb328-46bb-46a7-aa22-d905871d2991 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:39:26.770014 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bcb328-46bb-46a7-aa22-d905871d2991 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:39:26.801842 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1220/2439] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 11:39:26 2022] POST /identity/v3/projects => generated 383 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 11:39:26.803342 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0326744-953b-4f3f-a162-add805789c26 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:39:26.813901 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0326744-953b-4f3f-a162-add805789c26 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:39:26.874190 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e806f563-0c58-4545-a6b8-c90f2428f5a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:39:26.874843 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e806f563-0c58-4545-a6b8-c90f2428f5a3 admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:26.875098 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e806f563-0c58-4545-a6b8-c90f2428f5a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:26.875390 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e806f563-0c58-4545-a6b8-c90f2428f5a3 admin admin] PATH_INFO: `/v3/users` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:26.876039 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e806f563-0c58-4545-a6b8-c90f2428f5a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:39:26.878040 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e806f563-0c58-4545-a6b8-c90f2428f5a3 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:39:26.898902 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1220/2440] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 11:39:26 2022] POST /identity/v3/users => generated 292 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:39:26.903179 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bcb328-46bb-46a7-aa22-d905871d2991 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:39:26.917111 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bcb328-46bb-46a7-aa22-d905871d2991 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:39:26.922542 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5500a2-9a2f-46b2-91b1-e9254c28144f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:39:26.923150 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5500a2-9a2f-46b2-91b1-e9254c28144f admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:26.923450 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5500a2-9a2f-46b2-91b1-e9254c28144f admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:26.923715 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5500a2-9a2f-46b2-91b1-e9254c28144f admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:26.924353 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5500a2-9a2f-46b2-91b1-e9254c28144f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:39:26.925979 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5500a2-9a2f-46b2-91b1-e9254c28144f admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:39:26.935935 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1221/2441] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:39:26 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:39:26.940770 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e806f563-0c58-4545-a6b8-c90f2428f5a3 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:39:26.954953 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e806f563-0c58-4545-a6b8-c90f2428f5a3 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:39:26.963379 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258d84ad-36b6-4783-a0e5-6212a6344c64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:39:26.964206 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258d84ad-36b6-4783-a0e5-6212a6344c64 admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:26.964567 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258d84ad-36b6-4783-a0e5-6212a6344c64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:26.964873 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258d84ad-36b6-4783-a0e5-6212a6344c64 admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:26.965828 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258d84ad-36b6-4783-a0e5-6212a6344c64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:39:26.968053 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258d84ad-36b6-4783-a0e5-6212a6344c64 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:39:26.980696 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1221/2442] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:39:26 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:39:26.985072 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5500a2-9a2f-46b2-91b1-e9254c28144f admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:39:26.995965 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5500a2-9a2f-46b2-91b1-e9254c28144f admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:39:27.000815 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e669668a-93d3-427f-8938-150dfd684dc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:39:27.001468 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e669668a-93d3-427f-8938-150dfd684dc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:27.001741 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e669668a-93d3-427f-8938-150dfd684dc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:27.002011 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e669668a-93d3-427f-8938-150dfd684dc8 admin admin] PATH_INFO: `/v3/projects/cd0f06ca03434346b6dea5e8cd0de4a9/users/9cc59331ad2a4609b35bd62ddf46d6e4/roles/27e3e65e24df4b86b0d3d18d3212101d` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:27.017768 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e669668a-93d3-427f-8938-150dfd684dc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd0f06ca03434346b6dea5e8cd0de4a9, user_id=9cc59331ad2a4609b35bd62ddf46d6e4, role_id=27e3e65e24df4b86b0d3d18d3212101d)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:39:27.020472 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e669668a-93d3-427f-8938-150dfd684dc8 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:39:27.032217 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:39:27.041500 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1222/2443] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 11:39:26 2022] PUT /identity/v3/projects/cd0f06ca03434346b6dea5e8cd0de4a9/users/9cc59331ad2a4609b35bd62ddf46d6e4/roles/27e3e65e24df4b86b0d3d18d3212101d => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:39:27.053110 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc51cf3b-3554-4d8a-800c-e048acecdf54 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:27.053391 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc51cf3b-3554-4d8a-800c-e048acecdf54 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:27.053661 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc51cf3b-3554-4d8a-800c-e048acecdf54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:27.083369 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-dc51cf3b-3554-4d8a-800c-e048acecdf54 None None] MFA Rules not processed for user `9cc59331ad2a4609b35bd62ddf46d6e4`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:39:27.084513 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-dc51cf3b-3554-4d8a-800c-e048acecdf54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:39:27.128472 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:39:27.155182 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1222/2444] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:39:27 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:39:27.166573 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e669668a-93d3-427f-8938-150dfd684dc8 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:39:27.168611 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-e669668a-93d3-427f-8938-150dfd684dc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:39:27.232280 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e669668a-93d3-427f-8938-150dfd684dc8 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:39:27.236986 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc602fce-b678-4ccd-8b36-4e8972645d68 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92862b76ba3b4513b5dc5b5c962faac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:39:27.237599 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc602fce-b678-4ccd-8b36-4e8972645d68 service cinder] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:27.237876 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc602fce-b678-4ccd-8b36-4e8972645d68 service cinder] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:27.238145 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc602fce-b678-4ccd-8b36-4e8972645d68 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:27.248146 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc602fce-b678-4ccd-8b36-4e8972645d68 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:39:27.249606 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc602fce-b678-4ccd-8b36-4e8972645d68 service cinder] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:39:27.258895 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1223/2445] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:39:27 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:39:30.422385 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc51cf3b-3554-4d8a-800c-e048acecdf54 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:39:30.423833 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-dc51cf3b-3554-4d8a-800c-e048acecdf54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:39:30.484695 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc51cf3b-3554-4d8a-800c-e048acecdf54 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:39:30.489708 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3692930f-8352-4dba-a072-14f74ec34bd8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2d061d25d83443c9232218c90792d51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:39:30.490318 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3692930f-8352-4dba-a072-14f74ec34bd8 service neutron] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:30.490652 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3692930f-8352-4dba-a072-14f74ec34bd8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:30.490902 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3692930f-8352-4dba-a072-14f74ec34bd8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:30.492759 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-3692930f-8352-4dba-a072-14f74ec34bd8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:39:30.568500 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3692930f-8352-4dba-a072-14f74ec34bd8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:39:30.570154 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3692930f-8352-4dba-a072-14f74ec34bd8 service neutron] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:39:30.580027 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1223/2446] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:39:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:39:32.668442 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc602fce-b678-4ccd-8b36-4e8972645d68 service cinder] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:39:32.679203 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc602fce-b678-4ccd-8b36-4e8972645d68 service cinder] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:39:32.683781 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7e8f50-f689-4ff4-a29e-bc63a44668a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:39:32.684412 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7e8f50-f689-4ff4-a29e-bc63a44668a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:32.684715 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7e8f50-f689-4ff4-a29e-bc63a44668a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:32.684957 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7e8f50-f689-4ff4-a29e-bc63a44668a7 admin admin] PATH_INFO: `/v3/users/9cc59331ad2a4609b35bd62ddf46d6e4` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:32.686066 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7e8f50-f689-4ff4-a29e-bc63a44668a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9cc59331ad2a4609b35bd62ddf46d6e4)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:39:32.688153 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7e8f50-f689-4ff4-a29e-bc63a44668a7 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:39:32.740342 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-1b7e8f50-f689-4ff4-a29e-bc63a44668a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9cc59331ad2a4609b35bd62ddf46d6e4'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:39:32.741105 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-1b7e8f50-f689-4ff4-a29e-bc63a44668a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9cc59331ad2a4609b35bd62ddf46d6e4'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:39:32.741842 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-1b7e8f50-f689-4ff4-a29e-bc63a44668a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9cc59331ad2a4609b35bd62ddf46d6e4'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:39:32.751488 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-1b7e8f50-f689-4ff4-a29e-bc63a44668a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9cc59331ad2a4609b35bd62ddf46d6e4'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:39:32.759394 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-1b7e8f50-f689-4ff4-a29e-bc63a44668a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9cc59331ad2a4609b35bd62ddf46d6e4'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:39:32.781664 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1224/2447] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 11:39:32 2022] DELETE /identity/v3/users/9cc59331ad2a4609b35bd62ddf46d6e4 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:39:32.786321 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b5f980-5e2a-45bc-a80e-1710da6e309b None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:32.786839 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b5f980-5e2a-45bc-a80e-1710da6e309b None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:32.786975 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b5f980-5e2a-45bc-a80e-1710da6e309b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:32.806679 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-a3b5f980-5e2a-45bc-a80e-1710da6e309b None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:39:32.807903 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-a3b5f980-5e2a-45bc-a80e-1710da6e309b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:39:32.868933 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1224/2448] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:39:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:39:32.878769 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7e8f50-f689-4ff4-a29e-bc63a44668a7 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:39:32.880209 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-1b7e8f50-f689-4ff4-a29e-bc63a44668a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:39:32.940781 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7e8f50-f689-4ff4-a29e-bc63a44668a7 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:39:32.944713 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef062105-41ec-490b-a309-543944b30901 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2d061d25d83443c9232218c90792d51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:39:32.945827 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef062105-41ec-490b-a309-543944b30901 service neutron] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:32.945827 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef062105-41ec-490b-a309-543944b30901 service neutron] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:32.946036 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef062105-41ec-490b-a309-543944b30901 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:32.958341 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef062105-41ec-490b-a309-543944b30901 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:39:32.960192 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef062105-41ec-490b-a309-543944b30901 service neutron] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:39:32.971352 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1225/2449] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:39:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:39:33.305925 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b5f980-5e2a-45bc-a80e-1710da6e309b None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:39:33.308294 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-a3b5f980-5e2a-45bc-a80e-1710da6e309b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:39:33.324562 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b5f980-5e2a-45bc-a80e-1710da6e309b None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:39:33.355076 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a047c36-75cb-433d-a9f5-36151d993f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:39:33.355735 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a047c36-75cb-433d-a9f5-36151d993f31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:33.356011 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a047c36-75cb-433d-a9f5-36151d993f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:33.356277 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a047c36-75cb-433d-a9f5-36151d993f31 admin admin] PATH_INFO: `/v3/projects/cd0f06ca03434346b6dea5e8cd0de4a9` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:33.358875 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a047c36-75cb-433d-a9f5-36151d993f31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd0f06ca03434346b6dea5e8cd0de4a9)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:39:33.360811 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a047c36-75cb-433d-a9f5-36151d993f31 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:39:33.424171 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:39:33.499013 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-5a047c36-75cb-433d-a9f5-36151d993f31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd0f06ca03434346b6dea5e8cd0de4a9', 'request_id': 'req-5a047c36-75cb-433d-a9f5-36151d993f31'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:39:33.527004 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-5a047c36-75cb-433d-a9f5-36151d993f31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd0f06ca03434346b6dea5e8cd0de4a9', 'request_id': 'req-5a047c36-75cb-433d-a9f5-36151d993f31'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:39:33.563629 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-5a047c36-75cb-433d-a9f5-36151d993f31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd0f06ca03434346b6dea5e8cd0de4a9', 'request_id': 'req-5a047c36-75cb-433d-a9f5-36151d993f31'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:39:33.597248 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-5a047c36-75cb-433d-a9f5-36151d993f31 admin admin] The token cache is being invalidate because project cd0f06ca03434346b6dea5e8cd0de4a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:39:33.597710 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-5a047c36-75cb-433d-a9f5-36151d993f31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:39:33.598929 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-5a047c36-75cb-433d-a9f5-36151d993f31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:39:33.604649 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1225/2450] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 11:39:33 2022] DELETE /identity/v3/projects/cd0f06ca03434346b6dea5e8cd0de4a9 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:39:33.605695 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f377fe-32bb-46a8-8847-aa4013ed4f4d None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:33.606015 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f377fe-32bb-46a8-8847-aa4013ed4f4d None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:33.606251 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f377fe-32bb-46a8-8847-aa4013ed4f4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:33.642318 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-c1f377fe-32bb-46a8-8847-aa4013ed4f4d None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:39:33.643822 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-c1f377fe-32bb-46a8-8847-aa4013ed4f4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:39:33.666818 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:39:33.742631 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1226/2451] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:39:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:39:33.747321 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29073bd-c3e7-4d4e-aaec-7bcd42945063 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:33.747605 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29073bd-c3e7-4d4e-aaec-7bcd42945063 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:33.747873 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29073bd-c3e7-4d4e-aaec-7bcd42945063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:33.770265 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-c29073bd-c3e7-4d4e-aaec-7bcd42945063 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:39:33.771519 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-c29073bd-c3e7-4d4e-aaec-7bcd42945063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:39:33.779893 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1226/2452] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:39:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:39:33.786459 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f377fe-32bb-46a8-8847-aa4013ed4f4d None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:39:33.797044 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f377fe-32bb-46a8-8847-aa4013ed4f4d None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:39:33.805177 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe21ff40-5a5e-4c0d-9263-0958c3dec9e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:39:33.806043 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe21ff40-5a5e-4c0d-9263-0958c3dec9e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:33.806550 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29073bd-c3e7-4d4e-aaec-7bcd42945063 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:39:33.807048 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe21ff40-5a5e-4c0d-9263-0958c3dec9e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:33.807048 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe21ff40-5a5e-4c0d-9263-0958c3dec9e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:33.807551 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe21ff40-5a5e-4c0d-9263-0958c3dec9e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:39:33.807854 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe21ff40-5a5e-4c0d-9263-0958c3dec9e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:39:33.809440 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-c29073bd-c3e7-4d4e-aaec-7bcd42945063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:39:33.809564 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe21ff40-5a5e-4c0d-9263-0958c3dec9e6 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:39:33.822109 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29073bd-c3e7-4d4e-aaec-7bcd42945063 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:39:33.822552 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1227/2453] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 24 11:39:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:39:33.827028 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe21ff40-5a5e-4c0d-9263-0958c3dec9e6 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:39:33.827421 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023f9fb8-5ede-4d0d-b367-f08218d969c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:39:33.828155 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023f9fb8-5ede-4d0d-b367-f08218d969c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:33.828412 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023f9fb8-5ede-4d0d-b367-f08218d969c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:33.828894 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023f9fb8-5ede-4d0d-b367-f08218d969c7 admin admin] PATH_INFO: `/v3/users/c53eb370dc294248b3be2248570d1b04` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:33.830046 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023f9fb8-5ede-4d0d-b367-f08218d969c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c53eb370dc294248b3be2248570d1b04)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:39:33.832042 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023f9fb8-5ede-4d0d-b367-f08218d969c7 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:39:33.837457 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe21ff40-5a5e-4c0d-9263-0958c3dec9e6 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:39:33.842198 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d896276a-14aa-4968-b58c-42550767f706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:39:33.842848 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d896276a-14aa-4968-b58c-42550767f706 admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:33.843124 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d896276a-14aa-4968-b58c-42550767f706 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:33.843395 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d896276a-14aa-4968-b58c-42550767f706 admin admin] PATH_INFO: `/v3/projects` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:33.844022 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d896276a-14aa-4968-b58c-42550767f706 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:39:33.846002 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d896276a-14aa-4968-b58c-42550767f706 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:39:33.878881 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1228/2454] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 11:39:33 2022] POST /identity/v3/projects => generated 375 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:39:33.879732 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d896276a-14aa-4968-b58c-42550767f706 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:39:33.884539 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-023f9fb8-5ede-4d0d-b367-f08218d969c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c53eb370dc294248b3be2248570d1b04'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:39:33.885281 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-023f9fb8-5ede-4d0d-b367-f08218d969c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c53eb370dc294248b3be2248570d1b04'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:39:33.894375 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-023f9fb8-5ede-4d0d-b367-f08218d969c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c53eb370dc294248b3be2248570d1b04'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:39:33.901836 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-023f9fb8-5ede-4d0d-b367-f08218d969c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c53eb370dc294248b3be2248570d1b04'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:39:33.902500 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-023f9fb8-5ede-4d0d-b367-f08218d969c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c53eb370dc294248b3be2248570d1b04'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:39:33.920776 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1227/2455] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 11:39:33 2022] DELETE /identity/v3/users/c53eb370dc294248b3be2248570d1b04 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:39:33.941097 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d896276a-14aa-4968-b58c-42550767f706 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:39:34.000161 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee10f083-0857-47fa-89e3-1254e9947483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:39:34.000776 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee10f083-0857-47fa-89e3-1254e9947483 admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:34.001341 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee10f083-0857-47fa-89e3-1254e9947483 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:34.001341 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee10f083-0857-47fa-89e3-1254e9947483 admin admin] PATH_INFO: `/v3/users` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:34.001967 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee10f083-0857-47fa-89e3-1254e9947483 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:39:34.003989 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee10f083-0857-47fa-89e3-1254e9947483 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:39:34.030696 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1229/2456] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 11:39:33 2022] POST /identity/v3/users => generated 288 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:39:34.031845 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023f9fb8-5ede-4d0d-b367-f08218d969c7 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:39:34.033253 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-023f9fb8-5ede-4d0d-b367-f08218d969c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:39:34.046730 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023f9fb8-5ede-4d0d-b367-f08218d969c7 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:39:34.052474 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52966de-47d9-403d-9dee-16bc2f04d26f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:39:34.053151 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52966de-47d9-403d-9dee-16bc2f04d26f admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:34.053427 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52966de-47d9-403d-9dee-16bc2f04d26f admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:34.053685 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52966de-47d9-403d-9dee-16bc2f04d26f admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:34.054344 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52966de-47d9-403d-9dee-16bc2f04d26f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:39:34.055984 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52966de-47d9-403d-9dee-16bc2f04d26f admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:39:34.069501 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1228/2457] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:39:34 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 11:39:34.070803 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee10f083-0857-47fa-89e3-1254e9947483 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:39:34.083404 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee10f083-0857-47fa-89e3-1254e9947483 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:39:34.089254 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eb50a6-8f9e-4375-9485-cda2e0861818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:39:34.089993 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eb50a6-8f9e-4375-9485-cda2e0861818 admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:34.090383 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eb50a6-8f9e-4375-9485-cda2e0861818 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:34.090744 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eb50a6-8f9e-4375-9485-cda2e0861818 admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:34.091498 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7eb50a6-8f9e-4375-9485-cda2e0861818 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:39:34.093302 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7eb50a6-8f9e-4375-9485-cda2e0861818 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:39:34.108827 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1230/2458] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:39:34 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 11:39:34.108956 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52966de-47d9-403d-9dee-16bc2f04d26f admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:39:34.109354 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eb50a6-8f9e-4375-9485-cda2e0861818 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:39:34.110679 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-e52966de-47d9-403d-9dee-16bc2f04d26f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:39:34.120662 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eb50a6-8f9e-4375-9485-cda2e0861818 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:39:34.124884 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52966de-47d9-403d-9dee-16bc2f04d26f admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:39:34.130312 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00742655-411a-4d22-953d-aca402820a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:39:34.131183 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00742655-411a-4d22-953d-aca402820a6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:34.131615 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfefc76-50e8-47c5-aac9-5684afb87ef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:39:34.131902 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00742655-411a-4d22-953d-aca402820a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:34.132270 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00742655-411a-4d22-953d-aca402820a6e admin admin] PATH_INFO: `/v3/projects/a87b560b6a3e4f9baa16d0ad4758b1ff` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:34.132380 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfefc76-50e8-47c5-aac9-5684afb87ef4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:34.132564 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfefc76-50e8-47c5-aac9-5684afb87ef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:34.132839 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfefc76-50e8-47c5-aac9-5684afb87ef4 admin admin] PATH_INFO: `/v3/projects/2e7e7c75461446899a8616d5c607829a/users/1d4eca69151f41cda52c4e44db69b13d/roles/27e3e65e24df4b86b0d3d18d3212101d` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:34.134318 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00742655-411a-4d22-953d-aca402820a6e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a87b560b6a3e4f9baa16d0ad4758b1ff)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:39:34.135994 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:39:34.136497 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00742655-411a-4d22-953d-aca402820a6e admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:39:34.153109 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfefc76-50e8-47c5-aac9-5684afb87ef4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e7e7c75461446899a8616d5c607829a, user_id=1d4eca69151f41cda52c4e44db69b13d, role_id=27e3e65e24df4b86b0d3d18d3212101d)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:39:34.156268 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfefc76-50e8-47c5-aac9-5684afb87ef4 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:39:34.171047 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1231/2459] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 11:39:34 2022] PUT /identity/v3/projects/2e7e7c75461446899a8616d5c607829a/users/1d4eca69151f41cda52c4e44db69b13d/roles/27e3e65e24df4b86b0d3d18d3212101d => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:39:34.197066 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-00742655-411a-4d22-953d-aca402820a6e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a87b560b6a3e4f9baa16d0ad4758b1ff', 'request_id': 'req-00742655-411a-4d22-953d-aca402820a6e'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:39:34.206004 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-00742655-411a-4d22-953d-aca402820a6e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a87b560b6a3e4f9baa16d0ad4758b1ff', 'request_id': 'req-00742655-411a-4d22-953d-aca402820a6e'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:39:34.213003 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-00742655-411a-4d22-953d-aca402820a6e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a87b560b6a3e4f9baa16d0ad4758b1ff', 'request_id': 'req-00742655-411a-4d22-953d-aca402820a6e'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:39:34.214810 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:DELETE=22,keystone:SELECT=76,keystone:INSERT=2 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:39:34.231692 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-00742655-411a-4d22-953d-aca402820a6e admin admin] The token cache is being invalidate because project a87b560b6a3e4f9baa16d0ad4758b1ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:39:34.232115 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-00742655-411a-4d22-953d-aca402820a6e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:39:34.232915 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-00742655-411a-4d22-953d-aca402820a6e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:39:34.234764 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1229/2460] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 11:39:34 2022] DELETE /identity/v3/projects/a87b560b6a3e4f9baa16d0ad4758b1ff => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:39:34.239895 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e890bc-516b-4f61-900c-19a6d74c8edc None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:34.240288 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e890bc-516b-4f61-900c-19a6d74c8edc None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:34.240623 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e890bc-516b-4f61-900c-19a6d74c8edc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:34.243420 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6ae253-9612-41d2-bcfa-2a7359ce6e38 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:34.243703 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6ae253-9612-41d2-bcfa-2a7359ce6e38 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:34.243975 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6ae253-9612-41d2-bcfa-2a7359ce6e38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:34.261719 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-07e890bc-516b-4f61-900c-19a6d74c8edc None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:39:34.262998 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-07e890bc-516b-4f61-900c-19a6d74c8edc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:39:34.272910 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-cd6ae253-9612-41d2-bcfa-2a7359ce6e38 None None] MFA Rules not processed for user `1d4eca69151f41cda52c4e44db69b13d`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:39:34.274096 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-cd6ae253-9612-41d2-bcfa-2a7359ce6e38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:39:34.327112 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1232/2461] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:39:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 11:39:34.335639 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e22301-c88d-470a-82b6-4eb4800c8a7f None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:34.335925 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e22301-c88d-470a-82b6-4eb4800c8a7f None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:34.336200 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e22301-c88d-470a-82b6-4eb4800c8a7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:34.339902 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1230/2462] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:39:34 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:39:34.350752 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6ae253-9612-41d2-bcfa-2a7359ce6e38 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:39:34.352123 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-cd6ae253-9612-41d2-bcfa-2a7359ce6e38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:39:34.356752 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-59e22301-c88d-470a-82b6-4eb4800c8a7f None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:39:34.357926 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-59e22301-c88d-470a-82b6-4eb4800c8a7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:39:34.365806 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1233/2463] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:39:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:39:34.370409 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e22301-c88d-470a-82b6-4eb4800c8a7f None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:39:34.379181 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e22301-c88d-470a-82b6-4eb4800c8a7f None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:39:34.384586 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9f83a6-908e-4460-bcf4-869d58a7cf0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:39:34.385161 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9f83a6-908e-4460-bcf4-869d58a7cf0a admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:34.385437 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9f83a6-908e-4460-bcf4-869d58a7cf0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:34.385706 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9f83a6-908e-4460-bcf4-869d58a7cf0a admin admin] PATH_INFO: `/v3/domains` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:34.386349 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9f83a6-908e-4460-bcf4-869d58a7cf0a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:39:34.386673 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9f83a6-908e-4460-bcf4-869d58a7cf0a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:39:34.388388 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9f83a6-908e-4460-bcf4-869d58a7cf0a admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:39:34.403389 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1234/2464] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 24 11:39:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:39:34.404476 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9f83a6-908e-4460-bcf4-869d58a7cf0a admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:39:34.409855 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6ae253-9612-41d2-bcfa-2a7359ce6e38 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:39:34.413579 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eca322-cef2-4e88-969d-1fc3dbf56182 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92862b76ba3b4513b5dc5b5c962faac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:39:34.413849 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9f83a6-908e-4460-bcf4-869d58a7cf0a admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:39:34.414187 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eca322-cef2-4e88-969d-1fc3dbf56182 service cinder] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:34.414492 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eca322-cef2-4e88-969d-1fc3dbf56182 service cinder] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:34.414761 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eca322-cef2-4e88-969d-1fc3dbf56182 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:34.418418 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831c8def-3a00-461b-b621-a7625dcaa034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:39:34.418996 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831c8def-3a00-461b-b621-a7625dcaa034 admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:34.419270 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831c8def-3a00-461b-b621-a7625dcaa034 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:34.419536 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831c8def-3a00-461b-b621-a7625dcaa034 admin admin] PATH_INFO: `/v3/projects` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:34.420146 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831c8def-3a00-461b-b621-a7625dcaa034 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:39:34.422036 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831c8def-3a00-461b-b621-a7625dcaa034 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:39:34.423046 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16eca322-cef2-4e88-969d-1fc3dbf56182 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:39:34.424535 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16eca322-cef2-4e88-969d-1fc3dbf56182 service cinder] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:39:34.433259 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1231/2465] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:39:34 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 11:39:34.453567 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1235/2466] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 11:39:34 2022] POST /identity/v3/projects => generated 365 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:39:34.455044 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eca322-cef2-4e88-969d-1fc3dbf56182 service cinder] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:39:34.468265 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eca322-cef2-4e88-969d-1fc3dbf56182 service cinder] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:39:34.536423 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335f45f5-36c3-464e-9885-1c9217672e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:39:34.537049 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335f45f5-36c3-464e-9885-1c9217672e02 admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:34.537323 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335f45f5-36c3-464e-9885-1c9217672e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:34.537590 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335f45f5-36c3-464e-9885-1c9217672e02 admin admin] PATH_INFO: `/v3/users` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:34.538207 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335f45f5-36c3-464e-9885-1c9217672e02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:39:34.540155 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335f45f5-36c3-464e-9885-1c9217672e02 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:39:34.564465 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1232/2467] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 11:39:34 2022] POST /identity/v3/users => generated 283 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:39:34.565711 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831c8def-3a00-461b-b621-a7625dcaa034 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:39:34.577858 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831c8def-3a00-461b-b621-a7625dcaa034 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:39:34.582918 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebb11b5-23fe-4617-864c-46093c8a119c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:39:34.583591 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebb11b5-23fe-4617-864c-46093c8a119c admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:34.584011 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebb11b5-23fe-4617-864c-46093c8a119c admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:34.584342 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebb11b5-23fe-4617-864c-46093c8a119c admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:34.585013 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebb11b5-23fe-4617-864c-46093c8a119c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:39:34.586653 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebb11b5-23fe-4617-864c-46093c8a119c admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:39:34.596922 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1236/2468] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:39:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:39:34.601109 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335f45f5-36c3-464e-9885-1c9217672e02 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:39:34.610875 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335f45f5-36c3-464e-9885-1c9217672e02 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:39:34.615560 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a59cb06-5c6f-46c5-876d-86d67ff0d7d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:39:34.616154 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a59cb06-5c6f-46c5-876d-86d67ff0d7d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:34.616430 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a59cb06-5c6f-46c5-876d-86d67ff0d7d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:34.616699 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a59cb06-5c6f-46c5-876d-86d67ff0d7d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:34.617341 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a59cb06-5c6f-46c5-876d-86d67ff0d7d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:39:34.619336 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a59cb06-5c6f-46c5-876d-86d67ff0d7d0 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:39:34.629596 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1233/2469] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:39:34 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 11:39:34.634076 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebb11b5-23fe-4617-864c-46093c8a119c admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:39:34.645129 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebb11b5-23fe-4617-864c-46093c8a119c admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:39:34.650923 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0b30ae-7269-483d-8978-402dd75642ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:39:34.651604 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0b30ae-7269-483d-8978-402dd75642ee admin admin] REQUEST_METHOD: `PUT` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:34.651876 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0b30ae-7269-483d-8978-402dd75642ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:34.652169 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0b30ae-7269-483d-8978-402dd75642ee admin admin] PATH_INFO: `/v3/projects/de2cf159c9ca45e2a2b904fa61c4988c/users/0388c4843d334214a60c749da92d591a/roles/27e3e65e24df4b86b0d3d18d3212101d` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:34.670905 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0b30ae-7269-483d-8978-402dd75642ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=de2cf159c9ca45e2a2b904fa61c4988c, user_id=0388c4843d334214a60c749da92d591a, role_id=27e3e65e24df4b86b0d3d18d3212101d)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:39:34.673882 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0b30ae-7269-483d-8978-402dd75642ee admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:39:34.708616 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1237/2470] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 11:39:34 2022] PUT /identity/v3/projects/de2cf159c9ca45e2a2b904fa61c4988c/users/0388c4843d334214a60c749da92d591a/roles/27e3e65e24df4b86b0d3d18d3212101d => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:39:34.719297 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2f05d0-6cb9-4c1f-a5b7-7b8dfa5cbfe0 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:34.719773 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2f05d0-6cb9-4c1f-a5b7-7b8dfa5cbfe0 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:34.720111 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2f05d0-6cb9-4c1f-a5b7-7b8dfa5cbfe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:34.729652 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:INSERT=4,keystone:DELETE=1,keystone:SELECT=95 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:39:34.766566 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-bd2f05d0-6cb9-4c1f-a5b7-7b8dfa5cbfe0 None None] MFA Rules not processed for user `0388c4843d334214a60c749da92d591a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:39:34.768015 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-bd2f05d0-6cb9-4c1f-a5b7-7b8dfa5cbfe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:39:34.839354 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1234/2471] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:39:34 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:39:34.853758 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0b30ae-7269-483d-8978-402dd75642ee admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:39:34.917101 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0b30ae-7269-483d-8978-402dd75642ee admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:39:34.921140 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a223317-25a4-4be6-a09b-87066ca7a7e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92862b76ba3b4513b5dc5b5c962faac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:39:34.921759 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a223317-25a4-4be6-a09b-87066ca7a7e4 service cinder] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:34.922039 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a223317-25a4-4be6-a09b-87066ca7a7e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:34.922308 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a223317-25a4-4be6-a09b-87066ca7a7e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:34.931411 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a223317-25a4-4be6-a09b-87066ca7a7e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:39:34.932897 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a223317-25a4-4be6-a09b-87066ca7a7e4 service cinder] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:39:34.942349 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1238/2472] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:39:34 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:39:37.554777 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2f05d0-6cb9-4c1f-a5b7-7b8dfa5cbfe0 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:39:37.556409 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-bd2f05d0-6cb9-4c1f-a5b7-7b8dfa5cbfe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:39:37.624086 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2f05d0-6cb9-4c1f-a5b7-7b8dfa5cbfe0 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:39:37.628588 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f79e53b-9988-4d25-aaf2-83761064ec04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:39:37.629238 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f79e53b-9988-4d25-aaf2-83761064ec04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:37.629509 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f79e53b-9988-4d25-aaf2-83761064ec04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:37.629771 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f79e53b-9988-4d25-aaf2-83761064ec04 admin admin] PATH_INFO: `/v3/users/1d4eca69151f41cda52c4e44db69b13d` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:37.630968 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f79e53b-9988-4d25-aaf2-83761064ec04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d4eca69151f41cda52c4e44db69b13d)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:39:37.632896 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f79e53b-9988-4d25-aaf2-83761064ec04 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:39:37.680944 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-6f79e53b-9988-4d25-aaf2-83761064ec04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d4eca69151f41cda52c4e44db69b13d'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:39:37.681606 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-6f79e53b-9988-4d25-aaf2-83761064ec04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d4eca69151f41cda52c4e44db69b13d'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:39:37.689027 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-6f79e53b-9988-4d25-aaf2-83761064ec04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d4eca69151f41cda52c4e44db69b13d'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:39:37.696062 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-6f79e53b-9988-4d25-aaf2-83761064ec04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d4eca69151f41cda52c4e44db69b13d'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:39:37.696678 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-6f79e53b-9988-4d25-aaf2-83761064ec04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d4eca69151f41cda52c4e44db69b13d'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:39:37.713785 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1235/2473] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 11:39:37 2022] DELETE /identity/v3/users/1d4eca69151f41cda52c4e44db69b13d => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:39:37.718378 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad7f623-9e4e-4d78-ab93-cd709ee046c5 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:37.718884 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad7f623-9e4e-4d78-ab93-cd709ee046c5 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:37.718984 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad7f623-9e4e-4d78-ab93-cd709ee046c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:37.738999 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-1ad7f623-9e4e-4d78-ab93-cd709ee046c5 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:39:37.740274 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-1ad7f623-9e4e-4d78-ab93-cd709ee046c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:39:37.744861 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:39:37.806825 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1239/2474] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:39:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:39:37.816652 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f79e53b-9988-4d25-aaf2-83761064ec04 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:39:37.818199 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-6f79e53b-9988-4d25-aaf2-83761064ec04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:39:37.832100 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:39:37.884343 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f79e53b-9988-4d25-aaf2-83761064ec04 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:39:37.888099 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e691b317-6682-4cd6-9b78-c14b8e291baf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2d061d25d83443c9232218c90792d51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:39:37.888775 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e691b317-6682-4cd6-9b78-c14b8e291baf service neutron] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:37.889053 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e691b317-6682-4cd6-9b78-c14b8e291baf service neutron] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:37.889318 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e691b317-6682-4cd6-9b78-c14b8e291baf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:37.898451 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e691b317-6682-4cd6-9b78-c14b8e291baf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:39:37.899914 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e691b317-6682-4cd6-9b78-c14b8e291baf service neutron] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:39:37.909427 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1236/2475] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:39:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:39:38.220697 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad7f623-9e4e-4d78-ab93-cd709ee046c5 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:39:38.222268 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-1ad7f623-9e4e-4d78-ab93-cd709ee046c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:39:38.234899 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad7f623-9e4e-4d78-ab93-cd709ee046c5 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:39:38.239774 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d643e38-eca1-4468-9cf4-5b4db5969ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:39:38.240586 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d643e38-eca1-4468-9cf4-5b4db5969ae8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:38.240919 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d643e38-eca1-4468-9cf4-5b4db5969ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:38.241278 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d643e38-eca1-4468-9cf4-5b4db5969ae8 admin admin] PATH_INFO: `/v3/projects/2e7e7c75461446899a8616d5c607829a` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:38.243077 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d643e38-eca1-4468-9cf4-5b4db5969ae8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e7e7c75461446899a8616d5c607829a)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:39:38.245159 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d643e38-eca1-4468-9cf4-5b4db5969ae8 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:39:38.296799 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-2d643e38-eca1-4468-9cf4-5b4db5969ae8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e7e7c75461446899a8616d5c607829a', 'request_id': 'req-2d643e38-eca1-4468-9cf4-5b4db5969ae8'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:39:38.303090 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-2d643e38-eca1-4468-9cf4-5b4db5969ae8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e7e7c75461446899a8616d5c607829a', 'request_id': 'req-2d643e38-eca1-4468-9cf4-5b4db5969ae8'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:39:38.308798 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-2d643e38-eca1-4468-9cf4-5b4db5969ae8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e7e7c75461446899a8616d5c607829a', 'request_id': 'req-2d643e38-eca1-4468-9cf4-5b4db5969ae8'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:39:38.323399 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-2d643e38-eca1-4468-9cf4-5b4db5969ae8 admin admin] The token cache is being invalidate because project 2e7e7c75461446899a8616d5c607829a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81501) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:39:38.324088 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-2d643e38-eca1-4468-9cf4-5b4db5969ae8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:39:38.324710 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-2d643e38-eca1-4468-9cf4-5b4db5969ae8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:39:38.326221 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1240/2476] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 11:39:38 2022] DELETE /identity/v3/projects/2e7e7c75461446899a8616d5c607829a => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:39:38.331253 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c607a4ff-d23a-435a-bd99-468cd2208cbb None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:38.331562 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c607a4ff-d23a-435a-bd99-468cd2208cbb None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:38.331862 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c607a4ff-d23a-435a-bd99-468cd2208cbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:38.351286 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-c607a4ff-d23a-435a-bd99-468cd2208cbb None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:39:38.352464 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-c607a4ff-d23a-435a-bd99-468cd2208cbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:39:38.419644 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1237/2477] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:39:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 11:39:38.427548 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6330fc-0cdc-43be-bb38-07fa95a92b79 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:38.427846 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6330fc-0cdc-43be-bb38-07fa95a92b79 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:38.428116 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6330fc-0cdc-43be-bb38-07fa95a92b79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:38.447970 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-cc6330fc-0cdc-43be-bb38-07fa95a92b79 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:39:38.449351 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-cc6330fc-0cdc-43be-bb38-07fa95a92b79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:39:38.457849 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1241/2478] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:39:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:39:38.462496 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c607a4ff-d23a-435a-bd99-468cd2208cbb None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:39:38.472165 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c607a4ff-d23a-435a-bd99-468cd2208cbb None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:39:38.476707 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d4958d-c136-44e6-b94f-9c2549a407ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:39:38.477337 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d4958d-c136-44e6-b94f-9c2549a407ff admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:38.477617 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d4958d-c136-44e6-b94f-9c2549a407ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:38.477871 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d4958d-c136-44e6-b94f-9c2549a407ff admin admin] PATH_INFO: `/v3/domains` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:38.478566 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d4958d-c136-44e6-b94f-9c2549a407ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:39:38.478867 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d4958d-c136-44e6-b94f-9c2549a407ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:39:38.480487 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d4958d-c136-44e6-b94f-9c2549a407ff admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:39:38.492384 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1238/2479] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 24 11:39:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:39:38.497654 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6330fc-0cdc-43be-bb38-07fa95a92b79 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:39:38.512320 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6330fc-0cdc-43be-bb38-07fa95a92b79 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:39:38.521735 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f4ee18-493e-4927-ba6f-4836f687c1aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:39:38.522341 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f4ee18-493e-4927-ba6f-4836f687c1aa admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:38.522655 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f4ee18-493e-4927-ba6f-4836f687c1aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:38.522923 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f4ee18-493e-4927-ba6f-4836f687c1aa admin admin] PATH_INFO: `/v3/projects` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:38.523547 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f4ee18-493e-4927-ba6f-4836f687c1aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:39:38.525483 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f4ee18-493e-4927-ba6f-4836f687c1aa admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:39:38.556782 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1242/2480] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 11:39:38 2022] POST /identity/v3/projects => generated 385 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:39:38.561288 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d4958d-c136-44e6-b94f-9c2549a407ff admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:39:38.571561 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d4958d-c136-44e6-b94f-9c2549a407ff admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:39:38.638229 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7784224-189c-47fb-9fc5-bac2a3d22e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:39:38.638843 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7784224-189c-47fb-9fc5-bac2a3d22e86 admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:38.639115 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7784224-189c-47fb-9fc5-bac2a3d22e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:38.639378 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7784224-189c-47fb-9fc5-bac2a3d22e86 admin admin] PATH_INFO: `/v3/users` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:38.640006 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7784224-189c-47fb-9fc5-bac2a3d22e86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:39:38.641923 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7784224-189c-47fb-9fc5-bac2a3d22e86 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:39:38.664641 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1239/2481] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 11:39:38 2022] POST /identity/v3/users => generated 293 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:39:38.669014 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f4ee18-493e-4927-ba6f-4836f687c1aa admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:39:38.679210 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f4ee18-493e-4927-ba6f-4836f687c1aa admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:39:38.683958 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc68d720-646d-4b59-9844-8d97c4e64f85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:39:38.684544 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc68d720-646d-4b59-9844-8d97c4e64f85 admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:38.684815 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc68d720-646d-4b59-9844-8d97c4e64f85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:38.685077 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc68d720-646d-4b59-9844-8d97c4e64f85 admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:38.685715 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc68d720-646d-4b59-9844-8d97c4e64f85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:39:38.687368 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc68d720-646d-4b59-9844-8d97c4e64f85 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:39:38.697432 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1243/2482] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:39:38 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:39:38.701516 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7784224-189c-47fb-9fc5-bac2a3d22e86 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:39:38.711635 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7784224-189c-47fb-9fc5-bac2a3d22e86 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:39:38.716709 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a894a9-d393-4fda-8305-90799efe1995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:39:38.717279 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a894a9-d393-4fda-8305-90799efe1995 admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:38.717553 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a894a9-d393-4fda-8305-90799efe1995 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:38.717817 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a894a9-d393-4fda-8305-90799efe1995 admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:38.718487 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a894a9-d393-4fda-8305-90799efe1995 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:39:38.720097 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a894a9-d393-4fda-8305-90799efe1995 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:39:38.730273 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1240/2483] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:39:38 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:39:38.734534 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc68d720-646d-4b59-9844-8d97c4e64f85 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:39:38.745525 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc68d720-646d-4b59-9844-8d97c4e64f85 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:39:38.750732 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b957cdd9-8adb-4965-a125-60e3d0829e2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:39:38.751384 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b957cdd9-8adb-4965-a125-60e3d0829e2e admin admin] REQUEST_METHOD: `PUT` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:38.751662 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b957cdd9-8adb-4965-a125-60e3d0829e2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:38.751906 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b957cdd9-8adb-4965-a125-60e3d0829e2e admin admin] PATH_INFO: `/v3/projects/d6b83668ac9a4864bd8474321a556e17/users/763facd221624f6dae3192c42b4fcf41/roles/27e3e65e24df4b86b0d3d18d3212101d` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:38.768159 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b957cdd9-8adb-4965-a125-60e3d0829e2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6b83668ac9a4864bd8474321a556e17, user_id=763facd221624f6dae3192c42b4fcf41, role_id=27e3e65e24df4b86b0d3d18d3212101d)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:39:38.771033 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b957cdd9-8adb-4965-a125-60e3d0829e2e admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:39:38.784558 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1244/2484] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 11:39:38 2022] PUT /identity/v3/projects/d6b83668ac9a4864bd8474321a556e17/users/763facd221624f6dae3192c42b4fcf41/roles/27e3e65e24df4b86b0d3d18d3212101d => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:39:38.790132 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a04e8e-944f-4a69-b33a-1cfb7f582e71 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:38.790439 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a04e8e-944f-4a69-b33a-1cfb7f582e71 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:38.790783 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a04e8e-944f-4a69-b33a-1cfb7f582e71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:38.810953 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-78a04e8e-944f-4a69-b33a-1cfb7f582e71 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:39:38.812150 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-78a04e8e-944f-4a69-b33a-1cfb7f582e71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:39:38.828725 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:39:38.892136 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1241/2485] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:39:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 11:39:38.902830 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b957cdd9-8adb-4965-a125-60e3d0829e2e admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:39:38.905892 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-b957cdd9-8adb-4965-a125-60e3d0829e2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:39:38.940306 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:39:38.969812 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b957cdd9-8adb-4965-a125-60e3d0829e2e admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:39:38.973676 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9551f678-4ae5-4efb-9fd0-37f87920cf52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2d061d25d83443c9232218c90792d51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:39:38.974286 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9551f678-4ae5-4efb-9fd0-37f87920cf52 service neutron] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:38.974619 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9551f678-4ae5-4efb-9fd0-37f87920cf52 service neutron] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:38.974889 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9551f678-4ae5-4efb-9fd0-37f87920cf52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:38.984228 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9551f678-4ae5-4efb-9fd0-37f87920cf52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:39:38.985672 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9551f678-4ae5-4efb-9fd0-37f87920cf52 service neutron] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:39:38.995655 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1245/2486] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:39:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:39:43.197908 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b67414-d55d-4e84-b10d-06f5be387f1d None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:43.198519 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b67414-d55d-4e84-b10d-06f5be387f1d None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:43.198519 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b67414-d55d-4e84-b10d-06f5be387f1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:43.229169 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-f8b67414-d55d-4e84-b10d-06f5be387f1d None None] MFA Rules not processed for user `763facd221624f6dae3192c42b4fcf41`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:39:43.230952 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-f8b67414-d55d-4e84-b10d-06f5be387f1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:39:43.298130 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1242/2487] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:39:43 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:39:43.302847 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9551f678-4ae5-4efb-9fd0-37f87920cf52 service neutron] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:39:43.313146 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9551f678-4ae5-4efb-9fd0-37f87920cf52 service neutron] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:39:43.319393 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae1fb51-ca75-4149-8869-5e5fe4ccfd78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:39:43.320029 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae1fb51-ca75-4149-8869-5e5fe4ccfd78 admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:43.320304 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae1fb51-ca75-4149-8869-5e5fe4ccfd78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:43.320574 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae1fb51-ca75-4149-8869-5e5fe4ccfd78 admin admin] PATH_INFO: `/v3/projects` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:43.321226 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae1fb51-ca75-4149-8869-5e5fe4ccfd78 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:39:43.323236 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae1fb51-ca75-4149-8869-5e5fe4ccfd78 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:39:43.353093 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1246/2488] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 11:39:43 2022] POST /identity/v3/projects => generated 383 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 11:39:43.356878 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b67414-d55d-4e84-b10d-06f5be387f1d None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:39:43.369019 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b67414-d55d-4e84-b10d-06f5be387f1d None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:39:43.444485 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6931e437-fae4-48f0-8c10-da4023284d06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:39:43.445112 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6931e437-fae4-48f0-8c10-da4023284d06 admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:43.445389 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6931e437-fae4-48f0-8c10-da4023284d06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:43.445660 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6931e437-fae4-48f0-8c10-da4023284d06 admin admin] PATH_INFO: `/v3/users` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:43.446299 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6931e437-fae4-48f0-8c10-da4023284d06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:39:43.449364 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6931e437-fae4-48f0-8c10-da4023284d06 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:39:43.472355 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1243/2489] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 11:39:43 2022] POST /identity/v3/users => generated 298 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:39:43.476645 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae1fb51-ca75-4149-8869-5e5fe4ccfd78 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:39:43.487641 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae1fb51-ca75-4149-8869-5e5fe4ccfd78 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:39:43.493002 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3398003e-39bb-4655-827b-9593f615dee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:39:43.493625 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3398003e-39bb-4655-827b-9593f615dee9 admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:43.494050 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3398003e-39bb-4655-827b-9593f615dee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:43.494534 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3398003e-39bb-4655-827b-9593f615dee9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:43.495184 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3398003e-39bb-4655-827b-9593f615dee9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:39:43.496828 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3398003e-39bb-4655-827b-9593f615dee9 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:39:43.509395 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1247/2490] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:39:43 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:39:43.513504 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6931e437-fae4-48f0-8c10-da4023284d06 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:39:43.527253 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6931e437-fae4-48f0-8c10-da4023284d06 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:39:43.532492 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143ae907-9c10-4ae5-83a0-efa538546d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:39:43.533222 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143ae907-9c10-4ae5-83a0-efa538546d19 admin admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:43.533499 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143ae907-9c10-4ae5-83a0-efa538546d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:43.533768 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143ae907-9c10-4ae5-83a0-efa538546d19 admin admin] PATH_INFO: `/v3/projects/db898998d97f45fa88648670a8178687/users/4a9927e0e79640cd93f49ad1aaa4b39a/roles/30bb1e97257f4ca5b90c88545777317b` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:43.550492 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143ae907-9c10-4ae5-83a0-efa538546d19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db898998d97f45fa88648670a8178687, user_id=4a9927e0e79640cd93f49ad1aaa4b39a, role_id=30bb1e97257f4ca5b90c88545777317b)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:39:43.553297 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143ae907-9c10-4ae5-83a0-efa538546d19 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:39:43.570010 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1244/2491] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 11:39:43 2022] PUT /identity/v3/projects/db898998d97f45fa88648670a8178687/users/4a9927e0e79640cd93f49ad1aaa4b39a/roles/30bb1e97257f4ca5b90c88545777317b => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:39:43.574902 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3398003e-39bb-4655-827b-9593f615dee9 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:39:43.585704 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3398003e-39bb-4655-827b-9593f615dee9 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:39:43.654509 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb50f3fa-89b6-48ad-ba0d-402a1469a596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:39:43.655070 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb50f3fa-89b6-48ad-ba0d-402a1469a596 admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:43.655346 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb50f3fa-89b6-48ad-ba0d-402a1469a596 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:43.655615 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb50f3fa-89b6-48ad-ba0d-402a1469a596 admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:43.656260 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb50f3fa-89b6-48ad-ba0d-402a1469a596 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:39:43.657897 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb50f3fa-89b6-48ad-ba0d-402a1469a596 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:39:43.668608 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1248/2492] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:39:43 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:39:43.673185 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143ae907-9c10-4ae5-83a0-efa538546d19 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:39:43.684714 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143ae907-9c10-4ae5-83a0-efa538546d19 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:39:43.689909 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d63c4fb-91f7-4a2e-a70d-8ce50f565348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:39:43.690792 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d63c4fb-91f7-4a2e-a70d-8ce50f565348 admin admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:43.691054 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d63c4fb-91f7-4a2e-a70d-8ce50f565348 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:43.691300 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d63c4fb-91f7-4a2e-a70d-8ce50f565348 admin admin] PATH_INFO: `/v3/projects/db898998d97f45fa88648670a8178687/users/4a9927e0e79640cd93f49ad1aaa4b39a/roles/30bb1e97257f4ca5b90c88545777317b` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:43.693270 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d63c4fb-91f7-4a2e-a70d-8ce50f565348 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db898998d97f45fa88648670a8178687, user_id=4a9927e0e79640cd93f49ad1aaa4b39a, role_id=30bb1e97257f4ca5b90c88545777317b)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:39:43.695962 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d63c4fb-91f7-4a2e-a70d-8ce50f565348 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:39:43.707048 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1245/2493] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 11:39:43 2022] PUT /identity/v3/projects/db898998d97f45fa88648670a8178687/users/4a9927e0e79640cd93f49ad1aaa4b39a/roles/30bb1e97257f4ca5b90c88545777317b => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 11:39:43.840760 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb50f3fa-89b6-48ad-ba0d-402a1469a596 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:39:43.842720 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-eb50f3fa-89b6-48ad-ba0d-402a1469a596 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:39:43.859941 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb50f3fa-89b6-48ad-ba0d-402a1469a596 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:39:43.921524 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a05a3d-9737-42cc-a0b4-fd99972787c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:39:43.922173 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a05a3d-9737-42cc-a0b4-fd99972787c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:43.922474 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a05a3d-9737-42cc-a0b4-fd99972787c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:43.922762 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a05a3d-9737-42cc-a0b4-fd99972787c3 admin admin] PATH_INFO: `/v3/users/0388c4843d334214a60c749da92d591a` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:43.923924 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a05a3d-9737-42cc-a0b4-fd99972787c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0388c4843d334214a60c749da92d591a)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:39:43.925988 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a05a3d-9737-42cc-a0b4-fd99972787c3 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:39:43.974179 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:39:43.986497 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-a9a05a3d-9737-42cc-a0b4-fd99972787c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0388c4843d334214a60c749da92d591a'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:39:43.987171 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-a9a05a3d-9737-42cc-a0b4-fd99972787c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0388c4843d334214a60c749da92d591a'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:39:43.987945 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-a9a05a3d-9737-42cc-a0b4-fd99972787c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0388c4843d334214a60c749da92d591a'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:39:44.001847 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-a9a05a3d-9737-42cc-a0b4-fd99972787c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0388c4843d334214a60c749da92d591a'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:39:44.010178 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-a9a05a3d-9737-42cc-a0b4-fd99972787c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0388c4843d334214a60c749da92d591a'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:39:44.033153 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1249/2494] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 11:39:43 2022] DELETE /identity/v3/users/0388c4843d334214a60c749da92d591a => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:39:44.037723 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0458a6a-b206-49a5-9191-ea1eb1463895 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:44.038026 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0458a6a-b206-49a5-9191-ea1eb1463895 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:44.038293 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0458a6a-b206-49a5-9191-ea1eb1463895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:44.047753 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:39:44.068348 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-b0458a6a-b206-49a5-9191-ea1eb1463895 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:39:44.071148 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-b0458a6a-b206-49a5-9191-ea1eb1463895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:39:44.166233 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1246/2495] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:39:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:39:44.176111 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a05a3d-9737-42cc-a0b4-fd99972787c3 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:39:44.177663 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-a9a05a3d-9737-42cc-a0b4-fd99972787c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:39:44.239437 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a05a3d-9737-42cc-a0b4-fd99972787c3 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:39:44.244048 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae40dc1a-5af8-49b8-838b-c9b3cb3c3e0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2d061d25d83443c9232218c90792d51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:39:44.244704 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae40dc1a-5af8-49b8-838b-c9b3cb3c3e0a service neutron] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:44.244996 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae40dc1a-5af8-49b8-838b-c9b3cb3c3e0a service neutron] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:44.245369 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae40dc1a-5af8-49b8-838b-c9b3cb3c3e0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:44.255094 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae40dc1a-5af8-49b8-838b-c9b3cb3c3e0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:39:44.256644 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae40dc1a-5af8-49b8-838b-c9b3cb3c3e0a service neutron] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:39:44.267009 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1250/2496] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:39:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:39:44.581164 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0458a6a-b206-49a5-9191-ea1eb1463895 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:39:44.582658 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-b0458a6a-b206-49a5-9191-ea1eb1463895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:39:44.601999 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0458a6a-b206-49a5-9191-ea1eb1463895 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:39:44.607079 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd8208e-9850-45da-9615-d41c717ffba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:39:44.607726 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd8208e-9850-45da-9615-d41c717ffba9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:44.608003 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd8208e-9850-45da-9615-d41c717ffba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:44.608274 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd8208e-9850-45da-9615-d41c717ffba9 admin admin] PATH_INFO: `/v3/projects/de2cf159c9ca45e2a2b904fa61c4988c` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:44.609406 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd8208e-9850-45da-9615-d41c717ffba9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de2cf159c9ca45e2a2b904fa61c4988c)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:39:44.611445 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd8208e-9850-45da-9615-d41c717ffba9 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:39:44.674809 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-acd8208e-9850-45da-9615-d41c717ffba9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de2cf159c9ca45e2a2b904fa61c4988c', 'request_id': 'req-acd8208e-9850-45da-9615-d41c717ffba9'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:39:44.682297 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-acd8208e-9850-45da-9615-d41c717ffba9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de2cf159c9ca45e2a2b904fa61c4988c', 'request_id': 'req-acd8208e-9850-45da-9615-d41c717ffba9'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:39:44.689230 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-acd8208e-9850-45da-9615-d41c717ffba9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de2cf159c9ca45e2a2b904fa61c4988c', 'request_id': 'req-acd8208e-9850-45da-9615-d41c717ffba9'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:39:44.705417 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-acd8208e-9850-45da-9615-d41c717ffba9 admin admin] The token cache is being invalidate because project de2cf159c9ca45e2a2b904fa61c4988c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:39:44.705711 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-acd8208e-9850-45da-9615-d41c717ffba9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:39:44.706419 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-acd8208e-9850-45da-9615-d41c717ffba9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:39:44.708184 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1247/2497] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 11:39:44 2022] DELETE /identity/v3/projects/de2cf159c9ca45e2a2b904fa61c4988c => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:39:44.713171 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f11cc4-c551-40d2-9b88-1001b26a9f0f None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:44.713740 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f11cc4-c551-40d2-9b88-1001b26a9f0f None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:44.713740 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f11cc4-c551-40d2-9b88-1001b26a9f0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:44.735217 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-54f11cc4-c551-40d2-9b88-1001b26a9f0f None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:39:44.736546 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-54f11cc4-c551-40d2-9b88-1001b26a9f0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:39:44.809357 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1251/2498] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:39:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:39:44.817739 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8b5d3a-b30d-4a2c-aacb-6aad6300b375 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:44.818160 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8b5d3a-b30d-4a2c-aacb-6aad6300b375 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:44.818505 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8b5d3a-b30d-4a2c-aacb-6aad6300b375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:44.841976 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-8d8b5d3a-b30d-4a2c-aacb-6aad6300b375 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:39:44.843228 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-8d8b5d3a-b30d-4a2c-aacb-6aad6300b375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:39:44.851447 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1248/2499] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:39:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:39:44.855757 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f11cc4-c551-40d2-9b88-1001b26a9f0f None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:39:44.868215 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f11cc4-c551-40d2-9b88-1001b26a9f0f None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:39:44.873894 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383a27b8-cdf6-439a-876d-9157230992b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:39:44.874550 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383a27b8-cdf6-439a-876d-9157230992b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:44.874828 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383a27b8-cdf6-439a-876d-9157230992b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:44.875680 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383a27b8-cdf6-439a-876d-9157230992b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:44.876355 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383a27b8-cdf6-439a-876d-9157230992b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:39:44.876716 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383a27b8-cdf6-439a-876d-9157230992b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:39:44.878540 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383a27b8-cdf6-439a-876d-9157230992b7 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:39:44.892980 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1252/2500] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 24 11:39:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:39:44.899333 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8b5d3a-b30d-4a2c-aacb-6aad6300b375 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:39:44.912420 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8b5d3a-b30d-4a2c-aacb-6aad6300b375 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:39:44.918510 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575bab08-75c2-4b65-af58-6f3620440d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:39:44.919374 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575bab08-75c2-4b65-af58-6f3620440d9b admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:44.919835 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575bab08-75c2-4b65-af58-6f3620440d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:44.920176 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575bab08-75c2-4b65-af58-6f3620440d9b admin admin] PATH_INFO: `/v3/projects` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:44.921126 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575bab08-75c2-4b65-af58-6f3620440d9b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:39:44.923436 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575bab08-75c2-4b65-af58-6f3620440d9b admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:39:44.960646 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1249/2501] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 11:39:44 2022] POST /identity/v3/projects => generated 363 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 11:39:44.962274 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383a27b8-cdf6-439a-876d-9157230992b7 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:39:44.975314 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383a27b8-cdf6-439a-876d-9157230992b7 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:39:45.022248 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:39:45.046389 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b743b61c-a876-40cf-85d0-23bedbcff7ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:39:45.047027 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b743b61c-a876-40cf-85d0-23bedbcff7ad admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:45.047308 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b743b61c-a876-40cf-85d0-23bedbcff7ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:45.047575 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b743b61c-a876-40cf-85d0-23bedbcff7ad admin admin] PATH_INFO: `/v3/users` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:45.048204 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b743b61c-a876-40cf-85d0-23bedbcff7ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:39:45.050151 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b743b61c-a876-40cf-85d0-23bedbcff7ad admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:39:45.080504 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1253/2502] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 11:39:44 2022] POST /identity/v3/users => generated 282 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:39:45.082007 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575bab08-75c2-4b65-af58-6f3620440d9b admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:39:45.093505 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575bab08-75c2-4b65-af58-6f3620440d9b admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:39:45.098209 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711781f9-971a-49dd-9715-2bcaf345fc44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:39:45.102446 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711781f9-971a-49dd-9715-2bcaf345fc44 admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:45.102446 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711781f9-971a-49dd-9715-2bcaf345fc44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:45.102446 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711781f9-971a-49dd-9715-2bcaf345fc44 admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:45.102446 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711781f9-971a-49dd-9715-2bcaf345fc44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:39:45.102446 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711781f9-971a-49dd-9715-2bcaf345fc44 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:39:45.117947 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b743b61c-a876-40cf-85d0-23bedbcff7ad admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:39:45.118394 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1250/2503] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:39:45 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:39:45.128649 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b743b61c-a876-40cf-85d0-23bedbcff7ad admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:39:45.133954 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58edcc3-22e6-44da-9749-d0d2682aa38e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:39:45.134600 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58edcc3-22e6-44da-9749-d0d2682aa38e admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:45.134877 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58edcc3-22e6-44da-9749-d0d2682aa38e admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:45.135145 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58edcc3-22e6-44da-9749-d0d2682aa38e admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:45.135934 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58edcc3-22e6-44da-9749-d0d2682aa38e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:39:45.137540 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58edcc3-22e6-44da-9749-d0d2682aa38e admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:39:45.149565 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1254/2504] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:39:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:39:45.153860 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711781f9-971a-49dd-9715-2bcaf345fc44 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:39:45.169559 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711781f9-971a-49dd-9715-2bcaf345fc44 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:39:45.177875 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561abac6-4da6-4c8a-9e0c-0b3eb8679855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:39:45.178687 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561abac6-4da6-4c8a-9e0c-0b3eb8679855 admin admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:45.179035 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561abac6-4da6-4c8a-9e0c-0b3eb8679855 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:45.179964 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561abac6-4da6-4c8a-9e0c-0b3eb8679855 admin admin] PATH_INFO: `/v3/projects/f9edaff27dc5473cbbb6e1fb8e8f403c/users/df29a11481214a2db9849174656f1e16/roles/27e3e65e24df4b86b0d3d18d3212101d` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:45.207491 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561abac6-4da6-4c8a-9e0c-0b3eb8679855 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9edaff27dc5473cbbb6e1fb8e8f403c, user_id=df29a11481214a2db9849174656f1e16, role_id=27e3e65e24df4b86b0d3d18d3212101d)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:39:45.210500 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561abac6-4da6-4c8a-9e0c-0b3eb8679855 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:39:45.227537 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1251/2505] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 11:39:45 2022] PUT /identity/v3/projects/f9edaff27dc5473cbbb6e1fb8e8f403c/users/df29a11481214a2db9849174656f1e16/roles/27e3e65e24df4b86b0d3d18d3212101d => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:39:45.239043 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f670134c-7d03-4f4e-86e8-9ab3f6eff67e None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:45.239329 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f670134c-7d03-4f4e-86e8-9ab3f6eff67e None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:45.239602 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f670134c-7d03-4f4e-86e8-9ab3f6eff67e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:45.270124 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-f670134c-7d03-4f4e-86e8-9ab3f6eff67e None None] MFA Rules not processed for user `df29a11481214a2db9849174656f1e16`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:39:45.271408 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-f670134c-7d03-4f4e-86e8-9ab3f6eff67e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:39:45.351947 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1255/2506] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:39:45 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:39:45.356480 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561abac6-4da6-4c8a-9e0c-0b3eb8679855 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:39:45.407138 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:39:45.486376 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561abac6-4da6-4c8a-9e0c-0b3eb8679855 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:39:45.493889 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a32f8be-1bf6-4694-9caa-8c855651fe82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:39:45.493889 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a32f8be-1bf6-4694-9caa-8c855651fe82 admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:45.494137 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a32f8be-1bf6-4694-9caa-8c855651fe82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:45.494801 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a32f8be-1bf6-4694-9caa-8c855651fe82 admin admin] PATH_INFO: `/v3/projects` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:45.495460 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a32f8be-1bf6-4694-9caa-8c855651fe82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:39:45.497430 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a32f8be-1bf6-4694-9caa-8c855651fe82 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:39:45.540053 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f670134c-7d03-4f4e-86e8-9ab3f6eff67e None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:39:45.549696 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1252/2507] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 11:39:45 2022] POST /identity/v3/projects => generated 363 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:39:45.567255 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f670134c-7d03-4f4e-86e8-9ab3f6eff67e None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:39:45.657403 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cce912-9d7c-48aa-883f-5f16a7d04688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:39:45.658514 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cce912-9d7c-48aa-883f-5f16a7d04688 admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:45.658987 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cce912-9d7c-48aa-883f-5f16a7d04688 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:45.659260 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cce912-9d7c-48aa-883f-5f16a7d04688 admin admin] PATH_INFO: `/v3/users` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:45.659897 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cce912-9d7c-48aa-883f-5f16a7d04688 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:39:45.661928 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cce912-9d7c-48aa-883f-5f16a7d04688 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:39:45.693159 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1256/2508] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 11:39:45 2022] POST /identity/v3/users => generated 288 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:39:45.693610 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a32f8be-1bf6-4694-9caa-8c855651fe82 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:39:45.705050 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a32f8be-1bf6-4694-9caa-8c855651fe82 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:39:45.711130 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc3effa-956a-4309-88ac-e6b44128e4ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:39:45.711960 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc3effa-956a-4309-88ac-e6b44128e4ec admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:45.713016 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc3effa-956a-4309-88ac-e6b44128e4ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:45.713300 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc3effa-956a-4309-88ac-e6b44128e4ec admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:45.714075 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc3effa-956a-4309-88ac-e6b44128e4ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:39:45.715963 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc3effa-956a-4309-88ac-e6b44128e4ec admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:39:45.730617 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1253/2509] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:39:45 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:39:45.735194 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cce912-9d7c-48aa-883f-5f16a7d04688 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:39:45.749585 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cce912-9d7c-48aa-883f-5f16a7d04688 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:39:45.754419 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b297eda4-7c54-4a55-91c7-aed9bd90f17a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:39:45.755095 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b297eda4-7c54-4a55-91c7-aed9bd90f17a admin admin] REQUEST_METHOD: `PUT` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:45.755412 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b297eda4-7c54-4a55-91c7-aed9bd90f17a admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:45.755675 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b297eda4-7c54-4a55-91c7-aed9bd90f17a admin admin] PATH_INFO: `/v3/projects/46c44102516d4341a4a15fb592179ec0/users/e363c07fe485483b97300ec5ae64f235/roles/30bb1e97257f4ca5b90c88545777317b` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:45.783977 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b297eda4-7c54-4a55-91c7-aed9bd90f17a admin admin] RBAC: Authorizing `identity:create_grant(project_id=46c44102516d4341a4a15fb592179ec0, user_id=e363c07fe485483b97300ec5ae64f235, role_id=30bb1e97257f4ca5b90c88545777317b)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:39:45.787654 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b297eda4-7c54-4a55-91c7-aed9bd90f17a admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:39:45.810785 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1257/2510] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 11:39:45 2022] PUT /identity/v3/projects/46c44102516d4341a4a15fb592179ec0/users/e363c07fe485483b97300ec5ae64f235/roles/30bb1e97257f4ca5b90c88545777317b => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 11:39:45.815059 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc3effa-956a-4309-88ac-e6b44128e4ec admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:39:45.825853 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc3effa-956a-4309-88ac-e6b44128e4ec admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:39:45.904040 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67217759-96ac-4e9a-be9b-d0a5945700c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:39:45.905593 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67217759-96ac-4e9a-be9b-d0a5945700c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:45.907087 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67217759-96ac-4e9a-be9b-d0a5945700c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:45.912694 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67217759-96ac-4e9a-be9b-d0a5945700c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:45.913687 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67217759-96ac-4e9a-be9b-d0a5945700c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:39:45.921516 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67217759-96ac-4e9a-be9b-d0a5945700c0 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:39:45.956408 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1254/2511] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:39:45 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:39:45.957648 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b297eda4-7c54-4a55-91c7-aed9bd90f17a admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:39:45.969398 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b297eda4-7c54-4a55-91c7-aed9bd90f17a admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:39:45.978532 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776d9007-ea2d-42c0-ab90-ab85f221928f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:39:45.980380 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776d9007-ea2d-42c0-ab90-ab85f221928f admin admin] REQUEST_METHOD: `PUT` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:45.980614 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776d9007-ea2d-42c0-ab90-ab85f221928f admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:45.980888 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776d9007-ea2d-42c0-ab90-ab85f221928f admin admin] PATH_INFO: `/v3/projects/46c44102516d4341a4a15fb592179ec0/users/e363c07fe485483b97300ec5ae64f235/roles/30bb1e97257f4ca5b90c88545777317b` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:45.985213 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776d9007-ea2d-42c0-ab90-ab85f221928f admin admin] RBAC: Authorizing `identity:create_grant(project_id=46c44102516d4341a4a15fb592179ec0, user_id=e363c07fe485483b97300ec5ae64f235, role_id=30bb1e97257f4ca5b90c88545777317b)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:39:45.986078 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776d9007-ea2d-42c0-ab90-ab85f221928f admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:39:46.006699 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1258/2512] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 11:39:45 2022] PUT /identity/v3/projects/46c44102516d4341a4a15fb592179ec0/users/e363c07fe485483b97300ec5ae64f235/roles/30bb1e97257f4ca5b90c88545777317b => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:39:46.009462 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb945462-99d0-48bf-98ba-15f1d523a412 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:46.009944 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb945462-99d0-48bf-98ba-15f1d523a412 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:46.010446 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb945462-99d0-48bf-98ba-15f1d523a412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:46.047539 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-bb945462-99d0-48bf-98ba-15f1d523a412 None None] MFA Rules not processed for user `e363c07fe485483b97300ec5ae64f235`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:39:46.049085 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-bb945462-99d0-48bf-98ba-15f1d523a412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:39:46.160238 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1255/2513] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:39:46 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:39:46.173144 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776d9007-ea2d-42c0-ab90-ab85f221928f admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:39:46.177464 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-776d9007-ea2d-42c0-ab90-ab85f221928f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:39:46.189035 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:39:46.307048 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776d9007-ea2d-42c0-ab90-ab85f221928f admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:39:46.314328 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21375453-aa41-4f37-8019-62132217b52a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92862b76ba3b4513b5dc5b5c962faac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:39:46.314998 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21375453-aa41-4f37-8019-62132217b52a service cinder] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:46.315566 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21375453-aa41-4f37-8019-62132217b52a service cinder] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:46.315566 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21375453-aa41-4f37-8019-62132217b52a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:46.343906 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21375453-aa41-4f37-8019-62132217b52a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:39:46.349995 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21375453-aa41-4f37-8019-62132217b52a service cinder] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:39:46.394772 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1259/2514] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:39:46 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:39:46.493026 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb945462-99d0-48bf-98ba-15f1d523a412 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:39:46.506322 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb945462-99d0-48bf-98ba-15f1d523a412 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:39:46.513110 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02f8232-5021-401c-8dc8-e12697fd8ac9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92862b76ba3b4513b5dc5b5c962faac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:39:46.514571 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02f8232-5021-401c-8dc8-e12697fd8ac9 service cinder] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:46.514712 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02f8232-5021-401c-8dc8-e12697fd8ac9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:46.515066 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02f8232-5021-401c-8dc8-e12697fd8ac9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:46.530945 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:39:46.601967 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02f8232-5021-401c-8dc8-e12697fd8ac9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:39:46.609255 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02f8232-5021-401c-8dc8-e12697fd8ac9 service cinder] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:39:46.655778 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1256/2515] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:39:46 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:39:47.764216 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21375453-aa41-4f37-8019-62132217b52a service cinder] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:39:47.766919 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-21375453-aa41-4f37-8019-62132217b52a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:39:47.881608 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21375453-aa41-4f37-8019-62132217b52a service cinder] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:39:47.889291 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97542a9-31a0-44b1-a7af-5426bcadb70f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '282ec32864d046b2bea170f6a3845cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:39:47.889929 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97542a9-31a0-44b1-a7af-5426bcadb70f service nova] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:47.890204 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97542a9-31a0-44b1-a7af-5426bcadb70f service nova] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:47.890509 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97542a9-31a0-44b1-a7af-5426bcadb70f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:47.892301 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-c97542a9-31a0-44b1-a7af-5426bcadb70f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:39:48.005291 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97542a9-31a0-44b1-a7af-5426bcadb70f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:39:48.007362 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97542a9-31a0-44b1-a7af-5426bcadb70f service nova] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:39:48.048399 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1260/2516] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:39:47 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:39:49.944168 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bb3150-8453-4637-a2a2-b4afdb352d06 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:49.944746 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bb3150-8453-4637-a2a2-b4afdb352d06 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:49.944865 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bb3150-8453-4637-a2a2-b4afdb352d06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:49.994611 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-c2bb3150-8453-4637-a2a2-b4afdb352d06 None None] MFA Rules not processed for user `4a9927e0e79640cd93f49ad1aaa4b39a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:39:49.996418 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-c2bb3150-8453-4637-a2a2-b4afdb352d06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:39:50.094420 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1257/2517] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:39:49 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:39:50.109261 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97542a9-31a0-44b1-a7af-5426bcadb70f service nova] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:39:50.110868 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-c97542a9-31a0-44b1-a7af-5426bcadb70f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:39:50.179684 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:39:50.192024 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97542a9-31a0-44b1-a7af-5426bcadb70f service nova] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:39:50.213140 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96791985-e4da-415b-b86b-9ced0565e0ac service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abffba24649e49d28a01cbee51924ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:39:50.213783 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96791985-e4da-415b-b86b-9ced0565e0ac service glance] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:50.214065 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96791985-e4da-415b-b86b-9ced0565e0ac service glance] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:50.214344 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96791985-e4da-415b-b86b-9ced0565e0ac service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:50.219642 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-96791985-e4da-415b-b86b-9ced0565e0ac service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:39:50.293852 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96791985-e4da-415b-b86b-9ced0565e0ac service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:39:50.295412 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96791985-e4da-415b-b86b-9ced0565e0ac service glance] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:39:50.305274 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1261/2518] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:39:50 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:39:50.441258 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bdbac9-ec2c-4339-8d27-4ac35b4c1dad None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:50.441681 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bdbac9-ec2c-4339-8d27-4ac35b4c1dad None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:50.441892 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bdbac9-ec2c-4339-8d27-4ac35b4c1dad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:50.463280 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-b2bdbac9-ec2c-4339-8d27-4ac35b4c1dad None None] MFA Rules not processed for user `a5915030f01941fc89f92228ff57c7f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:39:50.465230 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-b2bdbac9-ec2c-4339-8d27-4ac35b4c1dad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:39:50.529938 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1258/2519] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Aug 24 11:39:50 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:39:50.555229 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96791985-e4da-415b-b86b-9ced0565e0ac service glance] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:39:50.557161 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-96791985-e4da-415b-b86b-9ced0565e0ac service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:39:50.643176 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96791985-e4da-415b-b86b-9ced0565e0ac service glance] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:39:50.652405 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273155d3-77f8-4acc-9de5-750eb9848326 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1069558c085449f9e4c9f06013b2a85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:39:50.653293 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273155d3-77f8-4acc-9de5-750eb9848326 service swift] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:50.653657 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273155d3-77f8-4acc-9de5-750eb9848326 service swift] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:50.654060 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273155d3-77f8-4acc-9de5-750eb9848326 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:50.670632 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273155d3-77f8-4acc-9de5-750eb9848326 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:39:50.670632 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273155d3-77f8-4acc-9de5-750eb9848326 service swift] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:39:50.678838 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1262/2520] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Aug 24 11:39:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 11:39:52.927164 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bdbac9-ec2c-4339-8d27-4ac35b4c1dad None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:39:52.928761 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-b2bdbac9-ec2c-4339-8d27-4ac35b4c1dad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:39:52.959782 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bdbac9-ec2c-4339-8d27-4ac35b4c1dad None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:39:52.977562 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86907b31-50a8-4870-99cf-67b1144ce7c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '282ec32864d046b2bea170f6a3845cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:39:52.978223 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86907b31-50a8-4870-99cf-67b1144ce7c8 service nova] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:52.978535 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86907b31-50a8-4870-99cf-67b1144ce7c8 service nova] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:52.980463 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86907b31-50a8-4870-99cf-67b1144ce7c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:52.982577 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-86907b31-50a8-4870-99cf-67b1144ce7c8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:39:53.010225 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86907b31-50a8-4870-99cf-67b1144ce7c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:39:53.012902 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86907b31-50a8-4870-99cf-67b1144ce7c8 service nova] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:39:53.030408 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1259/2521] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:39:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:39:53.523281 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273155d3-77f8-4acc-9de5-750eb9848326 service swift] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:39:53.524842 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-273155d3-77f8-4acc-9de5-750eb9848326 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:39:53.599120 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273155d3-77f8-4acc-9de5-750eb9848326 service swift] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:39:53.606099 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1701db23-2cc5-420f-9380-3329849cf585 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2d061d25d83443c9232218c90792d51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:39:53.607189 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1701db23-2cc5-420f-9380-3329849cf585 service neutron] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:53.607704 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1701db23-2cc5-420f-9380-3329849cf585 service neutron] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:53.608236 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1701db23-2cc5-420f-9380-3329849cf585 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:53.610509 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-1701db23-2cc5-420f-9380-3329849cf585 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:39:53.678261 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:39:53.705518 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1701db23-2cc5-420f-9380-3329849cf585 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:39:53.707723 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1701db23-2cc5-420f-9380-3329849cf585 service neutron] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:39:53.719305 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1263/2522] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:39:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:39:54.075757 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86907b31-50a8-4870-99cf-67b1144ce7c8 service nova] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:39:54.096221 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86907b31-50a8-4870-99cf-67b1144ce7c8 service nova] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:39:54.127838 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f2a442-c704-4dc8-9b74-39565f518d55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:39:54.131360 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f2a442-c704-4dc8-9b74-39565f518d55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:54.131878 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f2a442-c704-4dc8-9b74-39565f518d55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:54.132344 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f2a442-c704-4dc8-9b74-39565f518d55 admin admin] PATH_INFO: `/v3/users/df29a11481214a2db9849174656f1e16` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:54.135406 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f2a442-c704-4dc8-9b74-39565f518d55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df29a11481214a2db9849174656f1e16)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:39:54.138594 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f2a442-c704-4dc8-9b74-39565f518d55 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:39:54.204319 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:39:54.239086 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-b3f2a442-c704-4dc8-9b74-39565f518d55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df29a11481214a2db9849174656f1e16'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:39:54.240102 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-b3f2a442-c704-4dc8-9b74-39565f518d55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df29a11481214a2db9849174656f1e16'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:39:54.257353 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-b3f2a442-c704-4dc8-9b74-39565f518d55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df29a11481214a2db9849174656f1e16'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:39:54.277135 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-b3f2a442-c704-4dc8-9b74-39565f518d55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df29a11481214a2db9849174656f1e16'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:39:54.277921 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-b3f2a442-c704-4dc8-9b74-39565f518d55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df29a11481214a2db9849174656f1e16'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:39:54.309879 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1260/2523] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 11:39:54 2022] DELETE /identity/v3/users/df29a11481214a2db9849174656f1e16 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 11:39:54.314001 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f164b66-acb2-4bc5-b2e8-f294d8dd9f07 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:54.314576 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f164b66-acb2-4bc5-b2e8-f294d8dd9f07 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:54.315075 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f164b66-acb2-4bc5-b2e8-f294d8dd9f07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:54.357852 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-0f164b66-acb2-4bc5-b2e8-f294d8dd9f07 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:39:54.359401 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-0f164b66-acb2-4bc5-b2e8-f294d8dd9f07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:39:54.398595 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f2a442-c704-4dc8-9b74-39565f518d55 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:39:54.400082 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-b3f2a442-c704-4dc8-9b74-39565f518d55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:39:54.482060 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1264/2524] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:39:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:39:54.512626 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f164b66-acb2-4bc5-b2e8-f294d8dd9f07 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:39:54.522147 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-0f164b66-acb2-4bc5-b2e8-f294d8dd9f07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:39:54.563640 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f2a442-c704-4dc8-9b74-39565f518d55 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:39:54.584609 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee32c05b-b18d-4d20-8bc0-2a4b526fa02e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '282ec32864d046b2bea170f6a3845cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:39:54.585249 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee32c05b-b18d-4d20-8bc0-2a4b526fa02e service nova] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:54.585523 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee32c05b-b18d-4d20-8bc0-2a4b526fa02e service nova] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:54.585791 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee32c05b-b18d-4d20-8bc0-2a4b526fa02e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:54.589340 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-ee32c05b-b18d-4d20-8bc0-2a4b526fa02e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:39:54.678373 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f164b66-acb2-4bc5-b2e8-f294d8dd9f07 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:39:54.683077 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61959b9-8f71-4b19-bb04-56b78c8f69da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2d061d25d83443c9232218c90792d51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:39:54.684414 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61959b9-8f71-4b19-bb04-56b78c8f69da service neutron] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:54.684919 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61959b9-8f71-4b19-bb04-56b78c8f69da service neutron] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:54.685205 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61959b9-8f71-4b19-bb04-56b78c8f69da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:54.699046 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61959b9-8f71-4b19-bb04-56b78c8f69da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:39:54.700762 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee32c05b-b18d-4d20-8bc0-2a4b526fa02e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:39:54.702746 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee32c05b-b18d-4d20-8bc0-2a4b526fa02e service nova] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:39:54.704075 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61959b9-8f71-4b19-bb04-56b78c8f69da service neutron] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:39:54.719105 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1261/2525] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:39:54 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:39:54.720420 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee32c05b-b18d-4d20-8bc0-2a4b526fa02e service nova] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:39:54.736262 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-ee32c05b-b18d-4d20-8bc0-2a4b526fa02e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:39:54.750206 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1265/2526] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:39:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:39:54.776001 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee32c05b-b18d-4d20-8bc0-2a4b526fa02e service nova] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:39:54.783168 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67899eed-9d9d-41b2-8d62-08487d2d61f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2d061d25d83443c9232218c90792d51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:39:54.783988 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67899eed-9d9d-41b2-8d62-08487d2d61f9 service neutron] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:54.784409 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67899eed-9d9d-41b2-8d62-08487d2d61f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:54.784688 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67899eed-9d9d-41b2-8d62-08487d2d61f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:54.808616 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67899eed-9d9d-41b2-8d62-08487d2d61f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:39:54.810082 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67899eed-9d9d-41b2-8d62-08487d2d61f9 service neutron] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:39:54.825237 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1262/2527] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:39:54 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:39:55.444789 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61959b9-8f71-4b19-bb04-56b78c8f69da service neutron] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:39:55.446490 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-c61959b9-8f71-4b19-bb04-56b78c8f69da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:39:55.476234 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61959b9-8f71-4b19-bb04-56b78c8f69da service neutron] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:39:55.488835 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c1a098-dd37-4742-9a2b-08a3dd69a76c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:39:55.489844 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c1a098-dd37-4742-9a2b-08a3dd69a76c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:55.489844 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c1a098-dd37-4742-9a2b-08a3dd69a76c admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:55.490114 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c1a098-dd37-4742-9a2b-08a3dd69a76c admin admin] PATH_INFO: `/v3/projects/f9edaff27dc5473cbbb6e1fb8e8f403c` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:55.492571 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c1a098-dd37-4742-9a2b-08a3dd69a76c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9edaff27dc5473cbbb6e1fb8e8f403c)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:39:55.494915 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c1a098-dd37-4742-9a2b-08a3dd69a76c admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:39:55.617610 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-73c1a098-dd37-4742-9a2b-08a3dd69a76c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9edaff27dc5473cbbb6e1fb8e8f403c', 'request_id': 'req-73c1a098-dd37-4742-9a2b-08a3dd69a76c'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:39:55.638735 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-73c1a098-dd37-4742-9a2b-08a3dd69a76c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9edaff27dc5473cbbb6e1fb8e8f403c', 'request_id': 'req-73c1a098-dd37-4742-9a2b-08a3dd69a76c'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:39:55.655583 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-73c1a098-dd37-4742-9a2b-08a3dd69a76c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9edaff27dc5473cbbb6e1fb8e8f403c', 'request_id': 'req-73c1a098-dd37-4742-9a2b-08a3dd69a76c'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:39:55.707649 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-73c1a098-dd37-4742-9a2b-08a3dd69a76c admin admin] The token cache is being invalidate because project f9edaff27dc5473cbbb6e1fb8e8f403c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81501) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:39:55.708226 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-73c1a098-dd37-4742-9a2b-08a3dd69a76c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:39:55.709152 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-73c1a098-dd37-4742-9a2b-08a3dd69a76c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:39:55.725009 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1266/2528] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 11:39:55 2022] DELETE /identity/v3/projects/f9edaff27dc5473cbbb6e1fb8e8f403c => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:39:55.729119 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67899eed-9d9d-41b2-8d62-08487d2d61f9 service neutron] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:39:55.766447 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67899eed-9d9d-41b2-8d62-08487d2d61f9 service neutron] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:39:55.842528 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:39:55.976851 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039138cf-ce43-400a-83e7-ee0c35d33835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:39:55.977067 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039138cf-ce43-400a-83e7-ee0c35d33835 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:55.977453 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039138cf-ce43-400a-83e7-ee0c35d33835 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:55.977575 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039138cf-ce43-400a-83e7-ee0c35d33835 admin admin] PATH_INFO: `/v3/users/e363c07fe485483b97300ec5ae64f235` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:55.990893 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039138cf-ce43-400a-83e7-ee0c35d33835 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e363c07fe485483b97300ec5ae64f235)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:39:55.993275 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039138cf-ce43-400a-83e7-ee0c35d33835 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:39:56.110669 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-039138cf-ce43-400a-83e7-ee0c35d33835 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e363c07fe485483b97300ec5ae64f235'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:39:56.122864 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-039138cf-ce43-400a-83e7-ee0c35d33835 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e363c07fe485483b97300ec5ae64f235'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:39:56.136546 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-039138cf-ce43-400a-83e7-ee0c35d33835 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e363c07fe485483b97300ec5ae64f235'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:39:56.146751 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-039138cf-ce43-400a-83e7-ee0c35d33835 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e363c07fe485483b97300ec5ae64f235'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:39:56.147576 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-039138cf-ce43-400a-83e7-ee0c35d33835 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e363c07fe485483b97300ec5ae64f235'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:39:56.171595 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1263/2529] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 11:39:55 2022] DELETE /identity/v3/users/e363c07fe485483b97300ec5ae64f235 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:39:56.943096 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c1a098-dd37-4742-9a2b-08a3dd69a76c admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:39:56.944697 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-73c1a098-dd37-4742-9a2b-08a3dd69a76c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:39:56.961066 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:39:56.967127 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c1a098-dd37-4742-9a2b-08a3dd69a76c admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:39:57.068539 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf3f4b9-2d92-4322-bbac-9f6df78d5475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:39:57.069677 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf3f4b9-2d92-4322-bbac-9f6df78d5475 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:57.070136 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf3f4b9-2d92-4322-bbac-9f6df78d5475 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:57.070624 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf3f4b9-2d92-4322-bbac-9f6df78d5475 admin admin] PATH_INFO: `/v3/projects/46c44102516d4341a4a15fb592179ec0` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:57.072283 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf3f4b9-2d92-4322-bbac-9f6df78d5475 admin admin] RBAC: Authorizing `identity:delete_project(project_id=46c44102516d4341a4a15fb592179ec0)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:39:57.074614 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf3f4b9-2d92-4322-bbac-9f6df78d5475 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:39:57.231609 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-2bf3f4b9-2d92-4322-bbac-9f6df78d5475 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46c44102516d4341a4a15fb592179ec0', 'request_id': 'req-2bf3f4b9-2d92-4322-bbac-9f6df78d5475'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:39:57.246990 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-2bf3f4b9-2d92-4322-bbac-9f6df78d5475 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46c44102516d4341a4a15fb592179ec0', 'request_id': 'req-2bf3f4b9-2d92-4322-bbac-9f6df78d5475'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:39:57.262069 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-2bf3f4b9-2d92-4322-bbac-9f6df78d5475 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46c44102516d4341a4a15fb592179ec0', 'request_id': 'req-2bf3f4b9-2d92-4322-bbac-9f6df78d5475'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:39:57.297529 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-2bf3f4b9-2d92-4322-bbac-9f6df78d5475 admin admin] The token cache is being invalidate because project 46c44102516d4341a4a15fb592179ec0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81501) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:39:57.297768 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-2bf3f4b9-2d92-4322-bbac-9f6df78d5475 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:39:57.298650 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-2bf3f4b9-2d92-4322-bbac-9f6df78d5475 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:39:57.304244 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1267/2530] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 11:39:56 2022] DELETE /identity/v3/projects/46c44102516d4341a4a15fb592179ec0 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:39:57.306051 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e5686d-8e3f-4aaf-9868-43f668b250da None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:57.306576 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e5686d-8e3f-4aaf-9868-43f668b250da None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:57.306781 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e5686d-8e3f-4aaf-9868-43f668b250da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:57.333741 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-62e5686d-8e3f-4aaf-9868-43f668b250da None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:39:57.335374 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-62e5686d-8e3f-4aaf-9868-43f668b250da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:39:57.474712 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1264/2531] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:39:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:39:57.476574 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1ec89f-48e3-43e9-a15b-c85a90b7ceb4 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:57.476859 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1ec89f-48e3-43e9-a15b-c85a90b7ceb4 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:57.477124 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1ec89f-48e3-43e9-a15b-c85a90b7ceb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:57.509527 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-db1ec89f-48e3-43e9-a15b-c85a90b7ceb4 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:39:57.511133 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-db1ec89f-48e3-43e9-a15b-c85a90b7ceb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:39:57.531177 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e5686d-8e3f-4aaf-9868-43f668b250da None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:39:57.538193 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1268/2532] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:39:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:39:57.568014 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e5686d-8e3f-4aaf-9868-43f668b250da None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:39:57.580784 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aede75-cb90-4a96-bd4a-bf532891311d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:39:57.581604 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aede75-cb90-4a96-bd4a-bf532891311d admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:57.581878 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aede75-cb90-4a96-bd4a-bf532891311d admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:57.582150 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aede75-cb90-4a96-bd4a-bf532891311d admin admin] PATH_INFO: `/v3/domains` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:57.582861 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9aede75-cb90-4a96-bd4a-bf532891311d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:39:57.584149 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9aede75-cb90-4a96-bd4a-bf532891311d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:39:57.586311 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9aede75-cb90-4a96-bd4a-bf532891311d admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:39:57.600463 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1265/2533] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 24 11:39:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:39:57.605106 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1ec89f-48e3-43e9-a15b-c85a90b7ceb4 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:39:57.616690 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1ec89f-48e3-43e9-a15b-c85a90b7ceb4 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:39:57.624114 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b56ba6-d5ef-4cb8-b239-32fc15143584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:39:57.624739 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b56ba6-d5ef-4cb8-b239-32fc15143584 admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:57.625012 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b56ba6-d5ef-4cb8-b239-32fc15143584 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:57.625281 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b56ba6-d5ef-4cb8-b239-32fc15143584 admin admin] PATH_INFO: `/v3/projects` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:57.625921 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b56ba6-d5ef-4cb8-b239-32fc15143584 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:39:57.633249 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b56ba6-d5ef-4cb8-b239-32fc15143584 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:39:57.702398 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1269/2534] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 11:39:57 2022] POST /identity/v3/projects => generated 367 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:39:57.706797 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aede75-cb90-4a96-bd4a-bf532891311d admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:39:57.727146 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aede75-cb90-4a96-bd4a-bf532891311d admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:39:57.813704 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:39:57.865629 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a08dd47-5787-4f3b-82fb-1435afc341e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:39:57.866263 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a08dd47-5787-4f3b-82fb-1435afc341e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:57.866560 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a08dd47-5787-4f3b-82fb-1435afc341e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:57.867183 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a08dd47-5787-4f3b-82fb-1435afc341e9 admin admin] PATH_INFO: `/v3/users` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:57.867821 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a08dd47-5787-4f3b-82fb-1435afc341e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:39:57.869769 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a08dd47-5787-4f3b-82fb-1435afc341e9 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:39:57.927240 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b56ba6-d5ef-4cb8-b239-32fc15143584 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:39:57.934407 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1266/2535] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 11:39:57 2022] POST /identity/v3/users => generated 284 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 11:39:57.948162 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b56ba6-d5ef-4cb8-b239-32fc15143584 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:39:57.959710 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fcdd6e-f97e-4dd8-ab11-35c2193f7d04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:39:57.960530 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fcdd6e-f97e-4dd8-ab11-35c2193f7d04 admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:57.960977 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fcdd6e-f97e-4dd8-ab11-35c2193f7d04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:57.961391 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fcdd6e-f97e-4dd8-ab11-35c2193f7d04 admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:57.962212 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fcdd6e-f97e-4dd8-ab11-35c2193f7d04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:39:57.964080 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fcdd6e-f97e-4dd8-ab11-35c2193f7d04 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:39:57.994414 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a08dd47-5787-4f3b-82fb-1435afc341e9 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:39:58.005049 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1270/2536] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:39:57 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 11:39:58.010906 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a08dd47-5787-4f3b-82fb-1435afc341e9 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:39:58.048285 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd16b08f-daa1-42cc-9d0a-100ce1a0bbbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:39:58.049270 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd16b08f-daa1-42cc-9d0a-100ce1a0bbbb admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:58.051552 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd16b08f-daa1-42cc-9d0a-100ce1a0bbbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:58.052112 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd16b08f-daa1-42cc-9d0a-100ce1a0bbbb admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:58.056977 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd16b08f-daa1-42cc-9d0a-100ce1a0bbbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:39:58.067784 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd16b08f-daa1-42cc-9d0a-100ce1a0bbbb admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:39:58.123267 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fcdd6e-f97e-4dd8-ab11-35c2193f7d04 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:39:58.128580 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1267/2537] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:39:57 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:39:58.135198 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fcdd6e-f97e-4dd8-ab11-35c2193f7d04 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:39:58.143513 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8911441b-48f9-450d-942c-c5e0d3453a74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:39:58.144628 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8911441b-48f9-450d-942c-c5e0d3453a74 admin admin] REQUEST_METHOD: `PUT` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:58.145059 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8911441b-48f9-450d-942c-c5e0d3453a74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:58.145512 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8911441b-48f9-450d-942c-c5e0d3453a74 admin admin] PATH_INFO: `/v3/projects/b82f3f61d67b4a4e914d78314632ee32/users/6cf5e8a8022c4aa9bba69b7c25b8dca6/roles/27e3e65e24df4b86b0d3d18d3212101d` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:58.185068 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd16b08f-daa1-42cc-9d0a-100ce1a0bbbb admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:39:58.187917 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-bd16b08f-daa1-42cc-9d0a-100ce1a0bbbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:39:58.211037 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8911441b-48f9-450d-942c-c5e0d3453a74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b82f3f61d67b4a4e914d78314632ee32, user_id=6cf5e8a8022c4aa9bba69b7c25b8dca6, role_id=27e3e65e24df4b86b0d3d18d3212101d)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:39:58.217394 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8911441b-48f9-450d-942c-c5e0d3453a74 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:39:58.268802 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1271/2538] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 11:39:58 2022] PUT /identity/v3/projects/b82f3f61d67b4a4e914d78314632ee32/users/6cf5e8a8022c4aa9bba69b7c25b8dca6/roles/27e3e65e24df4b86b0d3d18d3212101d => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 11:39:58.282743 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5a3672-6738-47d3-979c-48943ad682a2 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:58.284172 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5a3672-6738-47d3-979c-48943ad682a2 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:58.284593 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5a3672-6738-47d3-979c-48943ad682a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:58.363372 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-fe5a3672-6738-47d3-979c-48943ad682a2 None None] MFA Rules not processed for user `6cf5e8a8022c4aa9bba69b7c25b8dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:39:58.365741 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-fe5a3672-6738-47d3-979c-48943ad682a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:39:58.376764 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd16b08f-daa1-42cc-9d0a-100ce1a0bbbb admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:39:58.424751 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:39:58.529806 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039a797b-4157-4a06-be60-04867aff44f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2d061d25d83443c9232218c90792d51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:39:58.530768 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039a797b-4157-4a06-be60-04867aff44f1 service neutron] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:58.531188 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039a797b-4157-4a06-be60-04867aff44f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:58.531630 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039a797b-4157-4a06-be60-04867aff44f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:58.533789 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-039a797b-4157-4a06-be60-04867aff44f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:39:58.545737 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1272/2539] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:39:58 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:39:58.548023 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5a3672-6738-47d3-979c-48943ad682a2 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:39:58.689846 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039a797b-4157-4a06-be60-04867aff44f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:39:58.691711 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039a797b-4157-4a06-be60-04867aff44f1 service neutron] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:39:58.709948 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1268/2540] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:39:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 525 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 11:39:58.808788 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5a3672-6738-47d3-979c-48943ad682a2 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:39:58.830514 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3655d0-3848-4034-a424-02ff65ea6900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:39:58.831160 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3655d0-3848-4034-a424-02ff65ea6900 admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:58.831436 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3655d0-3848-4034-a424-02ff65ea6900 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:58.831706 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3655d0-3848-4034-a424-02ff65ea6900 admin admin] PATH_INFO: `/v3/projects` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:58.832354 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3655d0-3848-4034-a424-02ff65ea6900 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:39:58.834411 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3655d0-3848-4034-a424-02ff65ea6900 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:39:58.914457 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1273/2541] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 11:39:58 2022] POST /identity/v3/projects => generated 367 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:39:58.915645 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039a797b-4157-4a06-be60-04867aff44f1 service neutron] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:39:58.928228 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039a797b-4157-4a06-be60-04867aff44f1 service neutron] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:39:58.952674 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:39:59.034005 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0a758f-4c92-498b-b177-1a8effb73852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:39:59.034766 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0a758f-4c92-498b-b177-1a8effb73852 admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:59.035115 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0a758f-4c92-498b-b177-1a8effb73852 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:59.035454 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0a758f-4c92-498b-b177-1a8effb73852 admin admin] PATH_INFO: `/v3/users` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:59.036226 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0a758f-4c92-498b-b177-1a8effb73852 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:39:59.039077 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0a758f-4c92-498b-b177-1a8effb73852 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:39:59.077684 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1269/2542] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 11:39:58 2022] POST /identity/v3/users => generated 290 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:39:59.080981 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3655d0-3848-4034-a424-02ff65ea6900 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:39:59.116315 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3655d0-3848-4034-a424-02ff65ea6900 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:39:59.122731 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f966b5-a9b0-4f5d-b762-59a516548856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:39:59.124718 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f966b5-a9b0-4f5d-b762-59a516548856 admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:59.127295 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f966b5-a9b0-4f5d-b762-59a516548856 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:59.127745 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f966b5-a9b0-4f5d-b762-59a516548856 admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:59.128711 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f966b5-a9b0-4f5d-b762-59a516548856 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:39:59.134529 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f966b5-a9b0-4f5d-b762-59a516548856 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:39:59.153660 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1274/2543] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:39:59 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:39:59.157919 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0a758f-4c92-498b-b177-1a8effb73852 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:39:59.170724 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0a758f-4c92-498b-b177-1a8effb73852 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:39:59.179021 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6232d0d-deed-4e62-a1d2-ff15be57330a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:39:59.180497 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6232d0d-deed-4e62-a1d2-ff15be57330a admin admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:59.182151 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6232d0d-deed-4e62-a1d2-ff15be57330a admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:59.183373 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6232d0d-deed-4e62-a1d2-ff15be57330a admin admin] PATH_INFO: `/v3/projects/994017cccc254554b12b58dc008877b8/users/4c1b1d084cfc42e888c31f70b3c63488/roles/30bb1e97257f4ca5b90c88545777317b` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:59.230445 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6232d0d-deed-4e62-a1d2-ff15be57330a admin admin] RBAC: Authorizing `identity:create_grant(project_id=994017cccc254554b12b58dc008877b8, user_id=4c1b1d084cfc42e888c31f70b3c63488, role_id=30bb1e97257f4ca5b90c88545777317b)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:39:59.233455 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6232d0d-deed-4e62-a1d2-ff15be57330a admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:39:59.263054 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1270/2544] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 11:39:59 2022] PUT /identity/v3/projects/994017cccc254554b12b58dc008877b8/users/4c1b1d084cfc42e888c31f70b3c63488/roles/30bb1e97257f4ca5b90c88545777317b => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:39:59.264348 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f966b5-a9b0-4f5d-b762-59a516548856 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:39:59.276297 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f966b5-a9b0-4f5d-b762-59a516548856 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:39:59.414072 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88f7f04-388d-4017-a94c-c3b01894a6c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:39:59.414760 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88f7f04-388d-4017-a94c-c3b01894a6c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:59.415045 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88f7f04-388d-4017-a94c-c3b01894a6c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:59.415386 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88f7f04-388d-4017-a94c-c3b01894a6c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:59.416053 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88f7f04-388d-4017-a94c-c3b01894a6c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:39:59.417697 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88f7f04-388d-4017-a94c-c3b01894a6c7 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:39:59.442396 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1275/2545] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:39:59 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:39:59.443407 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6232d0d-deed-4e62-a1d2-ff15be57330a admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:39:59.460872 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6232d0d-deed-4e62-a1d2-ff15be57330a admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:39:59.475665 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5387dc9-fc54-4960-a9ce-986bef6cad74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:39:59.476357 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5387dc9-fc54-4960-a9ce-986bef6cad74 admin admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:59.476636 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5387dc9-fc54-4960-a9ce-986bef6cad74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:59.476910 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5387dc9-fc54-4960-a9ce-986bef6cad74 admin admin] PATH_INFO: `/v3/projects/994017cccc254554b12b58dc008877b8/users/4c1b1d084cfc42e888c31f70b3c63488/roles/30bb1e97257f4ca5b90c88545777317b` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:59.480121 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5387dc9-fc54-4960-a9ce-986bef6cad74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=994017cccc254554b12b58dc008877b8, user_id=4c1b1d084cfc42e888c31f70b3c63488, role_id=30bb1e97257f4ca5b90c88545777317b)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:39:59.482491 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5387dc9-fc54-4960-a9ce-986bef6cad74 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:39:59.505320 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1271/2546] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 11:39:59 2022] PUT /identity/v3/projects/994017cccc254554b12b58dc008877b8/users/4c1b1d084cfc42e888c31f70b3c63488/roles/30bb1e97257f4ca5b90c88545777317b => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:39:59.507828 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ae8990-8fc7-4845-a01e-96ee378b2afa None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:59.508117 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ae8990-8fc7-4845-a01e-96ee378b2afa None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:59.508404 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ae8990-8fc7-4845-a01e-96ee378b2afa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:59.577830 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-c2ae8990-8fc7-4845-a01e-96ee378b2afa None None] MFA Rules not processed for user `4c1b1d084cfc42e888c31f70b3c63488`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:39:59.579118 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-c2ae8990-8fc7-4845-a01e-96ee378b2afa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:39:59.621898 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:39:59.784469 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1276/2547] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:39:59 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:39:59.798801 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5387dc9-fc54-4960-a9ce-986bef6cad74 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:39:59.803682 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-f5387dc9-fc54-4960-a9ce-986bef6cad74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:39:59.954706 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5387dc9-fc54-4960-a9ce-986bef6cad74 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:39:59.963904 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b6ef72-da46-45e6-9360-b2e3e9760ad8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92862b76ba3b4513b5dc5b5c962faac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:39:59.964543 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b6ef72-da46-45e6-9360-b2e3e9760ad8 service cinder] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:59.964821 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b6ef72-da46-45e6-9360-b2e3e9760ad8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:59.965090 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b6ef72-da46-45e6-9360-b2e3e9760ad8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:59.989015 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b6ef72-da46-45e6-9360-b2e3e9760ad8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:39:59.990797 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b6ef72-da46-45e6-9360-b2e3e9760ad8 service cinder] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:00.012560 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1272/2548] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:39:59 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:40:00.091912 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ae8990-8fc7-4845-a01e-96ee378b2afa None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:00.094171 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-c2ae8990-8fc7-4845-a01e-96ee378b2afa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:00.143939 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ae8990-8fc7-4845-a01e-96ee378b2afa None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:00.158161 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601c49cf-ca7d-41a4-b428-a8fb5982896f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92862b76ba3b4513b5dc5b5c962faac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:00.159235 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601c49cf-ca7d-41a4-b428-a8fb5982896f service cinder] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:00.159629 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601c49cf-ca7d-41a4-b428-a8fb5982896f service cinder] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:00.159995 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601c49cf-ca7d-41a4-b428-a8fb5982896f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:00.317664 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601c49cf-ca7d-41a4-b428-a8fb5982896f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:00.323983 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601c49cf-ca7d-41a4-b428-a8fb5982896f service cinder] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:00.350453 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1277/2549] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:40:00 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:40:00.925005 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b6ef72-da46-45e6-9360-b2e3e9760ad8 service cinder] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:00.929052 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-64b6ef72-da46-45e6-9360-b2e3e9760ad8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:01.064464 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601c49cf-ca7d-41a4-b428-a8fb5982896f service cinder] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:01.066111 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-601c49cf-ca7d-41a4-b428-a8fb5982896f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:01.142244 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b6ef72-da46-45e6-9360-b2e3e9760ad8 service cinder] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:01.150797 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77aa1430-1d2b-4d40-b2a3-be49a34a64c0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad45431e70ff48a9b90905a97d473d81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:01.152137 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aa1430-1d2b-4d40-b2a3-be49a34a64c0 service placement] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:01.152615 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aa1430-1d2b-4d40-b2a3-be49a34a64c0 service placement] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:01.153032 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aa1430-1d2b-4d40-b2a3-be49a34a64c0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:01.155125 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-77aa1430-1d2b-4d40-b2a3-be49a34a64c0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:01.179877 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77aa1430-1d2b-4d40-b2a3-be49a34a64c0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:01.184460 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77aa1430-1d2b-4d40-b2a3-be49a34a64c0 service placement] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:01.207850 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1273/2550] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:40:00 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:40:01.287814 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601c49cf-ca7d-41a4-b428-a8fb5982896f service cinder] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:01.295326 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78045146-d6db-496c-907f-5fd757407efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:01.295987 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78045146-d6db-496c-907f-5fd757407efa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:01.296783 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78045146-d6db-496c-907f-5fd757407efa admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:01.297064 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78045146-d6db-496c-907f-5fd757407efa admin admin] PATH_INFO: `/v3/users/d908050afb6e420ba36bfd5f4d59b50a` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:01.298250 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78045146-d6db-496c-907f-5fd757407efa admin admin] RBAC: Authorizing `identity:delete_user(user_id=d908050afb6e420ba36bfd5f4d59b50a)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:01.300769 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78045146-d6db-496c-907f-5fd757407efa admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:01.396036 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-78045146-d6db-496c-907f-5fd757407efa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd908050afb6e420ba36bfd5f4d59b50a'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:01.396987 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-78045146-d6db-496c-907f-5fd757407efa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd908050afb6e420ba36bfd5f4d59b50a'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:01.398115 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-78045146-d6db-496c-907f-5fd757407efa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd908050afb6e420ba36bfd5f4d59b50a'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:01.411417 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-78045146-d6db-496c-907f-5fd757407efa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd908050afb6e420ba36bfd5f4d59b50a'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:01.415763 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:40:01.432330 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-78045146-d6db-496c-907f-5fd757407efa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd908050afb6e420ba36bfd5f4d59b50a'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:01.473727 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1278/2551] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 11:40:01 2022] DELETE /identity/v3/users/d908050afb6e420ba36bfd5f4d59b50a => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:40:01.894930 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77aa1430-1d2b-4d40-b2a3-be49a34a64c0 service placement] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:01.903926 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:40:01.911725 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77aa1430-1d2b-4d40-b2a3-be49a34a64c0 service placement] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:02.075949 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c05340-6e9e-4909-86f4-ea85ccf60829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:02.076692 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c05340-6e9e-4909-86f4-ea85ccf60829 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:02.076893 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c05340-6e9e-4909-86f4-ea85ccf60829 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:02.077168 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c05340-6e9e-4909-86f4-ea85ccf60829 admin admin] PATH_INFO: `/v3/projects/3311e3111ed54eb6917dd0c8872b1089` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:02.079028 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c05340-6e9e-4909-86f4-ea85ccf60829 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3311e3111ed54eb6917dd0c8872b1089)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:02.081545 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c05340-6e9e-4909-86f4-ea85ccf60829 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:02.191636 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-e5c05340-6e9e-4909-86f4-ea85ccf60829 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3311e3111ed54eb6917dd0c8872b1089', 'request_id': 'req-e5c05340-6e9e-4909-86f4-ea85ccf60829'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:02.228714 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-e5c05340-6e9e-4909-86f4-ea85ccf60829 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3311e3111ed54eb6917dd0c8872b1089', 'request_id': 'req-e5c05340-6e9e-4909-86f4-ea85ccf60829'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:02.251301 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-e5c05340-6e9e-4909-86f4-ea85ccf60829 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3311e3111ed54eb6917dd0c8872b1089', 'request_id': 'req-e5c05340-6e9e-4909-86f4-ea85ccf60829'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:02.279236 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-e5c05340-6e9e-4909-86f4-ea85ccf60829 admin admin] The token cache is being invalidate because project 3311e3111ed54eb6917dd0c8872b1089 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:40:02.280071 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-e5c05340-6e9e-4909-86f4-ea85ccf60829 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:02.281822 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-e5c05340-6e9e-4909-86f4-ea85ccf60829 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:02.286238 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1274/2552] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 11:40:01 2022] DELETE /identity/v3/projects/3311e3111ed54eb6917dd0c8872b1089 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:40:02.293789 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e44224-123d-44bb-91b4-057fdc66613e None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:02.294851 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e44224-123d-44bb-91b4-057fdc66613e None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:02.295431 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e44224-123d-44bb-91b4-057fdc66613e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:02.362417 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-04e44224-123d-44bb-91b4-057fdc66613e None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:40:02.370458 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-04e44224-123d-44bb-91b4-057fdc66613e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:02.591725 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1279/2553] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:40:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:40:02.600004 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4421761b-5177-4a18-9fe2-81c77eac7982 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:02.600616 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4421761b-5177-4a18-9fe2-81c77eac7982 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:02.601149 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4421761b-5177-4a18-9fe2-81c77eac7982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:02.642060 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-4421761b-5177-4a18-9fe2-81c77eac7982 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:40:02.643236 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-4421761b-5177-4a18-9fe2-81c77eac7982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:02.666339 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1275/2554] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:40:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:40:02.670741 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e44224-123d-44bb-91b4-057fdc66613e None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:02.689482 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e44224-123d-44bb-91b4-057fdc66613e None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:02.700119 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edb7ac1-ffd4-4717-80a3-4ab30f716d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:02.700953 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edb7ac1-ffd4-4717-80a3-4ab30f716d9a admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:02.701372 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edb7ac1-ffd4-4717-80a3-4ab30f716d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:02.702567 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edb7ac1-ffd4-4717-80a3-4ab30f716d9a admin admin] PATH_INFO: `/v3/domains` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:02.704181 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edb7ac1-ffd4-4717-80a3-4ab30f716d9a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:40:02.704647 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edb7ac1-ffd4-4717-80a3-4ab30f716d9a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:02.709347 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edb7ac1-ffd4-4717-80a3-4ab30f716d9a admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:02.742794 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1280/2555] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 24 11:40:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:40:02.748043 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4421761b-5177-4a18-9fe2-81c77eac7982 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:02.762098 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4421761b-5177-4a18-9fe2-81c77eac7982 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:02.781970 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f450d70-82d5-497e-a736-26bc68e7a82c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:02.782639 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f450d70-82d5-497e-a736-26bc68e7a82c admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:02.782918 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f450d70-82d5-497e-a736-26bc68e7a82c admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:02.783182 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f450d70-82d5-497e-a736-26bc68e7a82c admin admin] PATH_INFO: `/v3/projects` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:02.785009 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f450d70-82d5-497e-a736-26bc68e7a82c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:02.789268 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f450d70-82d5-497e-a736-26bc68e7a82c admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:02.858958 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1276/2556] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 11:40:02 2022] POST /identity/v3/projects => generated 373 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 11:40:02.863018 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edb7ac1-ffd4-4717-80a3-4ab30f716d9a admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:02.876492 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edb7ac1-ffd4-4717-80a3-4ab30f716d9a admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:03.048060 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa248866-a58e-4a63-86b8-f6e611f1b473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:03.048854 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa248866-a58e-4a63-86b8-f6e611f1b473 admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:03.049123 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa248866-a58e-4a63-86b8-f6e611f1b473 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:03.050708 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa248866-a58e-4a63-86b8-f6e611f1b473 admin admin] PATH_INFO: `/v3/users` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:03.051394 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa248866-a58e-4a63-86b8-f6e611f1b473 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:03.053516 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa248866-a58e-4a63-86b8-f6e611f1b473 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:03.103345 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1281/2557] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 11:40:02 2022] POST /identity/v3/users => generated 287 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:40:03.106198 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f450d70-82d5-497e-a736-26bc68e7a82c admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:03.128351 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f450d70-82d5-497e-a736-26bc68e7a82c admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:03.135377 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bc3c37-3b93-41e7-9c50-7abe8f2da6ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:03.136392 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bc3c37-3b93-41e7-9c50-7abe8f2da6ba admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:03.136907 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bc3c37-3b93-41e7-9c50-7abe8f2da6ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:03.137454 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bc3c37-3b93-41e7-9c50-7abe8f2da6ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:03.138549 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bc3c37-3b93-41e7-9c50-7abe8f2da6ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:03.141815 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bc3c37-3b93-41e7-9c50-7abe8f2da6ba admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:03.156718 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1277/2558] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:40:03 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:40:03.160781 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa248866-a58e-4a63-86b8-f6e611f1b473 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:03.177496 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa248866-a58e-4a63-86b8-f6e611f1b473 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:03.189046 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a27c0d-ea92-4def-afc6-f48cb1975c7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:03.190991 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a27c0d-ea92-4def-afc6-f48cb1975c7a admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:03.193917 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a27c0d-ea92-4def-afc6-f48cb1975c7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:03.194255 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a27c0d-ea92-4def-afc6-f48cb1975c7a admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:03.195108 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a27c0d-ea92-4def-afc6-f48cb1975c7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:03.196914 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a27c0d-ea92-4def-afc6-f48cb1975c7a admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:03.237257 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1282/2559] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:40:03 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:40:03.242325 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bc3c37-3b93-41e7-9c50-7abe8f2da6ba admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:03.258023 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bc3c37-3b93-41e7-9c50-7abe8f2da6ba admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:03.265257 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e32458-0835-485c-93e0-68bc8acc87ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:03.266336 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e32458-0835-485c-93e0-68bc8acc87ed admin admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:03.266969 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e32458-0835-485c-93e0-68bc8acc87ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:03.267479 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e32458-0835-485c-93e0-68bc8acc87ed admin admin] PATH_INFO: `/v3/projects/ca2049e3d27f44de904bd935d95178cb/users/4a00f30efa804c22a780276c7ebc616a/roles/27e3e65e24df4b86b0d3d18d3212101d` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:03.317848 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e32458-0835-485c-93e0-68bc8acc87ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca2049e3d27f44de904bd935d95178cb, user_id=4a00f30efa804c22a780276c7ebc616a, role_id=27e3e65e24df4b86b0d3d18d3212101d)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:03.323430 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e32458-0835-485c-93e0-68bc8acc87ed admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:03.370569 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1278/2560] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 11:40:03 2022] PUT /identity/v3/projects/ca2049e3d27f44de904bd935d95178cb/users/4a00f30efa804c22a780276c7ebc616a/roles/27e3e65e24df4b86b0d3d18d3212101d => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:40:03.375552 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2c1e4f-adc6-45b4-916d-397c12546268 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:03.376437 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2c1e4f-adc6-45b4-916d-397c12546268 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:03.376865 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2c1e4f-adc6-45b4-916d-397c12546268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:03.444761 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-7e2c1e4f-adc6-45b4-916d-397c12546268 None None] MFA Rules not processed for user `4a00f30efa804c22a780276c7ebc616a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:40:03.446007 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-7e2c1e4f-adc6-45b4-916d-397c12546268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:03.533640 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:40:03.599797 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1283/2561] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:40:03 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:40:03.608150 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e32458-0835-485c-93e0-68bc8acc87ed admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:03.610520 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-06e32458-0835-485c-93e0-68bc8acc87ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:03.701303 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:40:03.803996 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e32458-0835-485c-93e0-68bc8acc87ed admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:03.814613 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cba2bb-dcdb-4f76-aae1-b6a4a8e2a8f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '282ec32864d046b2bea170f6a3845cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:03.819662 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cba2bb-dcdb-4f76-aae1-b6a4a8e2a8f5 service nova] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:03.821785 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cba2bb-dcdb-4f76-aae1-b6a4a8e2a8f5 service nova] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:03.822280 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cba2bb-dcdb-4f76-aae1-b6a4a8e2a8f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:03.860803 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cba2bb-dcdb-4f76-aae1-b6a4a8e2a8f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:03.862417 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cba2bb-dcdb-4f76-aae1-b6a4a8e2a8f5 service nova] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:03.890301 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1279/2562] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:40:03 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:40:04.252490 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2c1e4f-adc6-45b4-916d-397c12546268 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:04.425889 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2c1e4f-adc6-45b4-916d-397c12546268 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:04.440300 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ef7f84-e015-4a6d-a369-2bf43305867b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:04.441811 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ef7f84-e015-4a6d-a369-2bf43305867b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:04.442628 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ef7f84-e015-4a6d-a369-2bf43305867b admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:04.443428 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ef7f84-e015-4a6d-a369-2bf43305867b admin admin] PATH_INFO: `/v3/users/4a00f30efa804c22a780276c7ebc616a` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:04.447707 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ef7f84-e015-4a6d-a369-2bf43305867b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a00f30efa804c22a780276c7ebc616a)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:04.454871 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ef7f84-e015-4a6d-a369-2bf43305867b admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:04.626268 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-e7ef7f84-e015-4a6d-a369-2bf43305867b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a00f30efa804c22a780276c7ebc616a'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:04.627343 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-e7ef7f84-e015-4a6d-a369-2bf43305867b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a00f30efa804c22a780276c7ebc616a'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:04.628205 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-e7ef7f84-e015-4a6d-a369-2bf43305867b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a00f30efa804c22a780276c7ebc616a'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:04.662680 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-e7ef7f84-e015-4a6d-a369-2bf43305867b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a00f30efa804c22a780276c7ebc616a'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:04.675752 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-e7ef7f84-e015-4a6d-a369-2bf43305867b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a00f30efa804c22a780276c7ebc616a'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:04.707168 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1284/2563] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 11:40:04 2022] DELETE /identity/v3/users/4a00f30efa804c22a780276c7ebc616a => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:40:04.712113 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548d1a57-8fca-44b3-9c0d-0e7fdb4e5496 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:04.712528 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548d1a57-8fca-44b3-9c0d-0e7fdb4e5496 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:04.712635 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548d1a57-8fca-44b3-9c0d-0e7fdb4e5496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:04.737770 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-548d1a57-8fca-44b3-9c0d-0e7fdb4e5496 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:40:04.739719 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-548d1a57-8fca-44b3-9c0d-0e7fdb4e5496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:04.875324 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1280/2564] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:40:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:40:04.889617 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ef7f84-e015-4a6d-a369-2bf43305867b admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:04.891017 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-e7ef7f84-e015-4a6d-a369-2bf43305867b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:04.985335 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:40:04.991237 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ef7f84-e015-4a6d-a369-2bf43305867b admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:05.000448 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1ee522-08b0-4542-986a-2258de9ab6bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2d061d25d83443c9232218c90792d51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:05.001409 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1ee522-08b0-4542-986a-2258de9ab6bf service neutron] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:05.001950 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1ee522-08b0-4542-986a-2258de9ab6bf service neutron] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:05.002584 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1ee522-08b0-4542-986a-2258de9ab6bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:05.038788 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1ee522-08b0-4542-986a-2258de9ab6bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:05.040541 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1ee522-08b0-4542-986a-2258de9ab6bf service neutron] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:05.091684 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1285/2565] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:40:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:40:05.411956 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548d1a57-8fca-44b3-9c0d-0e7fdb4e5496 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:05.413402 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-548d1a57-8fca-44b3-9c0d-0e7fdb4e5496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:05.428467 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548d1a57-8fca-44b3-9c0d-0e7fdb4e5496 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:05.433154 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226271bb-ea0a-433e-85ff-4aae17d38879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:05.433795 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226271bb-ea0a-433e-85ff-4aae17d38879 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:05.434440 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226271bb-ea0a-433e-85ff-4aae17d38879 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:05.434859 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226271bb-ea0a-433e-85ff-4aae17d38879 admin admin] PATH_INFO: `/v3/users/6cf5e8a8022c4aa9bba69b7c25b8dca6` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:05.436383 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226271bb-ea0a-433e-85ff-4aae17d38879 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6cf5e8a8022c4aa9bba69b7c25b8dca6)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:05.438727 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226271bb-ea0a-433e-85ff-4aae17d38879 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:05.536714 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-226271bb-ea0a-433e-85ff-4aae17d38879 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6cf5e8a8022c4aa9bba69b7c25b8dca6'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:05.537565 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-226271bb-ea0a-433e-85ff-4aae17d38879 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6cf5e8a8022c4aa9bba69b7c25b8dca6'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:05.551895 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-226271bb-ea0a-433e-85ff-4aae17d38879 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6cf5e8a8022c4aa9bba69b7c25b8dca6'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:05.565060 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-226271bb-ea0a-433e-85ff-4aae17d38879 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6cf5e8a8022c4aa9bba69b7c25b8dca6'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:05.566078 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-226271bb-ea0a-433e-85ff-4aae17d38879 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6cf5e8a8022c4aa9bba69b7c25b8dca6'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:05.595516 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1281/2566] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 11:40:05 2022] DELETE /identity/v3/users/6cf5e8a8022c4aa9bba69b7c25b8dca6 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:40:05.600368 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390bb65c-d776-4304-a5e1-935733af578e None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:05.600853 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390bb65c-d776-4304-a5e1-935733af578e None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:05.601154 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390bb65c-d776-4304-a5e1-935733af578e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:05.634703 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-390bb65c-d776-4304-a5e1-935733af578e None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:40:05.636047 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-390bb65c-d776-4304-a5e1-935733af578e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:05.710665 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226271bb-ea0a-433e-85ff-4aae17d38879 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:05.712153 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-226271bb-ea0a-433e-85ff-4aae17d38879 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:05.718467 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1286/2567] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:40:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 11:40:05.744100 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390bb65c-d776-4304-a5e1-935733af578e None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:05.746263 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226271bb-ea0a-433e-85ff-4aae17d38879 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:05.748117 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-390bb65c-d776-4304-a5e1-935733af578e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:05.762745 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a011fb-e227-4de0-a29f-bfa9a0a95e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:05.765207 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a011fb-e227-4de0-a29f-bfa9a0a95e5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:05.765533 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a011fb-e227-4de0-a29f-bfa9a0a95e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:05.767023 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a011fb-e227-4de0-a29f-bfa9a0a95e5a admin admin] PATH_INFO: `/v3/projects/ca2049e3d27f44de904bd935d95178cb` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:05.769623 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a011fb-e227-4de0-a29f-bfa9a0a95e5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca2049e3d27f44de904bd935d95178cb)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:05.775140 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a011fb-e227-4de0-a29f-bfa9a0a95e5a admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:05.816353 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:40:05.859121 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-f9a011fb-e227-4de0-a29f-bfa9a0a95e5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca2049e3d27f44de904bd935d95178cb', 'request_id': 'req-f9a011fb-e227-4de0-a29f-bfa9a0a95e5a'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:05.862070 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390bb65c-d776-4304-a5e1-935733af578e None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:05.868181 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-f9a011fb-e227-4de0-a29f-bfa9a0a95e5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca2049e3d27f44de904bd935d95178cb', 'request_id': 'req-f9a011fb-e227-4de0-a29f-bfa9a0a95e5a'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:05.887833 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-f9a011fb-e227-4de0-a29f-bfa9a0a95e5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca2049e3d27f44de904bd935d95178cb', 'request_id': 'req-f9a011fb-e227-4de0-a29f-bfa9a0a95e5a'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:05.908995 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-f9a011fb-e227-4de0-a29f-bfa9a0a95e5a admin admin] The token cache is being invalidate because project ca2049e3d27f44de904bd935d95178cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:40:05.909262 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-f9a011fb-e227-4de0-a29f-bfa9a0a95e5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:05.914793 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-f9a011fb-e227-4de0-a29f-bfa9a0a95e5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:05.916579 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1282/2568] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 11:40:05 2022] DELETE /identity/v3/projects/ca2049e3d27f44de904bd935d95178cb => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:40:05.921751 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756fb344-d7cf-4530-99ff-4c1dbbd394ed None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:05.921751 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756fb344-d7cf-4530-99ff-4c1dbbd394ed None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:05.922059 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756fb344-d7cf-4530-99ff-4c1dbbd394ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:05.950097 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-756fb344-d7cf-4530-99ff-4c1dbbd394ed None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:40:05.951334 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-756fb344-d7cf-4530-99ff-4c1dbbd394ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:05.969193 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8172855-758f-4c26-9470-a4aa5ecf07aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2d061d25d83443c9232218c90792d51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:05.969948 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8172855-758f-4c26-9470-a4aa5ecf07aa service neutron] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:05.971215 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8172855-758f-4c26-9470-a4aa5ecf07aa service neutron] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:05.971519 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8172855-758f-4c26-9470-a4aa5ecf07aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:05.973814 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-e8172855-758f-4c26-9470-a4aa5ecf07aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:06.040886 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1283/2569] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:40:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:40:06.050047 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72de60af-d191-47b9-aec3-8eb00381c1b0 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:06.051239 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72de60af-d191-47b9-aec3-8eb00381c1b0 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:06.051750 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72de60af-d191-47b9-aec3-8eb00381c1b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:06.073894 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8172855-758f-4c26-9470-a4aa5ecf07aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:06.075180 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-72de60af-d191-47b9-aec3-8eb00381c1b0 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:40:06.076036 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8172855-758f-4c26-9470-a4aa5ecf07aa service neutron] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:06.076553 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-72de60af-d191-47b9-aec3-8eb00381c1b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:06.081453 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:40:06.087185 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1284/2570] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:40:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:40:06.092401 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72de60af-d191-47b9-aec3-8eb00381c1b0 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:06.102445 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1287/2571] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:40:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:40:06.108028 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72de60af-d191-47b9-aec3-8eb00381c1b0 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:06.122443 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a108e795-a5ad-401f-9c6a-2193dadcb1eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:06.123082 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a108e795-a5ad-401f-9c6a-2193dadcb1eb admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:06.123403 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a108e795-a5ad-401f-9c6a-2193dadcb1eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:06.123673 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a108e795-a5ad-401f-9c6a-2193dadcb1eb admin admin] PATH_INFO: `/v3/domains` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:06.124379 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a108e795-a5ad-401f-9c6a-2193dadcb1eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:40:06.124685 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a108e795-a5ad-401f-9c6a-2193dadcb1eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:06.126529 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a108e795-a5ad-401f-9c6a-2193dadcb1eb admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:06.144052 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1285/2572] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 24 11:40:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:40:06.148707 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8172855-758f-4c26-9470-a4aa5ecf07aa service neutron] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:06.164341 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8172855-758f-4c26-9470-a4aa5ecf07aa service neutron] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:06.173028 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207c44ad-7ef2-4c89-beb7-e9de8873b71e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:06.178720 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207c44ad-7ef2-4c89-beb7-e9de8873b71e admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:06.179446 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207c44ad-7ef2-4c89-beb7-e9de8873b71e admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:06.179936 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207c44ad-7ef2-4c89-beb7-e9de8873b71e admin admin] PATH_INFO: `/v3/projects` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:06.180782 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207c44ad-7ef2-4c89-beb7-e9de8873b71e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:06.183330 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207c44ad-7ef2-4c89-beb7-e9de8873b71e admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:06.228497 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1288/2573] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 11:40:06 2022] POST /identity/v3/projects => generated 405 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:40:06.233140 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a108e795-a5ad-401f-9c6a-2193dadcb1eb admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:06.247701 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a108e795-a5ad-401f-9c6a-2193dadcb1eb admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:06.407222 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d09a259-82cd-48a0-9a0f-86def0b66937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:06.407846 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d09a259-82cd-48a0-9a0f-86def0b66937 admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:06.408122 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d09a259-82cd-48a0-9a0f-86def0b66937 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:06.408392 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d09a259-82cd-48a0-9a0f-86def0b66937 admin admin] PATH_INFO: `/v3/users` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:06.409033 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d09a259-82cd-48a0-9a0f-86def0b66937 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:06.411205 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d09a259-82cd-48a0-9a0f-86def0b66937 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:06.455260 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1286/2574] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 11:40:06 2022] POST /identity/v3/users => generated 303 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:40:06.456250 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207c44ad-7ef2-4c89-beb7-e9de8873b71e admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:06.469924 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207c44ad-7ef2-4c89-beb7-e9de8873b71e admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:06.489273 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73c823e-34d7-417c-9927-c149ac3eab02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:06.490202 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73c823e-34d7-417c-9927-c149ac3eab02 admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:06.490754 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73c823e-34d7-417c-9927-c149ac3eab02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:06.491218 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73c823e-34d7-417c-9927-c149ac3eab02 admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:06.492461 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73c823e-34d7-417c-9927-c149ac3eab02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:06.494698 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73c823e-34d7-417c-9927-c149ac3eab02 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:06.510694 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1289/2575] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:40:06 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:40:06.514514 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d09a259-82cd-48a0-9a0f-86def0b66937 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:06.528509 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d09a259-82cd-48a0-9a0f-86def0b66937 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:06.540819 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7952efa-3249-47ba-a5cf-677fd6599d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:06.541455 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7952efa-3249-47ba-a5cf-677fd6599d41 admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:06.541733 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7952efa-3249-47ba-a5cf-677fd6599d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:06.542005 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7952efa-3249-47ba-a5cf-677fd6599d41 admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:06.544769 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7952efa-3249-47ba-a5cf-677fd6599d41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:06.546467 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7952efa-3249-47ba-a5cf-677fd6599d41 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:06.578926 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1287/2576] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:40:06 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:40:06.583134 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73c823e-34d7-417c-9927-c149ac3eab02 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:06.610462 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73c823e-34d7-417c-9927-c149ac3eab02 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:06.624887 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8a71e1-061d-4a53-bac0-404011f0b47a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:06.625883 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8a71e1-061d-4a53-bac0-404011f0b47a admin admin] REQUEST_METHOD: `PUT` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:06.626826 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8a71e1-061d-4a53-bac0-404011f0b47a admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:06.629220 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8a71e1-061d-4a53-bac0-404011f0b47a admin admin] PATH_INFO: `/v3/projects/6d0c96314adb4248ac8c9e0a1dc30b3e/users/8609868918bf4ab5a4495e1dfce345a4/roles/27e3e65e24df4b86b0d3d18d3212101d` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:06.669487 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8a71e1-061d-4a53-bac0-404011f0b47a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d0c96314adb4248ac8c9e0a1dc30b3e, user_id=8609868918bf4ab5a4495e1dfce345a4, role_id=27e3e65e24df4b86b0d3d18d3212101d)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:06.679302 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8a71e1-061d-4a53-bac0-404011f0b47a admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:06.707681 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1290/2577] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 11:40:06 2022] PUT /identity/v3/projects/6d0c96314adb4248ac8c9e0a1dc30b3e/users/8609868918bf4ab5a4495e1dfce345a4/roles/27e3e65e24df4b86b0d3d18d3212101d => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:40:06.719288 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b1872c-c1e1-492e-9eab-cbcb6e89d973 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:06.719890 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b1872c-c1e1-492e-9eab-cbcb6e89d973 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:06.719890 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b1872c-c1e1-492e-9eab-cbcb6e89d973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:06.746687 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:40:06.767177 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-53b1872c-c1e1-492e-9eab-cbcb6e89d973 None None] MFA Rules not processed for user `8609868918bf4ab5a4495e1dfce345a4`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:40:06.768616 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-53b1872c-c1e1-492e-9eab-cbcb6e89d973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:06.918943 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1288/2578] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:40:06 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:40:06.923431 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8a71e1-061d-4a53-bac0-404011f0b47a admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:06.968364 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b1872c-c1e1-492e-9eab-cbcb6e89d973 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:06.969872 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-53b1872c-c1e1-492e-9eab-cbcb6e89d973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:07.065327 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8a71e1-061d-4a53-bac0-404011f0b47a admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:07.072226 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656669ab-5cd6-4abc-a580-578a63737bd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:07.073526 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656669ab-5cd6-4abc-a580-578a63737bd2 admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:07.074022 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656669ab-5cd6-4abc-a580-578a63737bd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:07.076448 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656669ab-5cd6-4abc-a580-578a63737bd2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:07.078291 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656669ab-5cd6-4abc-a580-578a63737bd2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:07.080859 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656669ab-5cd6-4abc-a580-578a63737bd2 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:07.081044 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b1872c-c1e1-492e-9eab-cbcb6e89d973 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:07.086178 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a998988-5090-4759-be5e-768e9290a72f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:07.086886 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a998988-5090-4759-be5e-768e9290a72f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:07.087160 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a998988-5090-4759-be5e-768e9290a72f admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:07.087430 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a998988-5090-4759-be5e-768e9290a72f admin admin] PATH_INFO: `/v3/projects/b82f3f61d67b4a4e914d78314632ee32` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:07.089365 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a998988-5090-4759-be5e-768e9290a72f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b82f3f61d67b4a4e914d78314632ee32)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:07.090824 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a998988-5090-4759-be5e-768e9290a72f admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:07.149628 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1291/2579] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 11:40:06 2022] POST /identity/v3/projects => generated 403 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:40:07.163633 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656669ab-5cd6-4abc-a580-578a63737bd2 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:07.173110 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-4a998988-5090-4759-be5e-768e9290a72f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b82f3f61d67b4a4e914d78314632ee32', 'request_id': 'req-4a998988-5090-4759-be5e-768e9290a72f'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:07.180659 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-4a998988-5090-4759-be5e-768e9290a72f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b82f3f61d67b4a4e914d78314632ee32', 'request_id': 'req-4a998988-5090-4759-be5e-768e9290a72f'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:07.186927 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-4a998988-5090-4759-be5e-768e9290a72f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b82f3f61d67b4a4e914d78314632ee32', 'request_id': 'req-4a998988-5090-4759-be5e-768e9290a72f'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:07.202804 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-4a998988-5090-4759-be5e-768e9290a72f admin admin] The token cache is being invalidate because project b82f3f61d67b4a4e914d78314632ee32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:40:07.203150 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-4a998988-5090-4759-be5e-768e9290a72f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:07.203864 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-4a998988-5090-4759-be5e-768e9290a72f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:07.208772 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1289/2580] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 11:40:06 2022] DELETE /identity/v3/projects/b82f3f61d67b4a4e914d78314632ee32 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 11:40:07.212960 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a998988-5090-4759-be5e-768e9290a72f admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:07.220927 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-4a998988-5090-4759-be5e-768e9290a72f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:07.282970 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656669ab-5cd6-4abc-a580-578a63737bd2 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:07.286990 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:40:07.328107 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:40:07.367999 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8a9a00-f587-4a25-908a-8c737a5b5433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:07.369233 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8a9a00-f587-4a25-908a-8c737a5b5433 admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:07.369805 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8a9a00-f587-4a25-908a-8c737a5b5433 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:07.370283 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8a9a00-f587-4a25-908a-8c737a5b5433 admin admin] PATH_INFO: `/v3/users` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:07.371629 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8a9a00-f587-4a25-908a-8c737a5b5433 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:07.374118 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8a9a00-f587-4a25-908a-8c737a5b5433 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:07.411920 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a998988-5090-4759-be5e-768e9290a72f admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:07.418671 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1292/2581] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 11:40:07 2022] POST /identity/v3/users => generated 308 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:40:07.422441 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8a9a00-f587-4a25-908a-8c737a5b5433 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:07.425533 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ac2462-eece-4be2-b463-47517e2d4045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:07.426193 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ac2462-eece-4be2-b463-47517e2d4045 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:07.426527 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ac2462-eece-4be2-b463-47517e2d4045 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:07.426796 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ac2462-eece-4be2-b463-47517e2d4045 admin admin] PATH_INFO: `/v3/users/4c1b1d084cfc42e888c31f70b3c63488` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:07.427845 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-fc8a9a00-f587-4a25-908a-8c737a5b5433 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:07.430689 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ac2462-eece-4be2-b463-47517e2d4045 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c1b1d084cfc42e888c31f70b3c63488)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:07.432632 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ac2462-eece-4be2-b463-47517e2d4045 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:07.457063 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8a9a00-f587-4a25-908a-8c737a5b5433 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:07.473096 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dd98ca-3e37-4a24-ba62-4137acf8b4bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:07.473874 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dd98ca-3e37-4a24-ba62-4137acf8b4bb admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:07.474232 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dd98ca-3e37-4a24-ba62-4137acf8b4bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:07.474598 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dd98ca-3e37-4a24-ba62-4137acf8b4bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:07.475330 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dd98ca-3e37-4a24-ba62-4137acf8b4bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:07.477480 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dd98ca-3e37-4a24-ba62-4137acf8b4bb admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:07.501460 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1293/2582] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:40:07 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 11:40:07.505525 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dd98ca-3e37-4a24-ba62-4137acf8b4bb admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:07.517903 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-52ac2462-eece-4be2-b463-47517e2d4045 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c1b1d084cfc42e888c31f70b3c63488'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:07.518788 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-52ac2462-eece-4be2-b463-47517e2d4045 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c1b1d084cfc42e888c31f70b3c63488'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:07.522188 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dd98ca-3e37-4a24-ba62-4137acf8b4bb admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:07.533898 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26ca1f8-a07f-470b-8735-05dff61b7d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:07.536560 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26ca1f8-a07f-470b-8735-05dff61b7d9b admin admin] REQUEST_METHOD: `PUT` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:07.537027 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-52ac2462-eece-4be2-b463-47517e2d4045 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c1b1d084cfc42e888c31f70b3c63488'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:07.537521 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26ca1f8-a07f-470b-8735-05dff61b7d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:07.537808 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26ca1f8-a07f-470b-8735-05dff61b7d9b admin admin] PATH_INFO: `/v3/projects/3d22a72dbb3342a9995978ec639b706d/users/28a89a9ec6c4478b988188c0ecb2f195/roles/30bb1e97257f4ca5b90c88545777317b` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:07.564137 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26ca1f8-a07f-470b-8735-05dff61b7d9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d22a72dbb3342a9995978ec639b706d, user_id=28a89a9ec6c4478b988188c0ecb2f195, role_id=30bb1e97257f4ca5b90c88545777317b)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:07.567003 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-52ac2462-eece-4be2-b463-47517e2d4045 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c1b1d084cfc42e888c31f70b3c63488'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:07.567920 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-52ac2462-eece-4be2-b463-47517e2d4045 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c1b1d084cfc42e888c31f70b3c63488'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:07.568065 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26ca1f8-a07f-470b-8735-05dff61b7d9b admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:07.590781 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1294/2583] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 11:40:07 2022] PUT /identity/v3/projects/3d22a72dbb3342a9995978ec639b706d/users/28a89a9ec6c4478b988188c0ecb2f195/roles/30bb1e97257f4ca5b90c88545777317b => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:40:07.592568 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26ca1f8-a07f-470b-8735-05dff61b7d9b admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:07.595650 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-e26ca1f8-a07f-470b-8735-05dff61b7d9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:07.607589 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1290/2584] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 11:40:07 2022] DELETE /identity/v3/users/4c1b1d084cfc42e888c31f70b3c63488 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:40:07.772022 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26ca1f8-a07f-470b-8735-05dff61b7d9b admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:07.911644 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d7eeb0-1b91-4100-9769-6a188e901a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:07.912698 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d7eeb0-1b91-4100-9769-6a188e901a54 admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:07.912985 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d7eeb0-1b91-4100-9769-6a188e901a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:07.913257 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d7eeb0-1b91-4100-9769-6a188e901a54 admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:07.913929 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d7eeb0-1b91-4100-9769-6a188e901a54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:07.915601 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d7eeb0-1b91-4100-9769-6a188e901a54 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:07.945892 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1295/2585] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:40:07 2022] GET /identity/v3/roles => generated 1420 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:40:07.948840 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ac2462-eece-4be2-b463-47517e2d4045 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:07.949625 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d7eeb0-1b91-4100-9769-6a188e901a54 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:07.951878 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-91d7eeb0-1b91-4100-9769-6a188e901a54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:07.977182 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ac2462-eece-4be2-b463-47517e2d4045 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:07.993353 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76bda0d-58be-4b7c-b8b5-35fc7ee7a468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:07.994334 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76bda0d-58be-4b7c-b8b5-35fc7ee7a468 admin admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:07.994871 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76bda0d-58be-4b7c-b8b5-35fc7ee7a468 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:07.995333 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76bda0d-58be-4b7c-b8b5-35fc7ee7a468 admin admin] PATH_INFO: `/v3/projects/3d22a72dbb3342a9995978ec639b706d/users/28a89a9ec6c4478b988188c0ecb2f195/roles/30bb1e97257f4ca5b90c88545777317b` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:07.999197 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76bda0d-58be-4b7c-b8b5-35fc7ee7a468 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d22a72dbb3342a9995978ec639b706d, user_id=28a89a9ec6c4478b988188c0ecb2f195, role_id=30bb1e97257f4ca5b90c88545777317b)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:08.004327 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76bda0d-58be-4b7c-b8b5-35fc7ee7a468 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:08.033485 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1291/2586] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 11:40:07 2022] PUT /identity/v3/projects/3d22a72dbb3342a9995978ec639b706d/users/28a89a9ec6c4478b988188c0ecb2f195/roles/30bb1e97257f4ca5b90c88545777317b => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:40:08.033799 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:40:08.039004 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e8e36b-4c92-4a03-bfd8-af78467f239f None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:08.039304 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e8e36b-4c92-4a03-bfd8-af78467f239f None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:08.039585 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e8e36b-4c92-4a03-bfd8-af78467f239f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:08.074027 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d7eeb0-1b91-4100-9769-6a188e901a54 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:08.076522 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-76e8e36b-4c92-4a03-bfd8-af78467f239f None None] MFA Rules not processed for user `28a89a9ec6c4478b988188c0ecb2f195`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:40:08.077959 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-76e8e36b-4c92-4a03-bfd8-af78467f239f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:08.183352 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98e29f9-d96c-4428-8ea5-e647a20d725e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2d061d25d83443c9232218c90792d51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:08.184618 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98e29f9-d96c-4428-8ea5-e647a20d725e service neutron] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:08.185101 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98e29f9-d96c-4428-8ea5-e647a20d725e service neutron] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:08.186205 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98e29f9-d96c-4428-8ea5-e647a20d725e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:08.188895 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-a98e29f9-d96c-4428-8ea5-e647a20d725e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:08.243370 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1292/2587] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:40:08 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:40:08.265039 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e8e36b-4c92-4a03-bfd8-af78467f239f None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:08.270700 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-76e8e36b-4c92-4a03-bfd8-af78467f239f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:08.340108 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98e29f9-d96c-4428-8ea5-e647a20d725e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:08.345204 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98e29f9-d96c-4428-8ea5-e647a20d725e service neutron] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:08.353876 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:40:08.363345 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1296/2588] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:40:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:40:08.372413 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98e29f9-d96c-4428-8ea5-e647a20d725e service neutron] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:08.379297 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-a98e29f9-d96c-4428-8ea5-e647a20d725e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:08.417204 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e8e36b-4c92-4a03-bfd8-af78467f239f None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:08.419191 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98e29f9-d96c-4428-8ea5-e647a20d725e service neutron] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:08.421942 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1055f344-322d-46a3-b655-436c39414890 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92862b76ba3b4513b5dc5b5c962faac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:08.422610 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1055f344-322d-46a3-b655-436c39414890 service cinder] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:08.423118 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1055f344-322d-46a3-b655-436c39414890 service cinder] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:08.423236 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1055f344-322d-46a3-b655-436c39414890 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:08.428958 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909944be-1177-47c6-9179-5282df0cd1aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:08.433043 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909944be-1177-47c6-9179-5282df0cd1aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:08.433426 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909944be-1177-47c6-9179-5282df0cd1aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:08.433657 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909944be-1177-47c6-9179-5282df0cd1aa admin admin] PATH_INFO: `/v3/projects/994017cccc254554b12b58dc008877b8` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:08.436757 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1055f344-322d-46a3-b655-436c39414890 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:08.438131 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909944be-1177-47c6-9179-5282df0cd1aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=994017cccc254554b12b58dc008877b8)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:08.438257 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1055f344-322d-46a3-b655-436c39414890 service cinder] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:08.440201 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909944be-1177-47c6-9179-5282df0cd1aa admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:08.450436 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1293/2589] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:40:08 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:40:08.451740 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c52f1fc-7a32-4d96-ab3a-2885866c65d7 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:08.452018 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c52f1fc-7a32-4d96-ab3a-2885866c65d7 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:08.452282 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c52f1fc-7a32-4d96-ab3a-2885866c65d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:08.480598 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-7c52f1fc-7a32-4d96-ab3a-2885866c65d7 None None] MFA Rules not processed for user `763facd221624f6dae3192c42b4fcf41`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:40:08.482015 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-7c52f1fc-7a32-4d96-ab3a-2885866c65d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:08.550932 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-909944be-1177-47c6-9179-5282df0cd1aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '994017cccc254554b12b58dc008877b8', 'request_id': 'req-909944be-1177-47c6-9179-5282df0cd1aa'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:08.569873 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-909944be-1177-47c6-9179-5282df0cd1aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '994017cccc254554b12b58dc008877b8', 'request_id': 'req-909944be-1177-47c6-9179-5282df0cd1aa'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:08.585557 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-909944be-1177-47c6-9179-5282df0cd1aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '994017cccc254554b12b58dc008877b8', 'request_id': 'req-909944be-1177-47c6-9179-5282df0cd1aa'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:08.627461 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-909944be-1177-47c6-9179-5282df0cd1aa admin admin] The token cache is being invalidate because project 994017cccc254554b12b58dc008877b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81501) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:40:08.627767 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-909944be-1177-47c6-9179-5282df0cd1aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:08.631318 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-909944be-1177-47c6-9179-5282df0cd1aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:08.634276 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1297/2590] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 11:40:08 2022] DELETE /identity/v3/projects/994017cccc254554b12b58dc008877b8 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:40:08.635184 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1294/2591] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:40:08 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:40:08.644196 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcef65b-830c-4cda-a66f-7bfde306704e None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:08.644569 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcef65b-830c-4cda-a66f-7bfde306704e None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:08.644984 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcef65b-830c-4cda-a66f-7bfde306704e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:08.670724 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c52f1fc-7a32-4d96-ab3a-2885866c65d7 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:08.699738 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-5dcef65b-830c-4cda-a66f-7bfde306704e None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:40:08.702154 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-5dcef65b-830c-4cda-a66f-7bfde306704e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:08.702275 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c52f1fc-7a32-4d96-ab3a-2885866c65d7 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:08.734856 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:40:08.810408 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1298/2592] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:40:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:40:08.813913 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586a84d1-11bb-40d4-bb03-10827c7cf547 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:08.814207 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586a84d1-11bb-40d4-bb03-10827c7cf547 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:08.814914 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586a84d1-11bb-40d4-bb03-10827c7cf547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:08.819311 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50f572f-6430-4eed-a81b-601068c87da1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:08.819745 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50f572f-6430-4eed-a81b-601068c87da1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:08.820008 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50f572f-6430-4eed-a81b-601068c87da1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:08.820276 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50f572f-6430-4eed-a81b-601068c87da1 admin admin] PATH_INFO: `/v3/users/8609868918bf4ab5a4495e1dfce345a4` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:08.821513 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50f572f-6430-4eed-a81b-601068c87da1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8609868918bf4ab5a4495e1dfce345a4)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:08.823487 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50f572f-6430-4eed-a81b-601068c87da1 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:08.857171 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-586a84d1-11bb-40d4-bb03-10827c7cf547 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:40:08.859234 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-586a84d1-11bb-40d4-bb03-10827c7cf547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:08.874402 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1299/2593] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:40:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:40:08.877595 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586a84d1-11bb-40d4-bb03-10827c7cf547 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:08.888928 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586a84d1-11bb-40d4-bb03-10827c7cf547 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:08.891080 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-c50f572f-6430-4eed-a81b-601068c87da1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8609868918bf4ab5a4495e1dfce345a4'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:08.892062 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-c50f572f-6430-4eed-a81b-601068c87da1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8609868918bf4ab5a4495e1dfce345a4'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:08.895783 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38253f90-4b41-443c-8c01-a53a1603090b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:08.896362 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38253f90-4b41-443c-8c01-a53a1603090b admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:08.898014 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38253f90-4b41-443c-8c01-a53a1603090b admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:08.901736 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38253f90-4b41-443c-8c01-a53a1603090b admin admin] PATH_INFO: `/v3/domains` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:08.901736 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38253f90-4b41-443c-8c01-a53a1603090b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:40:08.901736 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38253f90-4b41-443c-8c01-a53a1603090b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:08.902711 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38253f90-4b41-443c-8c01-a53a1603090b admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:08.909552 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-c50f572f-6430-4eed-a81b-601068c87da1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8609868918bf4ab5a4495e1dfce345a4'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:08.922760 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1300/2594] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 24 11:40:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:40:08.924908 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-c50f572f-6430-4eed-a81b-601068c87da1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8609868918bf4ab5a4495e1dfce345a4'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:08.926637 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-c50f572f-6430-4eed-a81b-601068c87da1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8609868918bf4ab5a4495e1dfce345a4'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:08.927239 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38253f90-4b41-443c-8c01-a53a1603090b admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:08.929948 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-38253f90-4b41-443c-8c01-a53a1603090b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:08.941775 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:40:08.957984 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38253f90-4b41-443c-8c01-a53a1603090b admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:08.963930 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62c50c9-17ce-4a47-b2de-9b0128cc8731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:08.965147 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62c50c9-17ce-4a47-b2de-9b0128cc8731 admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:08.965350 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62c50c9-17ce-4a47-b2de-9b0128cc8731 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:08.965593 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62c50c9-17ce-4a47-b2de-9b0128cc8731 admin admin] PATH_INFO: `/v3/projects` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:08.966311 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62c50c9-17ce-4a47-b2de-9b0128cc8731 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:08.968787 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62c50c9-17ce-4a47-b2de-9b0128cc8731 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:08.969736 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1295/2595] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 11:40:08 2022] DELETE /identity/v3/users/8609868918bf4ab5a4495e1dfce345a4 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:40:08.981621 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1f9692-a3c5-427a-9326-351fec74b2d9 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:08.981910 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1f9692-a3c5-427a-9326-351fec74b2d9 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:08.982562 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1f9692-a3c5-427a-9326-351fec74b2d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:09.006589 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-df1f9692-a3c5-427a-9326-351fec74b2d9 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:40:09.008225 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-df1f9692-a3c5-427a-9326-351fec74b2d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:09.014546 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1301/2596] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 11:40:08 2022] POST /identity/v3/projects => generated 379 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:40:09.019040 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62c50c9-17ce-4a47-b2de-9b0128cc8731 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:09.152917 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1296/2597] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:40:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 11:40:09.160212 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62c50c9-17ce-4a47-b2de-9b0128cc8731 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:09.166396 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524309c4-18e4-44d1-9ea5-b4ea364496e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:09.167276 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524309c4-18e4-44d1-9ea5-b4ea364496e5 admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:09.167985 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524309c4-18e4-44d1-9ea5-b4ea364496e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:09.168529 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524309c4-18e4-44d1-9ea5-b4ea364496e5 admin admin] PATH_INFO: `/v3/users` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:09.168907 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1f9692-a3c5-427a-9326-351fec74b2d9 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:09.170234 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524309c4-18e4-44d1-9ea5-b4ea364496e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:09.170653 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-df1f9692-a3c5-427a-9326-351fec74b2d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:09.175011 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524309c4-18e4-44d1-9ea5-b4ea364496e5 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:09.211782 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1302/2598] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 11:40:09 2022] POST /identity/v3/users => generated 290 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:40:09.216584 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524309c4-18e4-44d1-9ea5-b4ea364496e5 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:09.245935 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524309c4-18e4-44d1-9ea5-b4ea364496e5 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:09.251241 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e300ec04-b020-4b86-9bd1-034b8972c6a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:09.251509 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e300ec04-b020-4b86-9bd1-034b8972c6a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:09.251786 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e300ec04-b020-4b86-9bd1-034b8972c6a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:09.252061 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e300ec04-b020-4b86-9bd1-034b8972c6a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:09.252716 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e300ec04-b020-4b86-9bd1-034b8972c6a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:09.254982 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e300ec04-b020-4b86-9bd1-034b8972c6a9 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:09.269869 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1303/2599] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:40:09 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 11:40:09.271257 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e300ec04-b020-4b86-9bd1-034b8972c6a9 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:09.274278 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1f9692-a3c5-427a-9326-351fec74b2d9 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:09.283194 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e300ec04-b020-4b86-9bd1-034b8972c6a9 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:09.289820 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d406fb-cc67-4328-b93b-e6c2ae54c109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:09.290473 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d406fb-cc67-4328-b93b-e6c2ae54c109 admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:09.290753 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d406fb-cc67-4328-b93b-e6c2ae54c109 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:09.291025 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d406fb-cc67-4328-b93b-e6c2ae54c109 admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:09.291679 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d406fb-cc67-4328-b93b-e6c2ae54c109 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:09.293315 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d406fb-cc67-4328-b93b-e6c2ae54c109 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:09.308367 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1304/2600] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:40:09 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 11:40:09.309351 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d406fb-cc67-4328-b93b-e6c2ae54c109 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:09.316292 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-d0d406fb-cc67-4328-b93b-e6c2ae54c109 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:09.333421 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e53968-e397-4dd4-987a-94e9d88f8ec2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2d061d25d83443c9232218c90792d51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:09.334495 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e53968-e397-4dd4-987a-94e9d88f8ec2 service neutron] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:09.334846 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e53968-e397-4dd4-987a-94e9d88f8ec2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:09.335189 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e53968-e397-4dd4-987a-94e9d88f8ec2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:09.349191 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e53968-e397-4dd4-987a-94e9d88f8ec2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:09.350685 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e53968-e397-4dd4-987a-94e9d88f8ec2 service neutron] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:09.361092 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1297/2601] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:40:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 11:40:09.361898 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e53968-e397-4dd4-987a-94e9d88f8ec2 service neutron] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:09.371623 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e53968-e397-4dd4-987a-94e9d88f8ec2 service neutron] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:09.376448 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1277a3e2-1a04-4e64-862f-d1335d8dd689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:09.377091 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1277a3e2-1a04-4e64-862f-d1335d8dd689 admin admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:09.377362 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1277a3e2-1a04-4e64-862f-d1335d8dd689 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:09.377754 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1277a3e2-1a04-4e64-862f-d1335d8dd689 admin admin] PATH_INFO: `/v3/projects/2c296dcf87b04d47b70fbcfb3475a26e/users/0d86282f7e574a909fa0c88ba344ff2f/roles/27e3e65e24df4b86b0d3d18d3212101d` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:09.399903 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:40:09.405432 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1277a3e2-1a04-4e64-862f-d1335d8dd689 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c296dcf87b04d47b70fbcfb3475a26e, user_id=0d86282f7e574a909fa0c88ba344ff2f, role_id=27e3e65e24df4b86b0d3d18d3212101d)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:09.407866 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1277a3e2-1a04-4e64-862f-d1335d8dd689 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:09.409083 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d406fb-cc67-4328-b93b-e6c2ae54c109 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:09.443466 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1e009b-d4f0-4f9c-8d8f-9a16ad9ec6b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2d061d25d83443c9232218c90792d51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:09.444169 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1e009b-d4f0-4f9c-8d8f-9a16ad9ec6b4 service neutron] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:09.444463 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1e009b-d4f0-4f9c-8d8f-9a16ad9ec6b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:09.444679 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1e009b-d4f0-4f9c-8d8f-9a16ad9ec6b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:09.449095 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1298/2602] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 11:40:09 2022] PUT /identity/v3/projects/2c296dcf87b04d47b70fbcfb3475a26e/users/0d86282f7e574a909fa0c88ba344ff2f/roles/27e3e65e24df4b86b0d3d18d3212101d => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:40:09.449907 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-8c1e009b-d4f0-4f9c-8d8f-9a16ad9ec6b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:09.460330 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1887c8e-8003-4b60-b133-5ab1e8003cc4 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:09.460450 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1887c8e-8003-4b60-b133-5ab1e8003cc4 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:09.460974 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1887c8e-8003-4b60-b133-5ab1e8003cc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:09.472249 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1e009b-d4f0-4f9c-8d8f-9a16ad9ec6b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:09.474069 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1e009b-d4f0-4f9c-8d8f-9a16ad9ec6b4 service neutron] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:09.491022 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1305/2603] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:40:09 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:40:09.534504 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-f1887c8e-8003-4b60-b133-5ab1e8003cc4 None None] MFA Rules not processed for user `0d86282f7e574a909fa0c88ba344ff2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:40:09.535888 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-f1887c8e-8003-4b60-b133-5ab1e8003cc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:09.560783 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:40:09.713970 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1299/2604] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:40:09 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:40:09.714339 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1e009b-d4f0-4f9c-8d8f-9a16ad9ec6b4 service neutron] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:09.751486 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1e009b-d4f0-4f9c-8d8f-9a16ad9ec6b4 service neutron] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:09.825900 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca368e0b-43b8-4fc0-94a2-cb8209a060fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:09.827253 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca368e0b-43b8-4fc0-94a2-cb8209a060fa admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:09.827253 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca368e0b-43b8-4fc0-94a2-cb8209a060fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:09.827253 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca368e0b-43b8-4fc0-94a2-cb8209a060fa admin admin] PATH_INFO: `/v3/projects` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:09.827820 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca368e0b-43b8-4fc0-94a2-cb8209a060fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:09.829684 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca368e0b-43b8-4fc0-94a2-cb8209a060fa admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:09.872125 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1306/2605] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 11:40:09 2022] POST /identity/v3/projects => generated 381 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 11:40:09.876195 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1887c8e-8003-4b60-b133-5ab1e8003cc4 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:09.896518 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1887c8e-8003-4b60-b133-5ab1e8003cc4 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:10.006402 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c303c63-38cd-4349-a503-e6e6d965b660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:10.007058 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c303c63-38cd-4349-a503-e6e6d965b660 admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:10.007341 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c303c63-38cd-4349-a503-e6e6d965b660 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:10.007613 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c303c63-38cd-4349-a503-e6e6d965b660 admin admin] PATH_INFO: `/v3/users` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:10.010474 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c303c63-38cd-4349-a503-e6e6d965b660 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:10.017670 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c303c63-38cd-4349-a503-e6e6d965b660 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:10.064099 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1300/2606] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 11:40:09 2022] POST /identity/v3/users => generated 297 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:40:10.065629 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca368e0b-43b8-4fc0-94a2-cb8209a060fa admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:10.087870 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca368e0b-43b8-4fc0-94a2-cb8209a060fa admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:10.116137 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7687765-80a8-4c2f-820c-0569d9b28664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:10.120057 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7687765-80a8-4c2f-820c-0569d9b28664 admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:10.122717 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7687765-80a8-4c2f-820c-0569d9b28664 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:10.123003 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7687765-80a8-4c2f-820c-0569d9b28664 admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:10.123941 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7687765-80a8-4c2f-820c-0569d9b28664 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:10.125604 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7687765-80a8-4c2f-820c-0569d9b28664 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:10.141184 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1307/2607] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:40:10 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:40:10.142809 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c303c63-38cd-4349-a503-e6e6d965b660 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:10.156868 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c303c63-38cd-4349-a503-e6e6d965b660 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:10.162689 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0294b43-6d4e-4b44-8798-9072b162d0d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:10.163455 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0294b43-6d4e-4b44-8798-9072b162d0d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:10.163896 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0294b43-6d4e-4b44-8798-9072b162d0d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:10.164421 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0294b43-6d4e-4b44-8798-9072b162d0d6 admin admin] PATH_INFO: `/v3/projects/21202cdea4804084ad8247c1e75bc99d/users/bf8f4a499e004bff910fc4b8ec625f44/roles/30bb1e97257f4ca5b90c88545777317b` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:10.201377 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7687765-80a8-4c2f-820c-0569d9b28664 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:10.203872 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-d7687765-80a8-4c2f-820c-0569d9b28664 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:10.223884 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0294b43-6d4e-4b44-8798-9072b162d0d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21202cdea4804084ad8247c1e75bc99d, user_id=bf8f4a499e004bff910fc4b8ec625f44, role_id=30bb1e97257f4ca5b90c88545777317b)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:10.226855 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0294b43-6d4e-4b44-8798-9072b162d0d6 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:10.231070 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7687765-80a8-4c2f-820c-0569d9b28664 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:10.241315 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cc8223-b038-476c-8469-bf5ef8b3c2c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:10.242394 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cc8223-b038-476c-8469-bf5ef8b3c2c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:10.243356 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cc8223-b038-476c-8469-bf5ef8b3c2c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:10.243641 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cc8223-b038-476c-8469-bf5ef8b3c2c6 admin admin] PATH_INFO: `/v3/projects/6d0c96314adb4248ac8c9e0a1dc30b3e` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:10.245010 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cc8223-b038-476c-8469-bf5ef8b3c2c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d0c96314adb4248ac8c9e0a1dc30b3e)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:10.247102 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cc8223-b038-476c-8469-bf5ef8b3c2c6 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:10.276247 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1301/2608] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 11:40:10 2022] PUT /identity/v3/projects/21202cdea4804084ad8247c1e75bc99d/users/bf8f4a499e004bff910fc4b8ec625f44/roles/30bb1e97257f4ca5b90c88545777317b => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 11:40:10.276247 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0294b43-6d4e-4b44-8798-9072b162d0d6 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:10.290014 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-b0294b43-6d4e-4b44-8798-9072b162d0d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:10.352559 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-88cc8223-b038-476c-8469-bf5ef8b3c2c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d0c96314adb4248ac8c9e0a1dc30b3e', 'request_id': 'req-88cc8223-b038-476c-8469-bf5ef8b3c2c6'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:10.364416 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-88cc8223-b038-476c-8469-bf5ef8b3c2c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d0c96314adb4248ac8c9e0a1dc30b3e', 'request_id': 'req-88cc8223-b038-476c-8469-bf5ef8b3c2c6'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:10.377671 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-88cc8223-b038-476c-8469-bf5ef8b3c2c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d0c96314adb4248ac8c9e0a1dc30b3e', 'request_id': 'req-88cc8223-b038-476c-8469-bf5ef8b3c2c6'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:10.402194 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-88cc8223-b038-476c-8469-bf5ef8b3c2c6 admin admin] The token cache is being invalidate because project 6d0c96314adb4248ac8c9e0a1dc30b3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81501) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:40:10.402592 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-88cc8223-b038-476c-8469-bf5ef8b3c2c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:10.403393 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-88cc8223-b038-476c-8469-bf5ef8b3c2c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:10.408483 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1308/2609] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 11:40:10 2022] DELETE /identity/v3/projects/6d0c96314adb4248ac8c9e0a1dc30b3e => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:40:10.408483 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cc8223-b038-476c-8469-bf5ef8b3c2c6 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:10.408483 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-88cc8223-b038-476c-8469-bf5ef8b3c2c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:10.422210 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0294b43-6d4e-4b44-8798-9072b162d0d6 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:10.467622 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:40:10.472475 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:40:10.495853 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cc8223-b038-476c-8469-bf5ef8b3c2c6 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:10.503405 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d339b31-6f24-4dba-a5ac-ae5a7b372f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:10.504032 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d339b31-6f24-4dba-a5ac-ae5a7b372f79 admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:10.504324 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d339b31-6f24-4dba-a5ac-ae5a7b372f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:10.505005 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d339b31-6f24-4dba-a5ac-ae5a7b372f79 admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:10.505707 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d339b31-6f24-4dba-a5ac-ae5a7b372f79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:10.507555 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d339b31-6f24-4dba-a5ac-ae5a7b372f79 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:10.514389 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db3355d-6b33-4a11-8300-284adb0df93f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:10.515131 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db3355d-6b33-4a11-8300-284adb0df93f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:10.515783 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db3355d-6b33-4a11-8300-284adb0df93f admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:10.516149 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db3355d-6b33-4a11-8300-284adb0df93f admin admin] PATH_INFO: `/v3/users/07e50eea391b40d6b5b90ae436558450` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:10.518179 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db3355d-6b33-4a11-8300-284adb0df93f admin admin] RBAC: Authorizing `identity:delete_user(user_id=07e50eea391b40d6b5b90ae436558450)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:10.519118 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1309/2610] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:40:10 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:40:10.519467 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db3355d-6b33-4a11-8300-284adb0df93f admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:10.520085 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d339b31-6f24-4dba-a5ac-ae5a7b372f79 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:10.522689 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-2d339b31-6f24-4dba-a5ac-ae5a7b372f79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:10.539540 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d339b31-6f24-4dba-a5ac-ae5a7b372f79 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:10.549468 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51e7a37-4045-4eff-be84-62387cc716c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:10.550259 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51e7a37-4045-4eff-be84-62387cc716c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:10.550610 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51e7a37-4045-4eff-be84-62387cc716c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:10.550915 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51e7a37-4045-4eff-be84-62387cc716c8 admin admin] PATH_INFO: `/v3/users/28a89a9ec6c4478b988188c0ecb2f195` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:10.552737 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51e7a37-4045-4eff-be84-62387cc716c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=28a89a9ec6c4478b988188c0ecb2f195)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:10.555805 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51e7a37-4045-4eff-be84-62387cc716c8 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:10.595120 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-7db3355d-6b33-4a11-8300-284adb0df93f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07e50eea391b40d6b5b90ae436558450'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:10.596076 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-7db3355d-6b33-4a11-8300-284adb0df93f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07e50eea391b40d6b5b90ae436558450'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:10.608061 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-7db3355d-6b33-4a11-8300-284adb0df93f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07e50eea391b40d6b5b90ae436558450'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:10.621999 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-7db3355d-6b33-4a11-8300-284adb0df93f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07e50eea391b40d6b5b90ae436558450'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:10.623010 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-7db3355d-6b33-4a11-8300-284adb0df93f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07e50eea391b40d6b5b90ae436558450'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:10.625715 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-f51e7a37-4045-4eff-be84-62387cc716c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28a89a9ec6c4478b988188c0ecb2f195'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:10.626367 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-f51e7a37-4045-4eff-be84-62387cc716c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28a89a9ec6c4478b988188c0ecb2f195'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:10.627799 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-f51e7a37-4045-4eff-be84-62387cc716c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28a89a9ec6c4478b988188c0ecb2f195'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:10.641176 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-f51e7a37-4045-4eff-be84-62387cc716c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28a89a9ec6c4478b988188c0ecb2f195'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:10.651562 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-f51e7a37-4045-4eff-be84-62387cc716c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28a89a9ec6c4478b988188c0ecb2f195'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:10.654728 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1302/2611] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 11:40:10 2022] DELETE /identity/v3/users/07e50eea391b40d6b5b90ae436558450 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:40:10.656197 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db3355d-6b33-4a11-8300-284adb0df93f admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:10.658080 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-7db3355d-6b33-4a11-8300-284adb0df93f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:10.682141 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1310/2612] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 11:40:10 2022] DELETE /identity/v3/users/28a89a9ec6c4478b988188c0ecb2f195 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:40:10.764116 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db3355d-6b33-4a11-8300-284adb0df93f admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:10.863645 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:40:10.875505 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e1d28b-11a8-470e-be01-874e66fb47f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:10.876348 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e1d28b-11a8-470e-be01-874e66fb47f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:10.876696 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e1d28b-11a8-470e-be01-874e66fb47f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:10.877825 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e1d28b-11a8-470e-be01-874e66fb47f4 admin admin] PATH_INFO: `/v3/projects/21202cdea4804084ad8247c1e75bc99d/users/bf8f4a499e004bff910fc4b8ec625f44/roles/30bb1e97257f4ca5b90c88545777317b` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:10.880837 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e1d28b-11a8-470e-be01-874e66fb47f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21202cdea4804084ad8247c1e75bc99d, user_id=bf8f4a499e004bff910fc4b8ec625f44, role_id=30bb1e97257f4ca5b90c88545777317b)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:10.886225 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e1d28b-11a8-470e-be01-874e66fb47f4 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:10.903380 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1303/2613] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 11:40:10 2022] PUT /identity/v3/projects/21202cdea4804084ad8247c1e75bc99d/users/bf8f4a499e004bff910fc4b8ec625f44/roles/30bb1e97257f4ca5b90c88545777317b => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:40:10.913843 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be605ad-c2f1-4af9-9181-1908a0949340 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:10.914782 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be605ad-c2f1-4af9-9181-1908a0949340 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:10.914782 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be605ad-c2f1-4af9-9181-1908a0949340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:10.961173 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-2be605ad-c2f1-4af9-9181-1908a0949340 None None] MFA Rules not processed for user `bf8f4a499e004bff910fc4b8ec625f44`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:40:10.963119 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-2be605ad-c2f1-4af9-9181-1908a0949340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:11.093712 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1311/2614] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:40:10 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:40:11.108607 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e1d28b-11a8-470e-be01-874e66fb47f4 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:11.110165 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-d9e1d28b-11a8-470e-be01-874e66fb47f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:11.128421 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be605ad-c2f1-4af9-9181-1908a0949340 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:11.131269 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-2be605ad-c2f1-4af9-9181-1908a0949340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:11.198956 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:40:11.231286 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be605ad-c2f1-4af9-9181-1908a0949340 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:11.243690 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e1d28b-11a8-470e-be01-874e66fb47f4 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:11.247028 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c59b0d5-9b72-4707-940b-44db800ae989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:11.247682 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c59b0d5-9b72-4707-940b-44db800ae989 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:11.248073 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c59b0d5-9b72-4707-940b-44db800ae989 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:11.248389 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c59b0d5-9b72-4707-940b-44db800ae989 admin admin] PATH_INFO: `/v3/projects/3d22a72dbb3342a9995978ec639b706d` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:11.250231 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c59b0d5-9b72-4707-940b-44db800ae989 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d22a72dbb3342a9995978ec639b706d)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:11.253253 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c59b0d5-9b72-4707-940b-44db800ae989 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:11.258231 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e3b45f-e710-4191-8fff-5fffd7d3fe14 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92862b76ba3b4513b5dc5b5c962faac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:11.258904 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e3b45f-e710-4191-8fff-5fffd7d3fe14 service cinder] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:11.259178 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e3b45f-e710-4191-8fff-5fffd7d3fe14 service cinder] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:11.259449 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e3b45f-e710-4191-8fff-5fffd7d3fe14 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:11.273338 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e3b45f-e710-4191-8fff-5fffd7d3fe14 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:11.275218 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e3b45f-e710-4191-8fff-5fffd7d3fe14 service cinder] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:11.288812 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1304/2615] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:40:11 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:40:11.289693 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e3b45f-e710-4191-8fff-5fffd7d3fe14 service cinder] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:11.291039 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-18e3b45f-e710-4191-8fff-5fffd7d3fe14 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:11.309785 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e3b45f-e710-4191-8fff-5fffd7d3fe14 service cinder] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:11.316051 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb7cff7-4242-453d-8a81-abd5c68d9318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:11.317460 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb7cff7-4242-453d-8a81-abd5c68d9318 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:11.317460 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb7cff7-4242-453d-8a81-abd5c68d9318 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:11.317898 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb7cff7-4242-453d-8a81-abd5c68d9318 admin admin] PATH_INFO: `/v3/projects/e688ad4dcbf74937850b53954675a9e0` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:11.319596 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb7cff7-4242-453d-8a81-abd5c68d9318 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e688ad4dcbf74937850b53954675a9e0)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:11.322210 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb7cff7-4242-453d-8a81-abd5c68d9318 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:11.358817 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-5c59b0d5-9b72-4707-940b-44db800ae989 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d22a72dbb3342a9995978ec639b706d', 'request_id': 'req-5c59b0d5-9b72-4707-940b-44db800ae989'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:11.367975 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-5c59b0d5-9b72-4707-940b-44db800ae989 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d22a72dbb3342a9995978ec639b706d', 'request_id': 'req-5c59b0d5-9b72-4707-940b-44db800ae989'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:11.375689 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-5c59b0d5-9b72-4707-940b-44db800ae989 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d22a72dbb3342a9995978ec639b706d', 'request_id': 'req-5c59b0d5-9b72-4707-940b-44db800ae989'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:11.399321 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-5c59b0d5-9b72-4707-940b-44db800ae989 admin admin] The token cache is being invalidate because project 3d22a72dbb3342a9995978ec639b706d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81501) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:40:11.399661 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-5c59b0d5-9b72-4707-940b-44db800ae989 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:11.410600 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-2eb7cff7-4242-453d-8a81-abd5c68d9318 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e688ad4dcbf74937850b53954675a9e0', 'request_id': 'req-2eb7cff7-4242-453d-8a81-abd5c68d9318'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:11.411435 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-5c59b0d5-9b72-4707-940b-44db800ae989 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:11.414464 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1312/2616] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 11:40:11 2022] DELETE /identity/v3/projects/3d22a72dbb3342a9995978ec639b706d => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:40:11.420979 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b597a55-8b73-4035-a842-0ba560c10cc7 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:11.421991 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b597a55-8b73-4035-a842-0ba560c10cc7 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:11.422152 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-2eb7cff7-4242-453d-8a81-abd5c68d9318 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e688ad4dcbf74937850b53954675a9e0', 'request_id': 'req-2eb7cff7-4242-453d-8a81-abd5c68d9318'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:11.422545 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b597a55-8b73-4035-a842-0ba560c10cc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:11.436122 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-2eb7cff7-4242-453d-8a81-abd5c68d9318 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e688ad4dcbf74937850b53954675a9e0', 'request_id': 'req-2eb7cff7-4242-453d-8a81-abd5c68d9318'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:11.452598 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-8b597a55-8b73-4035-a842-0ba560c10cc7 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:40:11.454120 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-8b597a55-8b73-4035-a842-0ba560c10cc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:11.466327 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-2eb7cff7-4242-453d-8a81-abd5c68d9318 admin admin] The token cache is being invalidate because project e688ad4dcbf74937850b53954675a9e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:40:11.466642 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-2eb7cff7-4242-453d-8a81-abd5c68d9318 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:11.467959 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-2eb7cff7-4242-453d-8a81-abd5c68d9318 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:11.475000 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1305/2617] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 11:40:11 2022] DELETE /identity/v3/projects/e688ad4dcbf74937850b53954675a9e0 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:40:11.479528 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb7cff7-4242-453d-8a81-abd5c68d9318 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:11.484408 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-2eb7cff7-4242-453d-8a81-abd5c68d9318 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:11.582654 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1313/2618] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:40:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:40:11.586123 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada2b54e-c706-419e-a68b-1ae4d7667198 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:11.588650 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada2b54e-c706-419e-a68b-1ae4d7667198 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:11.588947 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada2b54e-c706-419e-a68b-1ae4d7667198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:11.607197 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb7cff7-4242-453d-8a81-abd5c68d9318 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:11.613886 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f732a35-e4e6-40d8-b354-91dd0633eefc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:11.617261 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f732a35-e4e6-40d8-b354-91dd0633eefc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:11.617548 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f732a35-e4e6-40d8-b354-91dd0633eefc admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:11.617869 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f732a35-e4e6-40d8-b354-91dd0633eefc admin admin] PATH_INFO: `/v3/users/f43d2b82d63b4a3da1cb907f9ecd9747` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:11.619704 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f732a35-e4e6-40d8-b354-91dd0633eefc admin admin] RBAC: Authorizing `identity:delete_user(user_id=f43d2b82d63b4a3da1cb907f9ecd9747)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:11.623515 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f732a35-e4e6-40d8-b354-91dd0633eefc admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:11.631737 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-ada2b54e-c706-419e-a68b-1ae4d7667198 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:40:11.633579 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-ada2b54e-c706-419e-a68b-1ae4d7667198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:11.649137 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1314/2619] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:40:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:40:11.653967 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada2b54e-c706-419e-a68b-1ae4d7667198 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:11.664454 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:40:11.672485 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada2b54e-c706-419e-a68b-1ae4d7667198 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:11.692562 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83300384-aca8-4939-add8-54696cbb71a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:11.693302 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83300384-aca8-4939-add8-54696cbb71a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:11.693599 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83300384-aca8-4939-add8-54696cbb71a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:11.694022 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83300384-aca8-4939-add8-54696cbb71a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:11.694726 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83300384-aca8-4939-add8-54696cbb71a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:40:11.695112 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83300384-aca8-4939-add8-54696cbb71a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:11.698630 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83300384-aca8-4939-add8-54696cbb71a9 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:11.724403 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1315/2620] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 24 11:40:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:40:11.731304 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83300384-aca8-4939-add8-54696cbb71a9 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:11.754935 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-8f732a35-e4e6-40d8-b354-91dd0633eefc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f43d2b82d63b4a3da1cb907f9ecd9747'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:11.755976 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-8f732a35-e4e6-40d8-b354-91dd0633eefc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f43d2b82d63b4a3da1cb907f9ecd9747'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:11.764447 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83300384-aca8-4939-add8-54696cbb71a9 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:11.771284 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-8f732a35-e4e6-40d8-b354-91dd0633eefc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f43d2b82d63b4a3da1cb907f9ecd9747'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:11.775437 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7afb19-e45d-44c1-b71a-710841d6df13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:11.776025 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7afb19-e45d-44c1-b71a-710841d6df13 admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:11.776301 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7afb19-e45d-44c1-b71a-710841d6df13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:11.776569 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7afb19-e45d-44c1-b71a-710841d6df13 admin admin] PATH_INFO: `/v3/projects` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:11.777206 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7afb19-e45d-44c1-b71a-710841d6df13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:11.779155 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7afb19-e45d-44c1-b71a-710841d6df13 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:11.787984 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-8f732a35-e4e6-40d8-b354-91dd0633eefc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f43d2b82d63b4a3da1cb907f9ecd9747'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:11.789173 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-8f732a35-e4e6-40d8-b354-91dd0633eefc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f43d2b82d63b4a3da1cb907f9ecd9747'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:11.835868 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1306/2621] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 11:40:11 2022] DELETE /identity/v3/users/f43d2b82d63b4a3da1cb907f9ecd9747 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 11:40:11.839314 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1316/2622] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 11:40:11 2022] POST /identity/v3/projects => generated 405 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:40:11.843301 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f732a35-e4e6-40d8-b354-91dd0633eefc admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:11.845140 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-8f732a35-e4e6-40d8-b354-91dd0633eefc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:11.893844 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7afb19-e45d-44c1-b71a-710841d6df13 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:11.896003 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-fb7afb19-e45d-44c1-b71a-710841d6df13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:11.951885 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f732a35-e4e6-40d8-b354-91dd0633eefc admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:11.953689 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:40:12.006554 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7afb19-e45d-44c1-b71a-710841d6df13 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:12.011836 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b119e6c9-6831-4e18-b942-5470a73614f9 tempest-VolumeQuotaClassesTest-1088427240 tempest-VolumeQuotaClassesTest-1088427240-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf8f4a499e004bff910fc4b8ec625f44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21202cdea4804084ad8247c1e75bc99d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:12.012598 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b119e6c9-6831-4e18-b942-5470a73614f9 tempest-VolumeQuotaClassesTest-1088427240 tempest-VolumeQuotaClassesTest-1088427240-project-admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:12.013002 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b119e6c9-6831-4e18-b942-5470a73614f9 tempest-VolumeQuotaClassesTest-1088427240 tempest-VolumeQuotaClassesTest-1088427240-project-admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:12.013374 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b119e6c9-6831-4e18-b942-5470a73614f9 tempest-VolumeQuotaClassesTest-1088427240 tempest-VolumeQuotaClassesTest-1088427240-project-admin] PATH_INFO: `/v3/domains` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:12.014134 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b119e6c9-6831-4e18-b942-5470a73614f9 tempest-VolumeQuotaClassesTest-1088427240 tempest-VolumeQuotaClassesTest-1088427240-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:40:12.014580 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b119e6c9-6831-4e18-b942-5470a73614f9 tempest-VolumeQuotaClassesTest-1088427240 tempest-VolumeQuotaClassesTest-1088427240-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:12.016453 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b119e6c9-6831-4e18-b942-5470a73614f9 tempest-VolumeQuotaClassesTest-1088427240 tempest-VolumeQuotaClassesTest-1088427240-project-admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:12.032727 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1317/2623] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 24 11:40:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:40:12.034448 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ca8667-990c-43b6-aed7-1d0e0e868f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:12.034614 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d35e98-d229-4a63-b21a-b15f6c507810 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:12.035043 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d35e98-d229-4a63-b21a-b15f6c507810 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:12.035161 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ca8667-990c-43b6-aed7-1d0e0e868f70 admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:12.035388 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ca8667-990c-43b6-aed7-1d0e0e868f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:12.035729 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ca8667-990c-43b6-aed7-1d0e0e868f70 admin admin] PATH_INFO: `/v3/users` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:12.035881 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d35e98-d229-4a63-b21a-b15f6c507810 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:12.036380 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ca8667-990c-43b6-aed7-1d0e0e868f70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:12.038314 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ca8667-990c-43b6-aed7-1d0e0e868f70 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:12.057748 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-78d35e98-d229-4a63-b21a-b15f6c507810 None None] MFA Rules not processed for user `a5915030f01941fc89f92228ff57c7f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:40:12.059060 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-78d35e98-d229-4a63-b21a-b15f6c507810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:12.068325 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1307/2624] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 11:40:11 2022] POST /identity/v3/users => generated 303 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 11:40:12.069464 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ca8667-990c-43b6-aed7-1d0e0e868f70 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:12.082108 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ca8667-990c-43b6-aed7-1d0e0e868f70 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:12.091538 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4345bc-7149-48b2-b62d-c9e58dc22620 tempest-VolumeQuotaClassesTest-1088427240 tempest-VolumeQuotaClassesTest-1088427240-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf8f4a499e004bff910fc4b8ec625f44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21202cdea4804084ad8247c1e75bc99d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:12.092437 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4345bc-7149-48b2-b62d-c9e58dc22620 tempest-VolumeQuotaClassesTest-1088427240 tempest-VolumeQuotaClassesTest-1088427240-project-admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:12.093086 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4345bc-7149-48b2-b62d-c9e58dc22620 tempest-VolumeQuotaClassesTest-1088427240 tempest-VolumeQuotaClassesTest-1088427240-project-admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:12.093510 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4345bc-7149-48b2-b62d-c9e58dc22620 tempest-VolumeQuotaClassesTest-1088427240 tempest-VolumeQuotaClassesTest-1088427240-project-admin] PATH_INFO: `/v3/projects` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:12.094643 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4345bc-7149-48b2-b62d-c9e58dc22620 tempest-VolumeQuotaClassesTest-1088427240 tempest-VolumeQuotaClassesTest-1088427240-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:12.097207 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4345bc-7149-48b2-b62d-c9e58dc22620 tempest-VolumeQuotaClassesTest-1088427240 tempest-VolumeQuotaClassesTest-1088427240-project-admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:12.138580 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1318/2625] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Aug 24 11:40:12 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:40:12.142122 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d35e98-d229-4a63-b21a-b15f6c507810 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:12.154866 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1308/2626] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 11:40:12 2022] POST /identity/v3/projects => generated 354 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:40:12.157966 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4345bc-7149-48b2-b62d-c9e58dc22620 tempest-VolumeQuotaClassesTest-1088427240 tempest-VolumeQuotaClassesTest-1088427240-project-admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:12.172045 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d35e98-d229-4a63-b21a-b15f6c507810 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:12.185817 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=86,keystone:DELETE=9,keystone:INSERT=5 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:40:12.253168 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4345bc-7149-48b2-b62d-c9e58dc22620 tempest-VolumeQuotaClassesTest-1088427240 tempest-VolumeQuotaClassesTest-1088427240-project-admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:12.258982 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b60d535-be3a-46d0-a55c-91466d3be420 tempest-VolumeQuotaClassesTest-1088427240 tempest-VolumeQuotaClassesTest-1088427240-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf8f4a499e004bff910fc4b8ec625f44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21202cdea4804084ad8247c1e75bc99d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:12.259812 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b60d535-be3a-46d0-a55c-91466d3be420 tempest-VolumeQuotaClassesTest-1088427240 tempest-VolumeQuotaClassesTest-1088427240-project-admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:12.260095 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b60d535-be3a-46d0-a55c-91466d3be420 tempest-VolumeQuotaClassesTest-1088427240 tempest-VolumeQuotaClassesTest-1088427240-project-admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:12.260470 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b60d535-be3a-46d0-a55c-91466d3be420 tempest-VolumeQuotaClassesTest-1088427240 tempest-VolumeQuotaClassesTest-1088427240-project-admin] PATH_INFO: `/v3/domains` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:12.261132 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b60d535-be3a-46d0-a55c-91466d3be420 tempest-VolumeQuotaClassesTest-1088427240 tempest-VolumeQuotaClassesTest-1088427240-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:40:12.261433 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b60d535-be3a-46d0-a55c-91466d3be420 tempest-VolumeQuotaClassesTest-1088427240 tempest-VolumeQuotaClassesTest-1088427240-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:12.265252 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b60d535-be3a-46d0-a55c-91466d3be420 tempest-VolumeQuotaClassesTest-1088427240 tempest-VolumeQuotaClassesTest-1088427240-project-admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:12.277634 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1309/2627] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 24 11:40:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:40:12.278673 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b60d535-be3a-46d0-a55c-91466d3be420 tempest-VolumeQuotaClassesTest-1088427240 tempest-VolumeQuotaClassesTest-1088427240-project-admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:12.284170 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b477b1-db69-4f00-bc26-e4a224c25cad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:12.284833 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b477b1-db69-4f00-bc26-e4a224c25cad admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:12.284947 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-7b60d535-be3a-46d0-a55c-91466d3be420 tempest-VolumeQuotaClassesTest-1088427240 tempest-VolumeQuotaClassesTest-1088427240-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:12.285278 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b477b1-db69-4f00-bc26-e4a224c25cad admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:12.285388 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b477b1-db69-4f00-bc26-e4a224c25cad admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:12.286075 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b477b1-db69-4f00-bc26-e4a224c25cad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:12.288040 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b477b1-db69-4f00-bc26-e4a224c25cad admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:12.300406 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1319/2628] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:40:12 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:40:12.301550 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b477b1-db69-4f00-bc26-e4a224c25cad admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:12.303818 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-84b477b1-db69-4f00-bc26-e4a224c25cad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:12.317522 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b477b1-db69-4f00-bc26-e4a224c25cad admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:12.323667 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409358fb-28c1-44fe-ada1-7ad28b3dc593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:12.324821 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409358fb-28c1-44fe-ada1-7ad28b3dc593 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:12.325114 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409358fb-28c1-44fe-ada1-7ad28b3dc593 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:12.325394 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409358fb-28c1-44fe-ada1-7ad28b3dc593 admin admin] PATH_INFO: `/v3/projects/9d5d17a51bef43eaa2201df54608f7bd` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:12.328364 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409358fb-28c1-44fe-ada1-7ad28b3dc593 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d5d17a51bef43eaa2201df54608f7bd)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:12.340331 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409358fb-28c1-44fe-ada1-7ad28b3dc593 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:12.382061 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b60d535-be3a-46d0-a55c-91466d3be420 tempest-VolumeQuotaClassesTest-1088427240 tempest-VolumeQuotaClassesTest-1088427240-project-admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:12.389545 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8da3ae-2c89-4089-ac09-5d42142cb96a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1069558c085449f9e4c9f06013b2a85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:12.390172 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8da3ae-2c89-4089-ac09-5d42142cb96a service swift] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:12.390507 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8da3ae-2c89-4089-ac09-5d42142cb96a service swift] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:12.390779 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8da3ae-2c89-4089-ac09-5d42142cb96a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:12.409636 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-409358fb-28c1-44fe-ada1-7ad28b3dc593 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d5d17a51bef43eaa2201df54608f7bd', 'request_id': 'req-409358fb-28c1-44fe-ada1-7ad28b3dc593'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:12.418341 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-409358fb-28c1-44fe-ada1-7ad28b3dc593 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d5d17a51bef43eaa2201df54608f7bd', 'request_id': 'req-409358fb-28c1-44fe-ada1-7ad28b3dc593'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:12.424725 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:40:12.427715 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-409358fb-28c1-44fe-ada1-7ad28b3dc593 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d5d17a51bef43eaa2201df54608f7bd', 'request_id': 'req-409358fb-28c1-44fe-ada1-7ad28b3dc593'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:12.444521 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-409358fb-28c1-44fe-ada1-7ad28b3dc593 admin admin] The token cache is being invalidate because project 9d5d17a51bef43eaa2201df54608f7bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81501) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:40:12.444808 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-409358fb-28c1-44fe-ada1-7ad28b3dc593 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:12.445444 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-409358fb-28c1-44fe-ada1-7ad28b3dc593 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:12.447856 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1320/2629] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 11:40:12 2022] DELETE /identity/v3/projects/9d5d17a51bef43eaa2201df54608f7bd => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:40:12.448641 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409358fb-28c1-44fe-ada1-7ad28b3dc593 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:12.449958 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-409358fb-28c1-44fe-ada1-7ad28b3dc593 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:12.455419 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8da3ae-2c89-4089-ac09-5d42142cb96a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:12.457101 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8da3ae-2c89-4089-ac09-5d42142cb96a service swift] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:12.483073 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1310/2630] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Aug 24 11:40:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 11:40:12.486679 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8da3ae-2c89-4089-ac09-5d42142cb96a service swift] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:12.533410 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409358fb-28c1-44fe-ada1-7ad28b3dc593 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:12.538386 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8da3ae-2c89-4089-ac09-5d42142cb96a service swift] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:12.539887 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1af005-34a3-4308-ac38-4acdab11f421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:12.541201 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1af005-34a3-4308-ac38-4acdab11f421 admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:12.541201 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1af005-34a3-4308-ac38-4acdab11f421 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:12.541573 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1af005-34a3-4308-ac38-4acdab11f421 admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:12.542628 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1af005-34a3-4308-ac38-4acdab11f421 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:12.545410 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1af005-34a3-4308-ac38-4acdab11f421 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:12.564099 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1321/2631] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:40:12 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:40:12.566169 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1af005-34a3-4308-ac38-4acdab11f421 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:12.579617 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1af005-34a3-4308-ac38-4acdab11f421 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:12.586685 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22147d0-08fe-4305-93d4-15d393ccfaa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:12.587718 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22147d0-08fe-4305-93d4-15d393ccfaa5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:12.588132 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22147d0-08fe-4305-93d4-15d393ccfaa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:12.588920 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22147d0-08fe-4305-93d4-15d393ccfaa5 admin admin] PATH_INFO: `/v3/projects/d24906ef87df4fc28b9a93591a656d14/users/5669356d12cf4c9fa4ca56b001ee0452/roles/27e3e65e24df4b86b0d3d18d3212101d` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:12.613150 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22147d0-08fe-4305-93d4-15d393ccfaa5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d24906ef87df4fc28b9a93591a656d14, user_id=5669356d12cf4c9fa4ca56b001ee0452, role_id=27e3e65e24df4b86b0d3d18d3212101d)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:12.617711 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22147d0-08fe-4305-93d4-15d393ccfaa5 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:12.646611 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1322/2632] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 11:40:12 2022] PUT /identity/v3/projects/d24906ef87df4fc28b9a93591a656d14/users/5669356d12cf4c9fa4ca56b001ee0452/roles/27e3e65e24df4b86b0d3d18d3212101d => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:40:12.650288 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbdbb0e-fc68-4dc9-821c-aca8bab0f194 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:12.651065 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbdbb0e-fc68-4dc9-821c-aca8bab0f194 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:12.651065 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbdbb0e-fc68-4dc9-821c-aca8bab0f194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:12.732357 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-1bbdbb0e-fc68-4dc9-821c-aca8bab0f194 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:40:12.733778 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-1bbdbb0e-fc68-4dc9-821c-aca8bab0f194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:12.758215 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:40:12.791702 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80479b2-7705-40d5-b653-6d67f9cb2dbe tempest-VolumeQuotaClassesTest-1088427240 tempest-VolumeQuotaClassesTest-1088427240-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf8f4a499e004bff910fc4b8ec625f44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21202cdea4804084ad8247c1e75bc99d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:12.792260 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80479b2-7705-40d5-b653-6d67f9cb2dbe tempest-VolumeQuotaClassesTest-1088427240 tempest-VolumeQuotaClassesTest-1088427240-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:12.794724 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80479b2-7705-40d5-b653-6d67f9cb2dbe tempest-VolumeQuotaClassesTest-1088427240 tempest-VolumeQuotaClassesTest-1088427240-project-admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:12.795028 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80479b2-7705-40d5-b653-6d67f9cb2dbe tempest-VolumeQuotaClassesTest-1088427240 tempest-VolumeQuotaClassesTest-1088427240-project-admin] PATH_INFO: `/v3/projects/73c07090af784fca8fd58ce073c162ec` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:12.797069 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80479b2-7705-40d5-b653-6d67f9cb2dbe tempest-VolumeQuotaClassesTest-1088427240 tempest-VolumeQuotaClassesTest-1088427240-project-admin] RBAC: Authorizing `identity:delete_project(project_id=73c07090af784fca8fd58ce073c162ec)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:12.801142 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80479b2-7705-40d5-b653-6d67f9cb2dbe tempest-VolumeQuotaClassesTest-1088427240 tempest-VolumeQuotaClassesTest-1088427240-project-admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:12.896517 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1323/2633] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:40:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:40:12.905941 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbdbb0e-fc68-4dc9-821c-aca8bab0f194 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:12.907446 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-1bbdbb0e-fc68-4dc9-821c-aca8bab0f194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:12.922307 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-b80479b2-7705-40d5-b653-6d67f9cb2dbe tempest-VolumeQuotaClassesTest-1088427240 tempest-VolumeQuotaClassesTest-1088427240-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73c07090af784fca8fd58ce073c162ec', 'request_id': 'req-b80479b2-7705-40d5-b653-6d67f9cb2dbe'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:12.934690 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-b80479b2-7705-40d5-b653-6d67f9cb2dbe tempest-VolumeQuotaClassesTest-1088427240 tempest-VolumeQuotaClassesTest-1088427240-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73c07090af784fca8fd58ce073c162ec', 'request_id': 'req-b80479b2-7705-40d5-b653-6d67f9cb2dbe'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:12.944206 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-b80479b2-7705-40d5-b653-6d67f9cb2dbe tempest-VolumeQuotaClassesTest-1088427240 tempest-VolumeQuotaClassesTest-1088427240-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73c07090af784fca8fd58ce073c162ec', 'request_id': 'req-b80479b2-7705-40d5-b653-6d67f9cb2dbe'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:13.001474 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-b80479b2-7705-40d5-b653-6d67f9cb2dbe tempest-VolumeQuotaClassesTest-1088427240 tempest-VolumeQuotaClassesTest-1088427240-project-admin] The token cache is being invalidate because project 73c07090af784fca8fd58ce073c162ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:40:13.006236 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-b80479b2-7705-40d5-b653-6d67f9cb2dbe tempest-VolumeQuotaClassesTest-1088427240 tempest-VolumeQuotaClassesTest-1088427240-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:13.009538 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-b80479b2-7705-40d5-b653-6d67f9cb2dbe tempest-VolumeQuotaClassesTest-1088427240 tempest-VolumeQuotaClassesTest-1088427240-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:13.018709 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1311/2634] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 11:40:12 2022] DELETE /identity/v3/projects/73c07090af784fca8fd58ce073c162ec => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:40:13.101248 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbdbb0e-fc68-4dc9-821c-aca8bab0f194 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:13.142397 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:DELETE=2,keystone:SELECT=96,keystone:INSERT=2 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:40:13.289380 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45e0ab5-e709-4936-a814-e392f42bb468 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2d061d25d83443c9232218c90792d51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:13.289380 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45e0ab5-e709-4936-a814-e392f42bb468 service neutron] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:13.289380 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45e0ab5-e709-4936-a814-e392f42bb468 service neutron] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:13.289380 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45e0ab5-e709-4936-a814-e392f42bb468 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:13.292307 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-c45e0ab5-e709-4936-a814-e392f42bb468 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:13.452033 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45e0ab5-e709-4936-a814-e392f42bb468 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:13.456647 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45e0ab5-e709-4936-a814-e392f42bb468 service neutron] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:13.491184 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1324/2635] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:40:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 586 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:40:13.497462 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80479b2-7705-40d5-b653-6d67f9cb2dbe tempest-VolumeQuotaClassesTest-1088427240 tempest-VolumeQuotaClassesTest-1088427240-project-admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:13.499477 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-b80479b2-7705-40d5-b653-6d67f9cb2dbe tempest-VolumeQuotaClassesTest-1088427240 tempest-VolumeQuotaClassesTest-1088427240-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:13.537236 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80479b2-7705-40d5-b653-6d67f9cb2dbe tempest-VolumeQuotaClassesTest-1088427240 tempest-VolumeQuotaClassesTest-1088427240-project-admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:13.555829 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc1253b-e697-41a6-bd51-92bc2ecd3f20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:13.556549 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc1253b-e697-41a6-bd51-92bc2ecd3f20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:13.556825 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc1253b-e697-41a6-bd51-92bc2ecd3f20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:13.557159 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc1253b-e697-41a6-bd51-92bc2ecd3f20 admin admin] PATH_INFO: `/v3/users/0d86282f7e574a909fa0c88ba344ff2f` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:13.558594 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc1253b-e697-41a6-bd51-92bc2ecd3f20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d86282f7e574a909fa0c88ba344ff2f)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:13.560866 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc1253b-e697-41a6-bd51-92bc2ecd3f20 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:13.692758 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-0cc1253b-e697-41a6-bd51-92bc2ecd3f20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d86282f7e574a909fa0c88ba344ff2f'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:13.694259 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-0cc1253b-e697-41a6-bd51-92bc2ecd3f20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d86282f7e574a909fa0c88ba344ff2f'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:13.712259 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-0cc1253b-e697-41a6-bd51-92bc2ecd3f20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d86282f7e574a909fa0c88ba344ff2f'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:13.725042 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-0cc1253b-e697-41a6-bd51-92bc2ecd3f20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d86282f7e574a909fa0c88ba344ff2f'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:13.727854 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-0cc1253b-e697-41a6-bd51-92bc2ecd3f20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d86282f7e574a909fa0c88ba344ff2f'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:13.785521 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1312/2636] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 11:40:13 2022] DELETE /identity/v3/users/0d86282f7e574a909fa0c88ba344ff2f => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:40:13.789772 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62021b82-1e6f-43a5-a825-44e28b758e00 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:13.790061 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62021b82-1e6f-43a5-a825-44e28b758e00 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:13.790334 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62021b82-1e6f-43a5-a825-44e28b758e00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:13.832907 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-62021b82-1e6f-43a5-a825-44e28b758e00 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:40:13.834161 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-62021b82-1e6f-43a5-a825-44e28b758e00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:14.107785 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1325/2637] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:40:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:40:14.177076 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc1253b-e697-41a6-bd51-92bc2ecd3f20 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:14.179935 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-0cc1253b-e697-41a6-bd51-92bc2ecd3f20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:14.319788 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:40:14.367696 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc1253b-e697-41a6-bd51-92bc2ecd3f20 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:14.380192 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be670f6b-526a-4eab-a79c-d5ca69ef464a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2d061d25d83443c9232218c90792d51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:14.381316 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be670f6b-526a-4eab-a79c-d5ca69ef464a service neutron] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:14.382322 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be670f6b-526a-4eab-a79c-d5ca69ef464a service neutron] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:14.382991 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be670f6b-526a-4eab-a79c-d5ca69ef464a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:14.396803 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be670f6b-526a-4eab-a79c-d5ca69ef464a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:14.398880 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be670f6b-526a-4eab-a79c-d5ca69ef464a service neutron] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:14.416733 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1313/2638] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:40:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:40:14.957745 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62021b82-1e6f-43a5-a825-44e28b758e00 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:14.959315 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-62021b82-1e6f-43a5-a825-44e28b758e00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:14.982998 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62021b82-1e6f-43a5-a825-44e28b758e00 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:14.990071 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a7333d-0c2f-4991-a9fd-9c26018cf494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:14.991562 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a7333d-0c2f-4991-a9fd-9c26018cf494 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:14.991842 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a7333d-0c2f-4991-a9fd-9c26018cf494 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:14.992237 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a7333d-0c2f-4991-a9fd-9c26018cf494 admin admin] PATH_INFO: `/v3/users/6b08455fa85c4b60af58e9f213a00a4d` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:14.993639 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a7333d-0c2f-4991-a9fd-9c26018cf494 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b08455fa85c4b60af58e9f213a00a4d)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:14.996205 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a7333d-0c2f-4991-a9fd-9c26018cf494 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:15.097072 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-73a7333d-0c2f-4991-a9fd-9c26018cf494 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b08455fa85c4b60af58e9f213a00a4d'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:15.097778 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-73a7333d-0c2f-4991-a9fd-9c26018cf494 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b08455fa85c4b60af58e9f213a00a4d'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:15.098575 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-73a7333d-0c2f-4991-a9fd-9c26018cf494 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b08455fa85c4b60af58e9f213a00a4d'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:15.117868 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-73a7333d-0c2f-4991-a9fd-9c26018cf494 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b08455fa85c4b60af58e9f213a00a4d'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:15.125392 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:40:15.128064 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-73a7333d-0c2f-4991-a9fd-9c26018cf494 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b08455fa85c4b60af58e9f213a00a4d'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:15.219162 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1326/2639] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 11:40:14 2022] DELETE /identity/v3/users/6b08455fa85c4b60af58e9f213a00a4d => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:40:15.522013 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be670f6b-526a-4eab-a79c-d5ca69ef464a service neutron] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:15.523952 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-be670f6b-526a-4eab-a79c-d5ca69ef464a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:15.549468 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be670f6b-526a-4eab-a79c-d5ca69ef464a service neutron] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:15.664736 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a7333d-0c2f-4991-a9fd-9c26018cf494 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:15.667634 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-73a7333d-0c2f-4991-a9fd-9c26018cf494 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:15.756134 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb1b216-c9f0-4091-b40e-1eddae0876df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:15.756831 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb1b216-c9f0-4091-b40e-1eddae0876df admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:15.757037 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb1b216-c9f0-4091-b40e-1eddae0876df admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:15.757309 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb1b216-c9f0-4091-b40e-1eddae0876df admin admin] PATH_INFO: `/v3/projects/2c296dcf87b04d47b70fbcfb3475a26e` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:15.759216 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb1b216-c9f0-4091-b40e-1eddae0876df admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c296dcf87b04d47b70fbcfb3475a26e)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:15.761567 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb1b216-c9f0-4091-b40e-1eddae0876df admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:15.905571 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-bdb1b216-c9f0-4091-b40e-1eddae0876df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c296dcf87b04d47b70fbcfb3475a26e', 'request_id': 'req-bdb1b216-c9f0-4091-b40e-1eddae0876df'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:15.909243 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a7333d-0c2f-4991-a9fd-9c26018cf494 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:15.928460 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-bdb1b216-c9f0-4091-b40e-1eddae0876df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c296dcf87b04d47b70fbcfb3475a26e', 'request_id': 'req-bdb1b216-c9f0-4091-b40e-1eddae0876df'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:15.950656 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-bdb1b216-c9f0-4091-b40e-1eddae0876df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c296dcf87b04d47b70fbcfb3475a26e', 'request_id': 'req-bdb1b216-c9f0-4091-b40e-1eddae0876df'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:15.976489 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-bdb1b216-c9f0-4091-b40e-1eddae0876df admin admin] The token cache is being invalidate because project 2c296dcf87b04d47b70fbcfb3475a26e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:40:15.977035 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-bdb1b216-c9f0-4091-b40e-1eddae0876df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:15.978179 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-bdb1b216-c9f0-4091-b40e-1eddae0876df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:15.982065 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1314/2640] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 11:40:15 2022] DELETE /identity/v3/projects/2c296dcf87b04d47b70fbcfb3475a26e => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:40:15.985378 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ca8d3d-6f7e-4754-b593-b9d066c646e9 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:15.988150 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ca8d3d-6f7e-4754-b593-b9d066c646e9 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:15.988785 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ca8d3d-6f7e-4754-b593-b9d066c646e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:16.054251 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-86ca8d3d-6f7e-4754-b593-b9d066c646e9 None None] MFA Rules not processed for user `5669356d12cf4c9fa4ca56b001ee0452`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:40:16.056070 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-86ca8d3d-6f7e-4754-b593-b9d066c646e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:16.096771 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf892c1-8b0b-47b7-afc1-665f24459c01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:16.097563 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf892c1-8b0b-47b7-afc1-665f24459c01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:16.098007 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf892c1-8b0b-47b7-afc1-665f24459c01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:16.098309 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf892c1-8b0b-47b7-afc1-665f24459c01 admin admin] PATH_INFO: `/v3/projects/1df16f22d7ab46dab17aff9c5350dcf7` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:16.105249 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf892c1-8b0b-47b7-afc1-665f24459c01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1df16f22d7ab46dab17aff9c5350dcf7)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:16.109223 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf892c1-8b0b-47b7-afc1-665f24459c01 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:16.213750 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1315/2641] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:40:15 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:40:16.214859 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ca8d3d-6f7e-4754-b593-b9d066c646e9 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:16.218783 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-86ca8d3d-6f7e-4754-b593-b9d066c646e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:16.239750 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-bbf892c1-8b0b-47b7-afc1-665f24459c01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1df16f22d7ab46dab17aff9c5350dcf7', 'request_id': 'req-bbf892c1-8b0b-47b7-afc1-665f24459c01'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:16.258739 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-bbf892c1-8b0b-47b7-afc1-665f24459c01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1df16f22d7ab46dab17aff9c5350dcf7', 'request_id': 'req-bbf892c1-8b0b-47b7-afc1-665f24459c01'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:16.268688 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ca8d3d-6f7e-4754-b593-b9d066c646e9 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:16.273838 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-bbf892c1-8b0b-47b7-afc1-665f24459c01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1df16f22d7ab46dab17aff9c5350dcf7', 'request_id': 'req-bbf892c1-8b0b-47b7-afc1-665f24459c01'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:16.277664 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:40:16.303295 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-bbf892c1-8b0b-47b7-afc1-665f24459c01 admin admin] The token cache is being invalidate because project 1df16f22d7ab46dab17aff9c5350dcf7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81501) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:40:16.304175 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-bbf892c1-8b0b-47b7-afc1-665f24459c01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:16.305223 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-bbf892c1-8b0b-47b7-afc1-665f24459c01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:16.307474 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1327/2642] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 11:40:15 2022] DELETE /identity/v3/projects/1df16f22d7ab46dab17aff9c5350dcf7 => generated 0 bytes in 644 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:40:16.308454 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf892c1-8b0b-47b7-afc1-665f24459c01 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:16.311693 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-bbf892c1-8b0b-47b7-afc1-665f24459c01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:16.342561 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:40:16.389335 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bb8bea-d441-425d-8c34-4e1668fe0b06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:16.390116 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bb8bea-d441-425d-8c34-4e1668fe0b06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:16.390429 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bb8bea-d441-425d-8c34-4e1668fe0b06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:16.390842 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bb8bea-d441-425d-8c34-4e1668fe0b06 admin admin] PATH_INFO: `/v3/users/bf8f4a499e004bff910fc4b8ec625f44` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:16.392736 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bb8bea-d441-425d-8c34-4e1668fe0b06 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf8f4a499e004bff910fc4b8ec625f44)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:16.395726 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bb8bea-d441-425d-8c34-4e1668fe0b06 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:16.424192 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf892c1-8b0b-47b7-afc1-665f24459c01 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:16.430507 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719636ef-044a-49ec-b74a-072e366cb63e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:16.431486 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719636ef-044a-49ec-b74a-072e366cb63e admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:16.432594 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719636ef-044a-49ec-b74a-072e366cb63e admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:16.433650 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719636ef-044a-49ec-b74a-072e366cb63e admin admin] PATH_INFO: `/v3/projects` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:16.434758 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719636ef-044a-49ec-b74a-072e366cb63e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:16.437522 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719636ef-044a-49ec-b74a-072e366cb63e admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:16.474710 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1328/2643] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 11:40:16 2022] POST /identity/v3/projects => generated 403 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:40:16.475478 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-61bb8bea-d441-425d-8c34-4e1668fe0b06 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf8f4a499e004bff910fc4b8ec625f44'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:16.476254 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64c2622-893f-4615-82c1-f96b67712625 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:16.476570 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-61bb8bea-d441-425d-8c34-4e1668fe0b06 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf8f4a499e004bff910fc4b8ec625f44'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:16.476713 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64c2622-893f-4615-82c1-f96b67712625 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:16.476980 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64c2622-893f-4615-82c1-f96b67712625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:16.499823 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-61bb8bea-d441-425d-8c34-4e1668fe0b06 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf8f4a499e004bff910fc4b8ec625f44'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:16.503916 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-e64c2622-893f-4615-82c1-f96b67712625 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:40:16.505183 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-e64c2622-893f-4615-82c1-f96b67712625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:16.508865 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-61bb8bea-d441-425d-8c34-4e1668fe0b06 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf8f4a499e004bff910fc4b8ec625f44'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:16.509603 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-61bb8bea-d441-425d-8c34-4e1668fe0b06 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf8f4a499e004bff910fc4b8ec625f44'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:16.534904 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1316/2644] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 11:40:16 2022] DELETE /identity/v3/users/bf8f4a499e004bff910fc4b8ec625f44 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:40:16.534904 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bb8bea-d441-425d-8c34-4e1668fe0b06 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:16.534904 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-61bb8bea-d441-425d-8c34-4e1668fe0b06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:16.606534 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1329/2645] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:40:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:40:16.632925 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b87648-2ccb-4446-9a2b-f6938fbf00bf None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:16.633235 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bb8bea-d441-425d-8c34-4e1668fe0b06 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:16.633778 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b87648-2ccb-4446-9a2b-f6938fbf00bf None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:16.634426 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b87648-2ccb-4446-9a2b-f6938fbf00bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:16.639791 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e225773-e581-4ec3-b8f9-1d6252b66ad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:16.640568 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e225773-e581-4ec3-b8f9-1d6252b66ad7 admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:16.640878 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e225773-e581-4ec3-b8f9-1d6252b66ad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:16.641325 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e225773-e581-4ec3-b8f9-1d6252b66ad7 admin admin] PATH_INFO: `/v3/users` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:16.642444 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e225773-e581-4ec3-b8f9-1d6252b66ad7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:16.645074 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e225773-e581-4ec3-b8f9-1d6252b66ad7 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:16.668400 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-01b87648-2ccb-4446-9a2b-f6938fbf00bf None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:40:16.670221 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-01b87648-2ccb-4446-9a2b-f6938fbf00bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:16.679771 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1317/2646] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 11:40:16 2022] POST /identity/v3/users => generated 308 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:40:16.681225 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e225773-e581-4ec3-b8f9-1d6252b66ad7 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:16.690926 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1330/2647] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:40:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:40:16.691959 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b87648-2ccb-4446-9a2b-f6938fbf00bf None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:16.703640 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e225773-e581-4ec3-b8f9-1d6252b66ad7 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:16.710648 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b87648-2ccb-4446-9a2b-f6938fbf00bf None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:16.716418 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b903335a-af3e-4265-9e86-0020ebba2a0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:16.716638 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b903335a-af3e-4265-9e86-0020ebba2a0d admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:16.716897 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b903335a-af3e-4265-9e86-0020ebba2a0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:16.717168 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b903335a-af3e-4265-9e86-0020ebba2a0d admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:16.717830 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b903335a-af3e-4265-9e86-0020ebba2a0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:16.722145 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b903335a-af3e-4265-9e86-0020ebba2a0d admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:16.724286 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf666ff-26bc-40d9-8b72-124ba242de9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:16.725083 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf666ff-26bc-40d9-8b72-124ba242de9c admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:16.725244 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf666ff-26bc-40d9-8b72-124ba242de9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:16.725432 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf666ff-26bc-40d9-8b72-124ba242de9c admin admin] PATH_INFO: `/v3/domains` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:16.726109 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf666ff-26bc-40d9-8b72-124ba242de9c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:40:16.726432 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf666ff-26bc-40d9-8b72-124ba242de9c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:16.730416 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf666ff-26bc-40d9-8b72-124ba242de9c admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:16.748662 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1318/2648] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:40:16 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:40:16.753961 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b903335a-af3e-4265-9e86-0020ebba2a0d admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:16.757668 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1331/2649] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 24 11:40:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:40:16.767355 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf666ff-26bc-40d9-8b72-124ba242de9c admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:16.769868 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:40:16.779749 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b903335a-af3e-4265-9e86-0020ebba2a0d admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:16.785527 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf666ff-26bc-40d9-8b72-124ba242de9c admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:16.787226 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b878feaa-d3a8-4429-972a-8c6d19198062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:16.788145 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b878feaa-d3a8-4429-972a-8c6d19198062 admin admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:16.788516 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b878feaa-d3a8-4429-972a-8c6d19198062 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:16.788886 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b878feaa-d3a8-4429-972a-8c6d19198062 admin admin] PATH_INFO: `/v3/projects/f98b6fa95349462eb25f153821ad2495/users/63662bc83c1b423e9d6e25d14f2140bf/roles/30bb1e97257f4ca5b90c88545777317b` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:16.793474 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdbb9f2-8a44-41b4-9a50-4260fe8baa45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:16.794249 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdbb9f2-8a44-41b4-9a50-4260fe8baa45 admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:16.794585 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdbb9f2-8a44-41b4-9a50-4260fe8baa45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:16.794843 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdbb9f2-8a44-41b4-9a50-4260fe8baa45 admin admin] PATH_INFO: `/v3/projects` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:16.795545 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdbb9f2-8a44-41b4-9a50-4260fe8baa45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:16.797824 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdbb9f2-8a44-41b4-9a50-4260fe8baa45 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:16.810302 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b878feaa-d3a8-4429-972a-8c6d19198062 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f98b6fa95349462eb25f153821ad2495, user_id=63662bc83c1b423e9d6e25d14f2140bf, role_id=30bb1e97257f4ca5b90c88545777317b)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:16.814555 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b878feaa-d3a8-4429-972a-8c6d19198062 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:16.838025 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1332/2650] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 11:40:16 2022] POST /identity/v3/projects => generated 371 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:40:16.839373 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdbb9f2-8a44-41b4-9a50-4260fe8baa45 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:16.847391 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1319/2651] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 11:40:16 2022] PUT /identity/v3/projects/f98b6fa95349462eb25f153821ad2495/users/63662bc83c1b423e9d6e25d14f2140bf/roles/30bb1e97257f4ca5b90c88545777317b => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:40:16.851200 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b878feaa-d3a8-4429-972a-8c6d19198062 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:16.991486 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdbb9f2-8a44-41b4-9a50-4260fe8baa45 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:17.005763 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bafd0b3-444d-4f73-9644-89a07c358668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:17.006421 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bafd0b3-444d-4f73-9644-89a07c358668 admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:17.006706 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bafd0b3-444d-4f73-9644-89a07c358668 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:17.006976 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bafd0b3-444d-4f73-9644-89a07c358668 admin admin] PATH_INFO: `/v3/users` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:17.011323 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bafd0b3-444d-4f73-9644-89a07c358668 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:17.014314 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bafd0b3-444d-4f73-9644-89a07c358668 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:17.023731 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:40:17.048346 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1333/2652] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 11:40:16 2022] POST /identity/v3/users => generated 286 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:40:17.053282 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bafd0b3-444d-4f73-9644-89a07c358668 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:17.062790 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b878feaa-d3a8-4429-972a-8c6d19198062 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:17.069691 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c261b2c-d265-426b-be68-7ce4c542751e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:17.070434 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c261b2c-d265-426b-be68-7ce4c542751e admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:17.070762 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c261b2c-d265-426b-be68-7ce4c542751e admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:17.071139 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c261b2c-d265-426b-be68-7ce4c542751e admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:17.071899 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c261b2c-d265-426b-be68-7ce4c542751e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:17.073675 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c261b2c-d265-426b-be68-7ce4c542751e admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:17.076286 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bafd0b3-444d-4f73-9644-89a07c358668 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:17.086495 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a6a77b-b3fa-4381-bcde-8e86e6426b3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:17.087139 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a6a77b-b3fa-4381-bcde-8e86e6426b3f admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:17.089107 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a6a77b-b3fa-4381-bcde-8e86e6426b3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:17.089930 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a6a77b-b3fa-4381-bcde-8e86e6426b3f admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:17.090657 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a6a77b-b3fa-4381-bcde-8e86e6426b3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:17.094979 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a6a77b-b3fa-4381-bcde-8e86e6426b3f admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:17.120879 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1320/2653] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:40:16 2022] GET /identity/v3/roles => generated 1420 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:40:17.126663 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c261b2c-d265-426b-be68-7ce4c542751e admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:17.131189 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1334/2654] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:40:17 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:40:17.135477 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a6a77b-b3fa-4381-bcde-8e86e6426b3f admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:17.154891 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a6a77b-b3fa-4381-bcde-8e86e6426b3f admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:17.157244 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c261b2c-d265-426b-be68-7ce4c542751e admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:17.166579 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeb48cc-d741-4773-b385-b43c56b84753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:17.167585 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeb48cc-d741-4773-b385-b43c56b84753 admin admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:17.167905 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeb48cc-d741-4773-b385-b43c56b84753 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:17.168179 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeb48cc-d741-4773-b385-b43c56b84753 admin admin] PATH_INFO: `/v3/projects/f98b6fa95349462eb25f153821ad2495/users/63662bc83c1b423e9d6e25d14f2140bf/roles/30bb1e97257f4ca5b90c88545777317b` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:17.172321 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edeb48cc-d741-4773-b385-b43c56b84753 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f98b6fa95349462eb25f153821ad2495, user_id=63662bc83c1b423e9d6e25d14f2140bf, role_id=30bb1e97257f4ca5b90c88545777317b)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:17.177914 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edeb48cc-d741-4773-b385-b43c56b84753 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:17.179216 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb2d8cd-0f0f-4559-8892-5fd67fb151da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:17.182841 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb2d8cd-0f0f-4559-8892-5fd67fb151da admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:17.183316 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb2d8cd-0f0f-4559-8892-5fd67fb151da admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:17.183599 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb2d8cd-0f0f-4559-8892-5fd67fb151da admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:17.187046 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb2d8cd-0f0f-4559-8892-5fd67fb151da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:17.190130 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb2d8cd-0f0f-4559-8892-5fd67fb151da admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:17.221148 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1321/2655] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 11:40:17 2022] PUT /identity/v3/projects/f98b6fa95349462eb25f153821ad2495/users/63662bc83c1b423e9d6e25d14f2140bf/roles/30bb1e97257f4ca5b90c88545777317b => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:40:17.222203 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeb48cc-d741-4773-b385-b43c56b84753 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:17.232147 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-edeb48cc-d741-4773-b385-b43c56b84753 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:17.232580 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1335/2656] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:40:17 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:40:17.233790 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb2d8cd-0f0f-4559-8892-5fd67fb151da admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:17.278634 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb2d8cd-0f0f-4559-8892-5fd67fb151da admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:17.408371 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeb48cc-d741-4773-b385-b43c56b84753 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:17.419371 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae581c9-3b2a-4795-b1bf-749669650c14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:17.420501 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae581c9-3b2a-4795-b1bf-749669650c14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:17.421747 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae581c9-3b2a-4795-b1bf-749669650c14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:17.422238 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae581c9-3b2a-4795-b1bf-749669650c14 admin admin] PATH_INFO: `/v3/projects/21202cdea4804084ad8247c1e75bc99d` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:17.424590 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae581c9-3b2a-4795-b1bf-749669650c14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=21202cdea4804084ad8247c1e75bc99d)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:17.427999 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae581c9-3b2a-4795-b1bf-749669650c14 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:17.459065 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc68097-03b5-4246-b48b-271bb03b21eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:17.459891 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc68097-03b5-4246-b48b-271bb03b21eb admin admin] REQUEST_METHOD: `PUT` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:17.460285 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc68097-03b5-4246-b48b-271bb03b21eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:17.460731 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc68097-03b5-4246-b48b-271bb03b21eb admin admin] PATH_INFO: `/v3/projects/540eac0603544e23a7162f9fa4cfba64/users/7edc193cb731428eb7ea947aa9e96b7c/roles/27e3e65e24df4b86b0d3d18d3212101d` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:17.496563 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc68097-03b5-4246-b48b-271bb03b21eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=540eac0603544e23a7162f9fa4cfba64, user_id=7edc193cb731428eb7ea947aa9e96b7c, role_id=27e3e65e24df4b86b0d3d18d3212101d)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:17.499572 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc68097-03b5-4246-b48b-271bb03b21eb admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:17.509408 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-9ae581c9-3b2a-4795-b1bf-749669650c14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21202cdea4804084ad8247c1e75bc99d', 'request_id': 'req-9ae581c9-3b2a-4795-b1bf-749669650c14'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:17.520351 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-9ae581c9-3b2a-4795-b1bf-749669650c14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21202cdea4804084ad8247c1e75bc99d', 'request_id': 'req-9ae581c9-3b2a-4795-b1bf-749669650c14'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:17.530795 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-9ae581c9-3b2a-4795-b1bf-749669650c14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21202cdea4804084ad8247c1e75bc99d', 'request_id': 'req-9ae581c9-3b2a-4795-b1bf-749669650c14'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:17.534269 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:40:17.534474 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1336/2657] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 11:40:17 2022] PUT /identity/v3/projects/540eac0603544e23a7162f9fa4cfba64/users/7edc193cb731428eb7ea947aa9e96b7c/roles/27e3e65e24df4b86b0d3d18d3212101d => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:40:17.536170 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66191198-a103-430f-9b6e-1a9c597c8002 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:17.536424 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66191198-a103-430f-9b6e-1a9c597c8002 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:17.536704 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66191198-a103-430f-9b6e-1a9c597c8002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:17.567175 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-9ae581c9-3b2a-4795-b1bf-749669650c14 admin admin] The token cache is being invalidate because project 21202cdea4804084ad8247c1e75bc99d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:40:17.567781 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-9ae581c9-3b2a-4795-b1bf-749669650c14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:17.568465 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-9ae581c9-3b2a-4795-b1bf-749669650c14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:17.584440 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1322/2658] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 11:40:17 2022] DELETE /identity/v3/projects/21202cdea4804084ad8247c1e75bc99d => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:40:17.586276 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307b72d5-10ef-440f-8856-5d9c611c6709 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:17.586636 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307b72d5-10ef-440f-8856-5d9c611c6709 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:17.587081 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307b72d5-10ef-440f-8856-5d9c611c6709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:17.604065 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-66191198-a103-430f-9b6e-1a9c597c8002 None None] MFA Rules not processed for user `7edc193cb731428eb7ea947aa9e96b7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:40:17.605444 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-66191198-a103-430f-9b6e-1a9c597c8002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:17.630083 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-307b72d5-10ef-440f-8856-5d9c611c6709 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:40:17.631818 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-307b72d5-10ef-440f-8856-5d9c611c6709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:17.751484 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1337/2659] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:40:17 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:40:17.756999 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66191198-a103-430f-9b6e-1a9c597c8002 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:17.759200 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-66191198-a103-430f-9b6e-1a9c597c8002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:17.792977 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1323/2660] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:40:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:40:17.798538 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29a19c1-694e-4aad-93d6-4317ddcda31a None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:17.798538 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29a19c1-694e-4aad-93d6-4317ddcda31a None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:17.798538 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29a19c1-694e-4aad-93d6-4317ddcda31a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:17.819660 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66191198-a103-430f-9b6e-1a9c597c8002 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:17.838554 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabb6c93-64c0-4a61-9e13-5646477ba562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:17.839268 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabb6c93-64c0-4a61-9e13-5646477ba562 admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:17.839535 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabb6c93-64c0-4a61-9e13-5646477ba562 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:17.840637 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabb6c93-64c0-4a61-9e13-5646477ba562 admin admin] PATH_INFO: `/v3/projects` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:17.841198 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-b29a19c1-694e-4aad-93d6-4317ddcda31a None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:40:17.841338 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabb6c93-64c0-4a61-9e13-5646477ba562 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:17.843482 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabb6c93-64c0-4a61-9e13-5646477ba562 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:17.846220 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-b29a19c1-694e-4aad-93d6-4317ddcda31a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:17.869000 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1324/2661] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:40:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:40:17.876120 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29a19c1-694e-4aad-93d6-4317ddcda31a None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:17.896567 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29a19c1-694e-4aad-93d6-4317ddcda31a None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:17.904379 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca77a25-b4f5-40ff-8e18-b8039ee0d748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:17.905333 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca77a25-b4f5-40ff-8e18-b8039ee0d748 admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:17.905834 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca77a25-b4f5-40ff-8e18-b8039ee0d748 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:17.907002 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca77a25-b4f5-40ff-8e18-b8039ee0d748 admin admin] PATH_INFO: `/v3/domains` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:17.907869 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca77a25-b4f5-40ff-8e18-b8039ee0d748 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:40:17.908364 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca77a25-b4f5-40ff-8e18-b8039ee0d748 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:17.910447 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca77a25-b4f5-40ff-8e18-b8039ee0d748 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:17.913674 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1338/2662] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 11:40:17 2022] POST /identity/v3/projects => generated 371 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:40:17.915625 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabb6c93-64c0-4a61-9e13-5646477ba562 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:17.929340 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1325/2663] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 24 11:40:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:40:17.933678 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca77a25-b4f5-40ff-8e18-b8039ee0d748 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:17.948558 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca77a25-b4f5-40ff-8e18-b8039ee0d748 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:17.966588 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:40:18.046870 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007ad7ba-8101-4f51-82af-08aa291895ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:18.047666 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007ad7ba-8101-4f51-82af-08aa291895ed admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:18.047781 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007ad7ba-8101-4f51-82af-08aa291895ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:18.048070 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007ad7ba-8101-4f51-82af-08aa291895ed admin admin] PATH_INFO: `/v3/projects` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:18.048698 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007ad7ba-8101-4f51-82af-08aa291895ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:18.050776 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007ad7ba-8101-4f51-82af-08aa291895ed admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:18.059789 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabb6c93-64c0-4a61-9e13-5646477ba562 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:18.065781 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374d9809-4fd9-401e-a6d1-708b5cfa8fc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:18.066772 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374d9809-4fd9-401e-a6d1-708b5cfa8fc8 admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:18.067058 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374d9809-4fd9-401e-a6d1-708b5cfa8fc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:18.067378 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374d9809-4fd9-401e-a6d1-708b5cfa8fc8 admin admin] PATH_INFO: `/v3/users` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:18.068397 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374d9809-4fd9-401e-a6d1-708b5cfa8fc8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:18.070502 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374d9809-4fd9-401e-a6d1-708b5cfa8fc8 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:18.103111 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1339/2664] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 11:40:17 2022] POST /identity/v3/users => generated 292 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:40:18.103111 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374d9809-4fd9-401e-a6d1-708b5cfa8fc8 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:18.117676 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374d9809-4fd9-401e-a6d1-708b5cfa8fc8 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:18.136418 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f4e8f8-957c-4b80-9044-e7003c95afb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:18.137354 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f4e8f8-957c-4b80-9044-e7003c95afb4 admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:18.137797 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f4e8f8-957c-4b80-9044-e7003c95afb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:18.138227 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f4e8f8-957c-4b80-9044-e7003c95afb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:18.139068 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f4e8f8-957c-4b80-9044-e7003c95afb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:18.141654 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f4e8f8-957c-4b80-9044-e7003c95afb4 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:18.150670 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1326/2665] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 11:40:17 2022] POST /identity/v3/projects => generated 383 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:40:18.151652 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007ad7ba-8101-4f51-82af-08aa291895ed admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:18.170435 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1340/2666] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:40:18 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:40:18.171659 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f4e8f8-957c-4b80-9044-e7003c95afb4 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:18.192386 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f4e8f8-957c-4b80-9044-e7003c95afb4 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:18.254936 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f9718f-c446-44c9-86c2-877faf6a7a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:18.255982 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f9718f-c446-44c9-86c2-877faf6a7a00 admin admin] REQUEST_METHOD: `PUT` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:18.256422 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f9718f-c446-44c9-86c2-877faf6a7a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:18.256871 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f9718f-c446-44c9-86c2-877faf6a7a00 admin admin] PATH_INFO: `/v3/projects/7f9e726708464f7fbaf0fb094613386e/users/96e992091adb41989fb12fa03f8d2372/roles/30bb1e97257f4ca5b90c88545777317b` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:18.291121 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f9718f-c446-44c9-86c2-877faf6a7a00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f9e726708464f7fbaf0fb094613386e, user_id=96e992091adb41989fb12fa03f8d2372, role_id=30bb1e97257f4ca5b90c88545777317b)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:18.291121 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f9718f-c446-44c9-86c2-877faf6a7a00 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:18.310695 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1341/2667] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 11:40:18 2022] PUT /identity/v3/projects/7f9e726708464f7fbaf0fb094613386e/users/96e992091adb41989fb12fa03f8d2372/roles/30bb1e97257f4ca5b90c88545777317b => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:40:18.314791 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f9718f-c446-44c9-86c2-877faf6a7a00 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:18.317910 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007ad7ba-8101-4f51-82af-08aa291895ed admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:18.326767 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:40:18.452168 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f9718f-c446-44c9-86c2-877faf6a7a00 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:18.457549 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315a11f6-c830-4a75-8ad3-c1a04bae9be8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:18.458164 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315a11f6-c830-4a75-8ad3-c1a04bae9be8 admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:18.458479 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315a11f6-c830-4a75-8ad3-c1a04bae9be8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:18.458772 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315a11f6-c830-4a75-8ad3-c1a04bae9be8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:18.459594 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315a11f6-c830-4a75-8ad3-c1a04bae9be8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:18.461244 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315a11f6-c830-4a75-8ad3-c1a04bae9be8 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:18.475438 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1342/2668] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:40:18 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:40:18.479891 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315a11f6-c830-4a75-8ad3-c1a04bae9be8 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:18.482575 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c58a8af-37b5-4939-9dd2-78799ae58167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:18.483521 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c58a8af-37b5-4939-9dd2-78799ae58167 admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:18.483992 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c58a8af-37b5-4939-9dd2-78799ae58167 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:18.484452 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c58a8af-37b5-4939-9dd2-78799ae58167 admin admin] PATH_INFO: `/v3/users` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:18.485271 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c58a8af-37b5-4939-9dd2-78799ae58167 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:18.492462 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c58a8af-37b5-4939-9dd2-78799ae58167 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:18.498325 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315a11f6-c830-4a75-8ad3-c1a04bae9be8 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:18.507617 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb23c354-c920-4321-b1e0-fe91e9bb50cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:18.508699 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb23c354-c920-4321-b1e0-fe91e9bb50cf admin admin] REQUEST_METHOD: `PUT` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:18.508977 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb23c354-c920-4321-b1e0-fe91e9bb50cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:18.509297 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb23c354-c920-4321-b1e0-fe91e9bb50cf admin admin] PATH_INFO: `/v3/projects/7f9e726708464f7fbaf0fb094613386e/users/96e992091adb41989fb12fa03f8d2372/roles/30bb1e97257f4ca5b90c88545777317b` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:18.512222 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb23c354-c920-4321-b1e0-fe91e9bb50cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f9e726708464f7fbaf0fb094613386e, user_id=96e992091adb41989fb12fa03f8d2372, role_id=30bb1e97257f4ca5b90c88545777317b)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:18.516375 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb23c354-c920-4321-b1e0-fe91e9bb50cf admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:18.533451 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1343/2669] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 11:40:18 2022] PUT /identity/v3/projects/7f9e726708464f7fbaf0fb094613386e/users/96e992091adb41989fb12fa03f8d2372/roles/30bb1e97257f4ca5b90c88545777317b => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 11:40:18.544087 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1327/2670] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 11:40:18 2022] POST /identity/v3/users => generated 292 bytes in 393 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:40:18.547690 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f29f22d-4a35-4eb6-b867-3e176017a617 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:18.548051 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f29f22d-4a35-4eb6-b867-3e176017a617 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:18.548307 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c58a8af-37b5-4939-9dd2-78799ae58167 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:18.548456 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f29f22d-4a35-4eb6-b867-3e176017a617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:18.557471 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:40:18.576527 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c58a8af-37b5-4939-9dd2-78799ae58167 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:18.587310 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-5f29f22d-4a35-4eb6-b867-3e176017a617 None None] MFA Rules not processed for user `96e992091adb41989fb12fa03f8d2372`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:40:18.589156 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-5f29f22d-4a35-4eb6-b867-3e176017a617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:18.649397 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e8aa35-89ab-449e-b8f1-7a8d713a3d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:18.649760 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e8aa35-89ab-449e-b8f1-7a8d713a3d7b admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:18.650167 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e8aa35-89ab-449e-b8f1-7a8d713a3d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:18.650557 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e8aa35-89ab-449e-b8f1-7a8d713a3d7b admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:18.651323 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e8aa35-89ab-449e-b8f1-7a8d713a3d7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:18.653145 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e8aa35-89ab-449e-b8f1-7a8d713a3d7b admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:18.668711 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1328/2671] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:40:18 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:40:18.669915 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e8aa35-89ab-449e-b8f1-7a8d713a3d7b admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:18.681950 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e8aa35-89ab-449e-b8f1-7a8d713a3d7b admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:18.688688 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a73af6f-0e11-4d50-b98e-7b05952c61d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:18.689713 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a73af6f-0e11-4d50-b98e-7b05952c61d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:18.690105 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a73af6f-0e11-4d50-b98e-7b05952c61d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:18.690634 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a73af6f-0e11-4d50-b98e-7b05952c61d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:18.692203 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a73af6f-0e11-4d50-b98e-7b05952c61d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:18.694997 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a73af6f-0e11-4d50-b98e-7b05952c61d4 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:18.696402 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1344/2672] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:40:18 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 11:40:18.713984 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f29f22d-4a35-4eb6-b867-3e176017a617 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:18.717212 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1329/2673] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:40:18 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:40:18.720428 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a73af6f-0e11-4d50-b98e-7b05952c61d4 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:18.726002 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-5f29f22d-4a35-4eb6-b867-3e176017a617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:18.749017 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a73af6f-0e11-4d50-b98e-7b05952c61d4 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:18.755774 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5deaf53f-f97e-4097-95be-dd819debd40b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:18.756810 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deaf53f-f97e-4097-95be-dd819debd40b admin admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:18.756942 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deaf53f-f97e-4097-95be-dd819debd40b admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:18.757235 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deaf53f-f97e-4097-95be-dd819debd40b admin admin] PATH_INFO: `/v3/projects/4b08bee85a404bcbb1ff469010842a14/users/9389138484e146de803be70e0a00efb7/roles/27e3e65e24df4b86b0d3d18d3212101d` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:18.789940 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5deaf53f-f97e-4097-95be-dd819debd40b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b08bee85a404bcbb1ff469010842a14, user_id=9389138484e146de803be70e0a00efb7, role_id=27e3e65e24df4b86b0d3d18d3212101d)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:18.797172 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5deaf53f-f97e-4097-95be-dd819debd40b admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:18.828695 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1330/2674] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 11:40:18 2022] PUT /identity/v3/projects/4b08bee85a404bcbb1ff469010842a14/users/9389138484e146de803be70e0a00efb7/roles/27e3e65e24df4b86b0d3d18d3212101d => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:40:18.828695 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da721ec-fde0-49fa-8ca5-142d773da1cc None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:18.828695 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da721ec-fde0-49fa-8ca5-142d773da1cc None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:18.828695 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da721ec-fde0-49fa-8ca5-142d773da1cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:18.880551 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f29f22d-4a35-4eb6-b867-3e176017a617 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:18.895416 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-7da721ec-fde0-49fa-8ca5-142d773da1cc None None] MFA Rules not processed for user `63662bc83c1b423e9d6e25d14f2140bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:40:18.896745 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-7da721ec-fde0-49fa-8ca5-142d773da1cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:18.965150 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c2be7c-6fa1-4cc1-b1de-5d89e84d0f5c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92862b76ba3b4513b5dc5b5c962faac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:18.965948 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c2be7c-6fa1-4cc1-b1de-5d89e84d0f5c service cinder] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:18.966226 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c2be7c-6fa1-4cc1-b1de-5d89e84d0f5c service cinder] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:18.966541 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c2be7c-6fa1-4cc1-b1de-5d89e84d0f5c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:19.007469 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:40:19.043782 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1331/2675] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:40:18 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:40:19.043782 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5483ef-dc16-480f-a4e4-a66fb63f0385 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:19.043782 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5483ef-dc16-480f-a4e4-a66fb63f0385 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:19.043782 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5483ef-dc16-480f-a4e4-a66fb63f0385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:19.066660 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:40:19.077566 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c2be7c-6fa1-4cc1-b1de-5d89e84d0f5c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:19.079212 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c2be7c-6fa1-4cc1-b1de-5d89e84d0f5c service cinder] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:19.110233 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-4d5483ef-dc16-480f-a4e4-a66fb63f0385 None None] MFA Rules not processed for user `9389138484e146de803be70e0a00efb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:40:19.113870 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-4d5483ef-dc16-480f-a4e4-a66fb63f0385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:19.116381 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1345/2676] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:40:18 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:40:19.243292 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1332/2677] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:40:19 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:40:19.248732 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c2be7c-6fa1-4cc1-b1de-5d89e84d0f5c service cinder] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:19.268392 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5483ef-dc16-480f-a4e4-a66fb63f0385 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:19.286347 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5483ef-dc16-480f-a4e4-a66fb63f0385 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:19.291670 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624b84d0-80fa-4e75-a41b-1443409574cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92862b76ba3b4513b5dc5b5c962faac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:19.292299 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624b84d0-80fa-4e75-a41b-1443409574cb service cinder] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:19.292579 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624b84d0-80fa-4e75-a41b-1443409574cb service cinder] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:19.292855 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624b84d0-80fa-4e75-a41b-1443409574cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:19.406380 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c2be7c-6fa1-4cc1-b1de-5d89e84d0f5c service cinder] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:19.421063 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dc67f5-2513-4217-be67-d813070bfd67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:19.421702 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dc67f5-2513-4217-be67-d813070bfd67 admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:19.421980 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dc67f5-2513-4217-be67-d813070bfd67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:19.422250 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dc67f5-2513-4217-be67-d813070bfd67 admin admin] PATH_INFO: `/v3/projects` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:19.427454 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dc67f5-2513-4217-be67-d813070bfd67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:19.430697 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624b84d0-80fa-4e75-a41b-1443409574cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:19.432170 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624b84d0-80fa-4e75-a41b-1443409574cb service cinder] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:19.433331 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dc67f5-2513-4217-be67-d813070bfd67 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:19.452281 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1333/2678] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:40:19 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 11:40:19.530760 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1346/2679] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 11:40:19 2022] POST /identity/v3/projects => generated 387 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 11:40:19.533215 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624b84d0-80fa-4e75-a41b-1443409574cb service cinder] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:19.549094 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624b84d0-80fa-4e75-a41b-1443409574cb service cinder] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:19.686094 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9ccd75-ac99-4487-bb21-6fde272e9b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:19.688064 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9ccd75-ac99-4487-bb21-6fde272e9b22 admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:19.688337 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9ccd75-ac99-4487-bb21-6fde272e9b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:19.688615 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9ccd75-ac99-4487-bb21-6fde272e9b22 admin admin] PATH_INFO: `/v3/users` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:19.689348 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9ccd75-ac99-4487-bb21-6fde272e9b22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:19.692499 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9ccd75-ac99-4487-bb21-6fde272e9b22 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:19.716181 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:40:19.727279 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1334/2680] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 11:40:19 2022] POST /identity/v3/users => generated 300 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:40:19.728294 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dc67f5-2513-4217-be67-d813070bfd67 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:19.749578 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dc67f5-2513-4217-be67-d813070bfd67 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:19.758776 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3592ccd-bc1a-492f-9d55-03954af78a43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:19.759457 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3592ccd-bc1a-492f-9d55-03954af78a43 admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:19.759732 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3592ccd-bc1a-492f-9d55-03954af78a43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:19.761853 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3592ccd-bc1a-492f-9d55-03954af78a43 admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:19.762620 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3592ccd-bc1a-492f-9d55-03954af78a43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:19.764695 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3592ccd-bc1a-492f-9d55-03954af78a43 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:19.784154 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1347/2681] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:40:19 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 11:40:19.788580 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9ccd75-ac99-4487-bb21-6fde272e9b22 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:19.805494 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9ccd75-ac99-4487-bb21-6fde272e9b22 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:19.812599 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f9dfe7-0ad3-4fef-a4cd-c727cdb8fd17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:19.813519 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f9dfe7-0ad3-4fef-a4cd-c727cdb8fd17 admin admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:19.813792 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f9dfe7-0ad3-4fef-a4cd-c727cdb8fd17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:19.814075 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f9dfe7-0ad3-4fef-a4cd-c727cdb8fd17 admin admin] PATH_INFO: `/v3/projects/095706efa4ea4cd5990677d69ea87d4f/users/03f1cd9ff0114c438071ec82aee760ab/roles/30bb1e97257f4ca5b90c88545777317b` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:19.838037 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f9dfe7-0ad3-4fef-a4cd-c727cdb8fd17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=095706efa4ea4cd5990677d69ea87d4f, user_id=03f1cd9ff0114c438071ec82aee760ab, role_id=30bb1e97257f4ca5b90c88545777317b)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:19.841751 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f9dfe7-0ad3-4fef-a4cd-c727cdb8fd17 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:19.872248 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3592ccd-bc1a-492f-9d55-03954af78a43 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:19.872816 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1335/2682] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 11:40:19 2022] PUT /identity/v3/projects/095706efa4ea4cd5990677d69ea87d4f/users/03f1cd9ff0114c438071ec82aee760ab/roles/30bb1e97257f4ca5b90c88545777317b => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:40:19.886924 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3592ccd-bc1a-492f-9d55-03954af78a43 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:19.971898 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16b9eea-83bb-4234-81b9-7b3416900c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:19.972818 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16b9eea-83bb-4234-81b9-7b3416900c7d admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:19.973173 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16b9eea-83bb-4234-81b9-7b3416900c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:19.973515 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16b9eea-83bb-4234-81b9-7b3416900c7d admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:19.974249 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16b9eea-83bb-4234-81b9-7b3416900c7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:19.976194 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16b9eea-83bb-4234-81b9-7b3416900c7d admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:20.004655 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f9dfe7-0ad3-4fef-a4cd-c727cdb8fd17 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:20.016958 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1348/2683] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:40:19 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:40:20.023147 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f9dfe7-0ad3-4fef-a4cd-c727cdb8fd17 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:20.028723 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e339adfa-47d4-4f8e-8637-c132ac071004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:20.029568 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e339adfa-47d4-4f8e-8637-c132ac071004 admin admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:20.029970 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e339adfa-47d4-4f8e-8637-c132ac071004 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:20.030345 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e339adfa-47d4-4f8e-8637-c132ac071004 admin admin] PATH_INFO: `/v3/projects/095706efa4ea4cd5990677d69ea87d4f/users/03f1cd9ff0114c438071ec82aee760ab/roles/30bb1e97257f4ca5b90c88545777317b` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:20.032729 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e339adfa-47d4-4f8e-8637-c132ac071004 admin admin] RBAC: Authorizing `identity:create_grant(project_id=095706efa4ea4cd5990677d69ea87d4f, user_id=03f1cd9ff0114c438071ec82aee760ab, role_id=30bb1e97257f4ca5b90c88545777317b)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:20.036383 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e339adfa-47d4-4f8e-8637-c132ac071004 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:20.054394 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1336/2684] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 11:40:20 2022] PUT /identity/v3/projects/095706efa4ea4cd5990677d69ea87d4f/users/03f1cd9ff0114c438071ec82aee760ab/roles/30bb1e97257f4ca5b90c88545777317b => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 11:40:20.062846 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d58784-5750-42b0-9df6-952009ae0f1b None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:20.063150 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d58784-5750-42b0-9df6-952009ae0f1b None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:20.063481 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d58784-5750-42b0-9df6-952009ae0f1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:20.131495 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-31d58784-5750-42b0-9df6-952009ae0f1b None None] MFA Rules not processed for user `03f1cd9ff0114c438071ec82aee760ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:40:20.142171 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-31d58784-5750-42b0-9df6-952009ae0f1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:20.206304 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:40:20.238974 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1349/2685] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:40:20 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:40:20.250062 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e339adfa-47d4-4f8e-8637-c132ac071004 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:20.342611 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e339adfa-47d4-4f8e-8637-c132ac071004 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:20.354119 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fd4b09-5652-4450-9844-c5db98f34cfb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92862b76ba3b4513b5dc5b5c962faac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:20.355174 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fd4b09-5652-4450-9844-c5db98f34cfb service cinder] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:20.356360 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fd4b09-5652-4450-9844-c5db98f34cfb service cinder] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:20.357298 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fd4b09-5652-4450-9844-c5db98f34cfb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:20.386682 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fd4b09-5652-4450-9844-c5db98f34cfb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:20.390832 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fd4b09-5652-4450-9844-c5db98f34cfb service cinder] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:20.410093 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1337/2686] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:40:20 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:40:21.030273 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d58784-5750-42b0-9df6-952009ae0f1b None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:21.032261 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-31d58784-5750-42b0-9df6-952009ae0f1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:21.225437 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d58784-5750-42b0-9df6-952009ae0f1b None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:21.236638 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2728e998-afc0-445a-8245-450214859f5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:21.236638 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2728e998-afc0-445a-8245-450214859f5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:21.237090 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2728e998-afc0-445a-8245-450214859f5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:21.237405 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2728e998-afc0-445a-8245-450214859f5e admin admin] PATH_INFO: `/v3/users/5669356d12cf4c9fa4ca56b001ee0452` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:21.239434 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2728e998-afc0-445a-8245-450214859f5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5669356d12cf4c9fa4ca56b001ee0452)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:21.243312 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2728e998-afc0-445a-8245-450214859f5e admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:21.364678 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-2728e998-afc0-445a-8245-450214859f5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5669356d12cf4c9fa4ca56b001ee0452'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:21.367289 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-2728e998-afc0-445a-8245-450214859f5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5669356d12cf4c9fa4ca56b001ee0452'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:21.369846 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-2728e998-afc0-445a-8245-450214859f5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5669356d12cf4c9fa4ca56b001ee0452'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:21.388681 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-2728e998-afc0-445a-8245-450214859f5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5669356d12cf4c9fa4ca56b001ee0452'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:21.419401 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-2728e998-afc0-445a-8245-450214859f5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5669356d12cf4c9fa4ca56b001ee0452'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:21.470609 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1350/2687] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 11:40:21 2022] DELETE /identity/v3/users/5669356d12cf4c9fa4ca56b001ee0452 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:40:21.531771 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fd4b09-5652-4450-9844-c5db98f34cfb service cinder] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:21.552870 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fd4b09-5652-4450-9844-c5db98f34cfb service cinder] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:21.674336 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bd4e63-e4fc-4060-a23d-1f33ff1dbafe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:21.676085 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bd4e63-e4fc-4060-a23d-1f33ff1dbafe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:21.676599 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bd4e63-e4fc-4060-a23d-1f33ff1dbafe admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:21.677159 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bd4e63-e4fc-4060-a23d-1f33ff1dbafe admin admin] PATH_INFO: `/v3/users/9389138484e146de803be70e0a00efb7` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:21.680524 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bd4e63-e4fc-4060-a23d-1f33ff1dbafe admin admin] RBAC: Authorizing `identity:delete_user(user_id=9389138484e146de803be70e0a00efb7)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:21.684842 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bd4e63-e4fc-4060-a23d-1f33ff1dbafe admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:21.788259 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-88bd4e63-e4fc-4060-a23d-1f33ff1dbafe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9389138484e146de803be70e0a00efb7'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:21.788975 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-88bd4e63-e4fc-4060-a23d-1f33ff1dbafe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9389138484e146de803be70e0a00efb7'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:21.802802 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-88bd4e63-e4fc-4060-a23d-1f33ff1dbafe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9389138484e146de803be70e0a00efb7'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:21.817055 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-88bd4e63-e4fc-4060-a23d-1f33ff1dbafe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9389138484e146de803be70e0a00efb7'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:21.817942 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-88bd4e63-e4fc-4060-a23d-1f33ff1dbafe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9389138484e146de803be70e0a00efb7'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:21.825479 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:40:21.857905 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1338/2688] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 11:40:21 2022] DELETE /identity/v3/users/9389138484e146de803be70e0a00efb7 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:40:21.862928 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec1646c-a5f5-4108-9bd1-18620f362de0 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:21.863612 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec1646c-a5f5-4108-9bd1-18620f362de0 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:21.864229 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec1646c-a5f5-4108-9bd1-18620f362de0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:21.891245 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bd4e63-e4fc-4060-a23d-1f33ff1dbafe admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:21.893510 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-88bd4e63-e4fc-4060-a23d-1f33ff1dbafe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:21.895965 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-6ec1646c-a5f5-4108-9bd1-18620f362de0 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:40:21.897679 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-6ec1646c-a5f5-4108-9bd1-18620f362de0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:21.982672 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1351/2689] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:40:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:40:21.982919 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bd4e63-e4fc-4060-a23d-1f33ff1dbafe admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:21.987402 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5fc987-cc2a-4b00-b85e-b367b1e852a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:21.988039 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5fc987-cc2a-4b00-b85e-b367b1e852a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:21.988397 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5fc987-cc2a-4b00-b85e-b367b1e852a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:21.988677 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5fc987-cc2a-4b00-b85e-b367b1e852a7 admin admin] PATH_INFO: `/v3/projects/d24906ef87df4fc28b9a93591a656d14` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:21.989794 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5fc987-cc2a-4b00-b85e-b367b1e852a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d24906ef87df4fc28b9a93591a656d14)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:21.992119 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5fc987-cc2a-4b00-b85e-b367b1e852a7 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:21.993152 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec1646c-a5f5-4108-9bd1-18620f362de0 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:21.994677 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-6ec1646c-a5f5-4108-9bd1-18620f362de0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:22.005563 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:40:22.042347 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-fc5fc987-cc2a-4b00-b85e-b367b1e852a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd24906ef87df4fc28b9a93591a656d14', 'request_id': 'req-fc5fc987-cc2a-4b00-b85e-b367b1e852a7'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:22.050839 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-fc5fc987-cc2a-4b00-b85e-b367b1e852a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd24906ef87df4fc28b9a93591a656d14', 'request_id': 'req-fc5fc987-cc2a-4b00-b85e-b367b1e852a7'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:22.058004 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-fc5fc987-cc2a-4b00-b85e-b367b1e852a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd24906ef87df4fc28b9a93591a656d14', 'request_id': 'req-fc5fc987-cc2a-4b00-b85e-b367b1e852a7'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:22.058620 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec1646c-a5f5-4108-9bd1-18620f362de0 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:22.072318 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-fc5fc987-cc2a-4b00-b85e-b367b1e852a7 admin admin] The token cache is being invalidate because project d24906ef87df4fc28b9a93591a656d14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:40:22.072599 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-fc5fc987-cc2a-4b00-b85e-b367b1e852a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:22.073224 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-fc5fc987-cc2a-4b00-b85e-b367b1e852a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:22.074756 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1339/2690] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 11:40:21 2022] DELETE /identity/v3/projects/d24906ef87df4fc28b9a93591a656d14 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:40:22.078645 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5fc987-cc2a-4b00-b85e-b367b1e852a7 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:22.080076 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-fc5fc987-cc2a-4b00-b85e-b367b1e852a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:22.111241 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a06030-9839-4a41-890f-c806f0b1795d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2d061d25d83443c9232218c90792d51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:22.111786 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a06030-9839-4a41-890f-c806f0b1795d service neutron] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:22.112069 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a06030-9839-4a41-890f-c806f0b1795d service neutron] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:22.112340 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a06030-9839-4a41-890f-c806f0b1795d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:22.114168 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-27a06030-9839-4a41-890f-c806f0b1795d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:22.151210 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5fc987-cc2a-4b00-b85e-b367b1e852a7 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:22.155820 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522eb863-bba8-47e5-99d6-6b641bb842a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:22.156451 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522eb863-bba8-47e5-99d6-6b641bb842a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:22.156728 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522eb863-bba8-47e5-99d6-6b641bb842a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:22.156998 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522eb863-bba8-47e5-99d6-6b641bb842a2 admin admin] PATH_INFO: `/v3/users/63662bc83c1b423e9d6e25d14f2140bf` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:22.158160 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522eb863-bba8-47e5-99d6-6b641bb842a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=63662bc83c1b423e9d6e25d14f2140bf)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:22.160205 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522eb863-bba8-47e5-99d6-6b641bb842a2 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:22.176266 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:40:22.179467 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a06030-9839-4a41-890f-c806f0b1795d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:22.180944 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a06030-9839-4a41-890f-c806f0b1795d service neutron] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:22.191761 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1352/2691] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:40:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:40:22.209911 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-522eb863-bba8-47e5-99d6-6b641bb842a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63662bc83c1b423e9d6e25d14f2140bf'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:22.210633 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-522eb863-bba8-47e5-99d6-6b641bb842a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63662bc83c1b423e9d6e25d14f2140bf'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:22.219009 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-522eb863-bba8-47e5-99d6-6b641bb842a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63662bc83c1b423e9d6e25d14f2140bf'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:22.226176 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-522eb863-bba8-47e5-99d6-6b641bb842a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63662bc83c1b423e9d6e25d14f2140bf'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:22.226876 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-522eb863-bba8-47e5-99d6-6b641bb842a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63662bc83c1b423e9d6e25d14f2140bf'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:22.246414 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1340/2692] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 11:40:22 2022] DELETE /identity/v3/users/63662bc83c1b423e9d6e25d14f2140bf => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:40:22.481926 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a06030-9839-4a41-890f-c806f0b1795d service neutron] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:22.493747 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a06030-9839-4a41-890f-c806f0b1795d service neutron] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:22.574795 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d71c316-4600-4c36-bad5-5f8a5886d9f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:22.575475 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d71c316-4600-4c36-bad5-5f8a5886d9f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:22.575778 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d71c316-4600-4c36-bad5-5f8a5886d9f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:22.576033 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d71c316-4600-4c36-bad5-5f8a5886d9f2 admin admin] PATH_INFO: `/v3/projects/f98b6fa95349462eb25f153821ad2495` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:22.577188 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d71c316-4600-4c36-bad5-5f8a5886d9f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f98b6fa95349462eb25f153821ad2495)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:22.579217 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d71c316-4600-4c36-bad5-5f8a5886d9f2 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:22.607044 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:40:22.642779 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-7d71c316-4600-4c36-bad5-5f8a5886d9f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f98b6fa95349462eb25f153821ad2495', 'request_id': 'req-7d71c316-4600-4c36-bad5-5f8a5886d9f2'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:22.650308 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-7d71c316-4600-4c36-bad5-5f8a5886d9f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f98b6fa95349462eb25f153821ad2495', 'request_id': 'req-7d71c316-4600-4c36-bad5-5f8a5886d9f2'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:22.662446 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-7d71c316-4600-4c36-bad5-5f8a5886d9f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f98b6fa95349462eb25f153821ad2495', 'request_id': 'req-7d71c316-4600-4c36-bad5-5f8a5886d9f2'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:22.680489 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-7d71c316-4600-4c36-bad5-5f8a5886d9f2 admin admin] The token cache is being invalidate because project f98b6fa95349462eb25f153821ad2495 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81501) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:40:22.680923 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-7d71c316-4600-4c36-bad5-5f8a5886d9f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:22.681844 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-7d71c316-4600-4c36-bad5-5f8a5886d9f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:22.689360 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1353/2693] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 11:40:22 2022] DELETE /identity/v3/projects/f98b6fa95349462eb25f153821ad2495 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:40:22.691270 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce7bc31-f70c-4bf7-b418-4e2752864302 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:22.691749 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce7bc31-f70c-4bf7-b418-4e2752864302 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:22.691859 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce7bc31-f70c-4bf7-b418-4e2752864302 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:22.713387 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-2ce7bc31-f70c-4bf7-b418-4e2752864302 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:40:22.714921 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-2ce7bc31-f70c-4bf7-b418-4e2752864302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:22.795546 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d71c316-4600-4c36-bad5-5f8a5886d9f2 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:22.797860 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-7d71c316-4600-4c36-bad5-5f8a5886d9f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:22.802456 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1341/2694] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:40:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:40:22.807601 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f1d994-7251-43fc-b40d-7a77df5e91fc None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:22.808386 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f1d994-7251-43fc-b40d-7a77df5e91fc None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:22.808552 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f1d994-7251-43fc-b40d-7a77df5e91fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:22.817456 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d71c316-4600-4c36-bad5-5f8a5886d9f2 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:22.823777 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa1fb78-69fb-423a-884e-fe65c5cc1101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:22.824719 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa1fb78-69fb-423a-884e-fe65c5cc1101 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:22.825353 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa1fb78-69fb-423a-884e-fe65c5cc1101 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:22.825790 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa1fb78-69fb-423a-884e-fe65c5cc1101 admin admin] PATH_INFO: `/v3/projects/4b08bee85a404bcbb1ff469010842a14` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:22.827308 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa1fb78-69fb-423a-884e-fe65c5cc1101 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b08bee85a404bcbb1ff469010842a14)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:22.830013 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa1fb78-69fb-423a-884e-fe65c5cc1101 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:22.833191 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-a9f1d994-7251-43fc-b40d-7a77df5e91fc None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:40:22.835131 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-a9f1d994-7251-43fc-b40d-7a77df5e91fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:22.845847 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1342/2695] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:40:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:40:22.850225 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f1d994-7251-43fc-b40d-7a77df5e91fc None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:22.859702 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f1d994-7251-43fc-b40d-7a77df5e91fc None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:22.864519 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3b765a-ce8d-4cc3-ba13-72d4680b9da1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:22.865178 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3b765a-ce8d-4cc3-ba13-72d4680b9da1 admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:22.865405 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3b765a-ce8d-4cc3-ba13-72d4680b9da1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:22.865661 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3b765a-ce8d-4cc3-ba13-72d4680b9da1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:22.866703 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3b765a-ce8d-4cc3-ba13-72d4680b9da1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:40:22.867002 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3b765a-ce8d-4cc3-ba13-72d4680b9da1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:22.868641 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3b765a-ce8d-4cc3-ba13-72d4680b9da1 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:22.882390 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1343/2696] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 24 11:40:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:40:22.885506 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3b765a-ce8d-4cc3-ba13-72d4680b9da1 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:22.892659 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-9fa1fb78-69fb-423a-884e-fe65c5cc1101 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b08bee85a404bcbb1ff469010842a14', 'request_id': 'req-9fa1fb78-69fb-423a-884e-fe65c5cc1101'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:22.895440 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3b765a-ce8d-4cc3-ba13-72d4680b9da1 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:22.898947 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-9fa1fb78-69fb-423a-884e-fe65c5cc1101 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b08bee85a404bcbb1ff469010842a14', 'request_id': 'req-9fa1fb78-69fb-423a-884e-fe65c5cc1101'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:22.904509 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-9fa1fb78-69fb-423a-884e-fe65c5cc1101 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b08bee85a404bcbb1ff469010842a14', 'request_id': 'req-9fa1fb78-69fb-423a-884e-fe65c5cc1101'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:22.918058 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-9fa1fb78-69fb-423a-884e-fe65c5cc1101 admin admin] The token cache is being invalidate because project 4b08bee85a404bcbb1ff469010842a14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81501) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:40:22.918374 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-9fa1fb78-69fb-423a-884e-fe65c5cc1101 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:22.919039 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-9fa1fb78-69fb-423a-884e-fe65c5cc1101 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:22.920598 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1354/2697] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 11:40:22 2022] DELETE /identity/v3/projects/4b08bee85a404bcbb1ff469010842a14 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 11:40:22.924542 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa1fb78-69fb-423a-884e-fe65c5cc1101 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:22.925912 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-9fa1fb78-69fb-423a-884e-fe65c5cc1101 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:22.954527 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cd53e8-5c16-436f-9e52-83432fc2e6e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:22.955141 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cd53e8-5c16-436f-9e52-83432fc2e6e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:22.955460 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cd53e8-5c16-436f-9e52-83432fc2e6e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:22.955903 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cd53e8-5c16-436f-9e52-83432fc2e6e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:22.956542 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cd53e8-5c16-436f-9e52-83432fc2e6e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:22.959251 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cd53e8-5c16-436f-9e52-83432fc2e6e2 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:22.987882 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:40:22.998826 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1344/2698] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 11:40:22 2022] POST /identity/v3/projects => generated 363 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:40:23.000994 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa1fb78-69fb-423a-884e-fe65c5cc1101 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:23.002876 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cd53e8-5c16-436f-9e52-83432fc2e6e2 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:23.004922 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-16cd53e8-5c16-436f-9e52-83432fc2e6e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:23.038878 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:40:23.071563 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbb0e8e-78ee-44ed-b153-5636ecc24252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:23.072202 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbb0e8e-78ee-44ed-b153-5636ecc24252 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:23.072470 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbb0e8e-78ee-44ed-b153-5636ecc24252 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:23.072763 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbb0e8e-78ee-44ed-b153-5636ecc24252 admin admin] PATH_INFO: `/v3/users/03f1cd9ff0114c438071ec82aee760ab` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:23.073928 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbb0e8e-78ee-44ed-b153-5636ecc24252 admin admin] RBAC: Authorizing `identity:delete_user(user_id=03f1cd9ff0114c438071ec82aee760ab)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:23.075936 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbb0e8e-78ee-44ed-b153-5636ecc24252 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:23.081114 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cd53e8-5c16-436f-9e52-83432fc2e6e2 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:23.086154 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3af064-a4f4-40f6-aa1e-47ae62ca8760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:23.086865 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3af064-a4f4-40f6-aa1e-47ae62ca8760 admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:23.087207 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3af064-a4f4-40f6-aa1e-47ae62ca8760 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:23.087928 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3af064-a4f4-40f6-aa1e-47ae62ca8760 admin admin] PATH_INFO: `/v3/users` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:23.088234 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3af064-a4f4-40f6-aa1e-47ae62ca8760 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:23.090388 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3af064-a4f4-40f6-aa1e-47ae62ca8760 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:23.117746 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1345/2699] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 11:40:23 2022] POST /identity/v3/users => generated 282 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 11:40:23.121610 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3af064-a4f4-40f6-aa1e-47ae62ca8760 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:23.132184 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3af064-a4f4-40f6-aa1e-47ae62ca8760 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:23.133365 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-bfbb0e8e-78ee-44ed-b153-5636ecc24252 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03f1cd9ff0114c438071ec82aee760ab'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:23.134270 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-bfbb0e8e-78ee-44ed-b153-5636ecc24252 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03f1cd9ff0114c438071ec82aee760ab'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:23.135013 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-bfbb0e8e-78ee-44ed-b153-5636ecc24252 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03f1cd9ff0114c438071ec82aee760ab'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:23.136837 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4067c71-1b3c-4f5c-82e0-bb7306808f53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:23.137445 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4067c71-1b3c-4f5c-82e0-bb7306808f53 admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:23.137734 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4067c71-1b3c-4f5c-82e0-bb7306808f53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:23.138023 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4067c71-1b3c-4f5c-82e0-bb7306808f53 admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:23.139006 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4067c71-1b3c-4f5c-82e0-bb7306808f53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:23.140647 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4067c71-1b3c-4f5c-82e0-bb7306808f53 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:23.145883 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-bfbb0e8e-78ee-44ed-b153-5636ecc24252 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03f1cd9ff0114c438071ec82aee760ab'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:23.151339 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1346/2700] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:40:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 11:40:23.153660 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-bfbb0e8e-78ee-44ed-b153-5636ecc24252 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03f1cd9ff0114c438071ec82aee760ab'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:23.158753 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4067c71-1b3c-4f5c-82e0-bb7306808f53 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:23.160925 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-e4067c71-1b3c-4f5c-82e0-bb7306808f53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:23.171357 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1355/2701] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 11:40:22 2022] DELETE /identity/v3/users/03f1cd9ff0114c438071ec82aee760ab => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 11:40:23.173614 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4067c71-1b3c-4f5c-82e0-bb7306808f53 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:23.233882 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f078fd37-eaa7-41ed-a2a6-23a423348dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:23.234788 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f078fd37-eaa7-41ed-a2a6-23a423348dad admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:23.235106 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f078fd37-eaa7-41ed-a2a6-23a423348dad admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:23.235384 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f078fd37-eaa7-41ed-a2a6-23a423348dad admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:23.236047 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f078fd37-eaa7-41ed-a2a6-23a423348dad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:23.238106 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f078fd37-eaa7-41ed-a2a6-23a423348dad admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:23.250099 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1347/2702] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:40:23 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 11:40:23.254789 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbb0e8e-78ee-44ed-b153-5636ecc24252 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:23.264864 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbb0e8e-78ee-44ed-b153-5636ecc24252 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:23.270007 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3cf76b-4ffa-4f1b-9f09-40f9d5a7c1df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:23.270721 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3cf76b-4ffa-4f1b-9f09-40f9d5a7c1df admin admin] REQUEST_METHOD: `PUT` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:23.270995 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3cf76b-4ffa-4f1b-9f09-40f9d5a7c1df admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:23.271265 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3cf76b-4ffa-4f1b-9f09-40f9d5a7c1df admin admin] PATH_INFO: `/v3/projects/a39a9c099be346cab4cb19da1ecc92f1/users/777bc203d9f5473b938d54f6dfd7516a/roles/27e3e65e24df4b86b0d3d18d3212101d` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:23.287080 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3cf76b-4ffa-4f1b-9f09-40f9d5a7c1df admin admin] RBAC: Authorizing `identity:create_grant(project_id=a39a9c099be346cab4cb19da1ecc92f1, user_id=777bc203d9f5473b938d54f6dfd7516a, role_id=27e3e65e24df4b86b0d3d18d3212101d)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:23.289854 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3cf76b-4ffa-4f1b-9f09-40f9d5a7c1df admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:23.303875 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1356/2703] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 11:40:23 2022] PUT /identity/v3/projects/a39a9c099be346cab4cb19da1ecc92f1/users/777bc203d9f5473b938d54f6dfd7516a/roles/27e3e65e24df4b86b0d3d18d3212101d => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:40:23.315385 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1246b507-a0ac-47db-8283-a9de3ce82af6 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:23.315710 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1246b507-a0ac-47db-8283-a9de3ce82af6 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:23.315919 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1246b507-a0ac-47db-8283-a9de3ce82af6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:23.379641 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-1246b507-a0ac-47db-8283-a9de3ce82af6 None None] MFA Rules not processed for user `777bc203d9f5473b938d54f6dfd7516a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:40:23.380935 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-1246b507-a0ac-47db-8283-a9de3ce82af6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:23.457875 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3cf76b-4ffa-4f1b-9f09-40f9d5a7c1df admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:23.459895 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-6c3cf76b-4ffa-4f1b-9f09-40f9d5a7c1df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:23.465949 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1348/2704] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:40:23 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:40:23.479461 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1246b507-a0ac-47db-8283-a9de3ce82af6 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:23.482009 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-1246b507-a0ac-47db-8283-a9de3ce82af6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:23.488676 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:40:23.551920 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1246b507-a0ac-47db-8283-a9de3ce82af6 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:23.554772 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3cf76b-4ffa-4f1b-9f09-40f9d5a7c1df admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:23.555920 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06c96c5-ae13-4800-bbec-d350d6d13b20 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92862b76ba3b4513b5dc5b5c962faac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:23.556698 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06c96c5-ae13-4800-bbec-d350d6d13b20 service cinder] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:23.556962 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06c96c5-ae13-4800-bbec-d350d6d13b20 service cinder] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:23.557282 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06c96c5-ae13-4800-bbec-d350d6d13b20 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:23.559935 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99cb58d-04e1-4bf4-a29d-f2781bf10dc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:23.560643 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99cb58d-04e1-4bf4-a29d-f2781bf10dc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:23.560921 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99cb58d-04e1-4bf4-a29d-f2781bf10dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:23.561206 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99cb58d-04e1-4bf4-a29d-f2781bf10dc9 admin admin] PATH_INFO: `/v3/projects/095706efa4ea4cd5990677d69ea87d4f` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:23.562438 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99cb58d-04e1-4bf4-a29d-f2781bf10dc9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=095706efa4ea4cd5990677d69ea87d4f)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:23.566428 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99cb58d-04e1-4bf4-a29d-f2781bf10dc9 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:23.571260 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06c96c5-ae13-4800-bbec-d350d6d13b20 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:23.572813 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06c96c5-ae13-4800-bbec-d350d6d13b20 service cinder] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:23.583199 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1349/2705] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:40:23 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 11:40:23.604200 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:40:23.620815 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-f99cb58d-04e1-4bf4-a29d-f2781bf10dc9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '095706efa4ea4cd5990677d69ea87d4f', 'request_id': 'req-f99cb58d-04e1-4bf4-a29d-f2781bf10dc9'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:23.627838 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-f99cb58d-04e1-4bf4-a29d-f2781bf10dc9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '095706efa4ea4cd5990677d69ea87d4f', 'request_id': 'req-f99cb58d-04e1-4bf4-a29d-f2781bf10dc9'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:23.634730 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-f99cb58d-04e1-4bf4-a29d-f2781bf10dc9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '095706efa4ea4cd5990677d69ea87d4f', 'request_id': 'req-f99cb58d-04e1-4bf4-a29d-f2781bf10dc9'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:23.648931 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-f99cb58d-04e1-4bf4-a29d-f2781bf10dc9 admin admin] The token cache is being invalidate because project 095706efa4ea4cd5990677d69ea87d4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81501) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:40:23.649227 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-f99cb58d-04e1-4bf4-a29d-f2781bf10dc9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:23.649928 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-f99cb58d-04e1-4bf4-a29d-f2781bf10dc9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:23.652018 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1357/2706] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 11:40:23 2022] DELETE /identity/v3/projects/095706efa4ea4cd5990677d69ea87d4f => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 11:40:23.657467 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a42586-4c26-4e59-a845-eac313eec68f None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:23.657792 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a42586-4c26-4e59-a845-eac313eec68f None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:23.658113 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a42586-4c26-4e59-a845-eac313eec68f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:23.678300 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-82a42586-4c26-4e59-a845-eac313eec68f None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:40:23.680120 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-82a42586-4c26-4e59-a845-eac313eec68f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:23.748758 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1350/2707] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:40:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:40:23.758186 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e02fb3-14bf-4465-b08d-8256938c9f17 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:23.758555 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e02fb3-14bf-4465-b08d-8256938c9f17 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:23.758836 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e02fb3-14bf-4465-b08d-8256938c9f17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:23.780731 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-e3e02fb3-14bf-4465-b08d-8256938c9f17 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:40:23.782726 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-e3e02fb3-14bf-4465-b08d-8256938c9f17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:23.793229 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1358/2708] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:40:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:40:23.798018 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a42586-4c26-4e59-a845-eac313eec68f None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:23.808982 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a42586-4c26-4e59-a845-eac313eec68f None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:23.814309 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8b6781-4d29-4039-a362-b6b5b2180bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:23.815062 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8b6781-4d29-4039-a362-b6b5b2180bda admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:23.815432 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8b6781-4d29-4039-a362-b6b5b2180bda admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:23.815822 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8b6781-4d29-4039-a362-b6b5b2180bda admin admin] PATH_INFO: `/v3/domains` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:23.816731 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8b6781-4d29-4039-a362-b6b5b2180bda admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:40:23.817155 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8b6781-4d29-4039-a362-b6b5b2180bda admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:23.818938 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8b6781-4d29-4039-a362-b6b5b2180bda admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:23.839100 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1351/2709] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 24 11:40:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:40:23.843486 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e02fb3-14bf-4465-b08d-8256938c9f17 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:23.871479 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e02fb3-14bf-4465-b08d-8256938c9f17 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:23.877471 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed7169f-904c-4c57-934c-cb14dc0d0fe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:23.878105 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed7169f-904c-4c57-934c-cb14dc0d0fe9 admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:23.878477 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed7169f-904c-4c57-934c-cb14dc0d0fe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:23.878942 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed7169f-904c-4c57-934c-cb14dc0d0fe9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:23.879668 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed7169f-904c-4c57-934c-cb14dc0d0fe9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:23.881594 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed7169f-904c-4c57-934c-cb14dc0d0fe9 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:23.952342 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1359/2710] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 11:40:23 2022] POST /identity/v3/projects => generated 377 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 11:40:23.953502 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8b6781-4d29-4039-a362-b6b5b2180bda admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:23.966898 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8b6781-4d29-4039-a362-b6b5b2180bda admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:24.037615 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45077d9-897d-4c4b-a77a-08cea41f4466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:24.038273 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45077d9-897d-4c4b-a77a-08cea41f4466 admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:24.038586 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45077d9-897d-4c4b-a77a-08cea41f4466 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:24.038858 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45077d9-897d-4c4b-a77a-08cea41f4466 admin admin] PATH_INFO: `/v3/users` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:24.039473 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45077d9-897d-4c4b-a77a-08cea41f4466 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:24.041375 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45077d9-897d-4c4b-a77a-08cea41f4466 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:24.064824 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1352/2711] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 11:40:23 2022] POST /identity/v3/users => generated 289 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 11:40:24.069910 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed7169f-904c-4c57-934c-cb14dc0d0fe9 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:24.084370 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed7169f-904c-4c57-934c-cb14dc0d0fe9 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:24.090156 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c56579-2b3e-4372-80e8-9601a3102ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:24.090797 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c56579-2b3e-4372-80e8-9601a3102ff0 admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:24.091077 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c56579-2b3e-4372-80e8-9601a3102ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:24.091347 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c56579-2b3e-4372-80e8-9601a3102ff0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:24.092002 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c56579-2b3e-4372-80e8-9601a3102ff0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:24.093636 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c56579-2b3e-4372-80e8-9601a3102ff0 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:24.104929 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1360/2712] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:40:24 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:40:24.109093 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45077d9-897d-4c4b-a77a-08cea41f4466 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:24.120931 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45077d9-897d-4c4b-a77a-08cea41f4466 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:24.127370 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac629734-bc92-4d86-8ef8-d3ab96ebde25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:24.128234 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac629734-bc92-4d86-8ef8-d3ab96ebde25 admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:24.128511 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac629734-bc92-4d86-8ef8-d3ab96ebde25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:24.128801 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac629734-bc92-4d86-8ef8-d3ab96ebde25 admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:24.129488 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac629734-bc92-4d86-8ef8-d3ab96ebde25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:24.131375 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac629734-bc92-4d86-8ef8-d3ab96ebde25 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:24.142862 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1353/2713] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:40:24 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:40:24.148189 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c56579-2b3e-4372-80e8-9601a3102ff0 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:24.159410 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c56579-2b3e-4372-80e8-9601a3102ff0 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:24.174821 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28489ca-ee3d-4a92-ae89-cc9de37f6748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:24.175532 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28489ca-ee3d-4a92-ae89-cc9de37f6748 admin admin] REQUEST_METHOD: `PUT` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:24.176119 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28489ca-ee3d-4a92-ae89-cc9de37f6748 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:24.176324 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28489ca-ee3d-4a92-ae89-cc9de37f6748 admin admin] PATH_INFO: `/v3/projects/9fb079d85b664f27b997fa62baa7a2ad/users/8fd2aee1a54241edb95e26482f6a1f52/roles/27e3e65e24df4b86b0d3d18d3212101d` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:24.195693 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28489ca-ee3d-4a92-ae89-cc9de37f6748 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fb079d85b664f27b997fa62baa7a2ad, user_id=8fd2aee1a54241edb95e26482f6a1f52, role_id=27e3e65e24df4b86b0d3d18d3212101d)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:24.199388 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28489ca-ee3d-4a92-ae89-cc9de37f6748 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:24.215543 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1361/2714] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 11:40:24 2022] PUT /identity/v3/projects/9fb079d85b664f27b997fa62baa7a2ad/users/8fd2aee1a54241edb95e26482f6a1f52/roles/27e3e65e24df4b86b0d3d18d3212101d => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 11:40:24.225979 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3421d2d9-53e4-42f2-9bc9-feb48717ab86 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:24.226256 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3421d2d9-53e4-42f2-9bc9-feb48717ab86 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:24.226548 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3421d2d9-53e4-42f2-9bc9-feb48717ab86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:24.255368 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:40:24.259556 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-3421d2d9-53e4-42f2-9bc9-feb48717ab86 None None] MFA Rules not processed for user `8fd2aee1a54241edb95e26482f6a1f52`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:40:24.261789 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-3421d2d9-53e4-42f2-9bc9-feb48717ab86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:24.340249 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1354/2715] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:40:24 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:40:24.353758 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28489ca-ee3d-4a92-ae89-cc9de37f6748 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:24.356764 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-f28489ca-ee3d-4a92-ae89-cc9de37f6748 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:24.418717 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28489ca-ee3d-4a92-ae89-cc9de37f6748 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:24.422392 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f410fc61-2d75-4174-a8c3-6fcf4433d398 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abffba24649e49d28a01cbee51924ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:24.422994 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f410fc61-2d75-4174-a8c3-6fcf4433d398 service glance] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:24.423267 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f410fc61-2d75-4174-a8c3-6fcf4433d398 service glance] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:24.423535 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f410fc61-2d75-4174-a8c3-6fcf4433d398 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:24.431904 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f410fc61-2d75-4174-a8c3-6fcf4433d398 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:24.433402 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f410fc61-2d75-4174-a8c3-6fcf4433d398 service glance] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:24.442187 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1362/2716] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:40:24 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:40:33.063291 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3421d2d9-53e4-42f2-9bc9-feb48717ab86 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:33.064942 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-3421d2d9-53e4-42f2-9bc9-feb48717ab86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:33.136688 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3421d2d9-53e4-42f2-9bc9-feb48717ab86 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:33.140868 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee32e81-f72b-4061-a13d-f118cb8bc719 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2d061d25d83443c9232218c90792d51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:33.141485 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee32e81-f72b-4061-a13d-f118cb8bc719 service neutron] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:33.141784 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee32e81-f72b-4061-a13d-f118cb8bc719 service neutron] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:33.142052 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee32e81-f72b-4061-a13d-f118cb8bc719 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:33.144043 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-eee32e81-f72b-4061-a13d-f118cb8bc719 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:33.216159 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee32e81-f72b-4061-a13d-f118cb8bc719 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:33.217936 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee32e81-f72b-4061-a13d-f118cb8bc719 service neutron] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:33.228883 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1355/2717] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:40:33 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:40:34.438209 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=65,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:40:42.356084 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f410fc61-2d75-4174-a8c3-6fcf4433d398 service glance] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:42.424470 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f410fc61-2d75-4174-a8c3-6fcf4433d398 service glance] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:42.429480 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf4f7aa-8d45-4502-a249-c4dc496779c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:42.430139 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf4f7aa-8d45-4502-a249-c4dc496779c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:42.430401 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf4f7aa-8d45-4502-a249-c4dc496779c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:42.430691 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf4f7aa-8d45-4502-a249-c4dc496779c7 admin admin] PATH_INFO: `/v3/users/8fd2aee1a54241edb95e26482f6a1f52` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:42.431894 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf4f7aa-8d45-4502-a249-c4dc496779c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8fd2aee1a54241edb95e26482f6a1f52)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:42.433928 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf4f7aa-8d45-4502-a249-c4dc496779c7 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:42.485857 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-9cf4f7aa-8d45-4502-a249-c4dc496779c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8fd2aee1a54241edb95e26482f6a1f52'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:42.486546 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-9cf4f7aa-8d45-4502-a249-c4dc496779c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8fd2aee1a54241edb95e26482f6a1f52'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:42.487171 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-9cf4f7aa-8d45-4502-a249-c4dc496779c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8fd2aee1a54241edb95e26482f6a1f52'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:42.495577 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-9cf4f7aa-8d45-4502-a249-c4dc496779c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8fd2aee1a54241edb95e26482f6a1f52'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:42.502534 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-9cf4f7aa-8d45-4502-a249-c4dc496779c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8fd2aee1a54241edb95e26482f6a1f52'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:42.520809 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1363/2718] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 11:40:42 2022] DELETE /identity/v3/users/8fd2aee1a54241edb95e26482f6a1f52 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:40:42.525451 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879c2187-6608-481c-9626-65d82978a4c8 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:42.526135 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879c2187-6608-481c-9626-65d82978a4c8 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:42.526135 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879c2187-6608-481c-9626-65d82978a4c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:42.546602 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-879c2187-6608-481c-9626-65d82978a4c8 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:40:42.547841 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-879c2187-6608-481c-9626-65d82978a4c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:42.603662 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:40:42.618260 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1356/2719] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:40:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:40:42.632052 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf4f7aa-8d45-4502-a249-c4dc496779c7 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:42.634470 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-9cf4f7aa-8d45-4502-a249-c4dc496779c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:42.699244 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf4f7aa-8d45-4502-a249-c4dc496779c7 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:42.704079 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaf5f33-3366-4bd5-9810-e274f7c3c06f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2d061d25d83443c9232218c90792d51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:42.704710 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaf5f33-3366-4bd5-9810-e274f7c3c06f service neutron] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:42.704990 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaf5f33-3366-4bd5-9810-e274f7c3c06f service neutron] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:42.705261 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaf5f33-3366-4bd5-9810-e274f7c3c06f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:42.715707 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaf5f33-3366-4bd5-9810-e274f7c3c06f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:42.717150 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaf5f33-3366-4bd5-9810-e274f7c3c06f service neutron] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:42.731692 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1364/2720] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:40:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:40:43.025575 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879c2187-6608-481c-9626-65d82978a4c8 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:43.027713 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-879c2187-6608-481c-9626-65d82978a4c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:43.041229 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879c2187-6608-481c-9626-65d82978a4c8 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:43.046463 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1945ab-f625-4a22-8a45-d168a4c83b12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:43.047213 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1945ab-f625-4a22-8a45-d168a4c83b12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:43.047681 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1945ab-f625-4a22-8a45-d168a4c83b12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:43.048042 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1945ab-f625-4a22-8a45-d168a4c83b12 admin admin] PATH_INFO: `/v3/projects/9fb079d85b664f27b997fa62baa7a2ad` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:43.049267 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1945ab-f625-4a22-8a45-d168a4c83b12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9fb079d85b664f27b997fa62baa7a2ad)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:43.051524 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1945ab-f625-4a22-8a45-d168a4c83b12 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:43.123234 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-ca1945ab-f625-4a22-8a45-d168a4c83b12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9fb079d85b664f27b997fa62baa7a2ad', 'request_id': 'req-ca1945ab-f625-4a22-8a45-d168a4c83b12'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:43.129618 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-ca1945ab-f625-4a22-8a45-d168a4c83b12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9fb079d85b664f27b997fa62baa7a2ad', 'request_id': 'req-ca1945ab-f625-4a22-8a45-d168a4c83b12'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:43.135196 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-ca1945ab-f625-4a22-8a45-d168a4c83b12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9fb079d85b664f27b997fa62baa7a2ad', 'request_id': 'req-ca1945ab-f625-4a22-8a45-d168a4c83b12'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:43.149367 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-ca1945ab-f625-4a22-8a45-d168a4c83b12 admin admin] The token cache is being invalidate because project 9fb079d85b664f27b997fa62baa7a2ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:40:43.149653 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-ca1945ab-f625-4a22-8a45-d168a4c83b12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:43.150281 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-ca1945ab-f625-4a22-8a45-d168a4c83b12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:43.151937 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1357/2721] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 11:40:43 2022] DELETE /identity/v3/projects/9fb079d85b664f27b997fa62baa7a2ad => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:40:43.158661 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a03dc11-3041-4d47-bb1e-546a11668bc1 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:43.158959 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a03dc11-3041-4d47-bb1e-546a11668bc1 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:43.159237 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a03dc11-3041-4d47-bb1e-546a11668bc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:43.178518 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-0a03dc11-3041-4d47-bb1e-546a11668bc1 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:40:43.179720 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-0a03dc11-3041-4d47-bb1e-546a11668bc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:43.198249 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:40:43.243704 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1365/2722] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:40:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:40:43.310973 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e815cc98-399b-4fed-953c-340ea6ac0ffe None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:43.311256 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e815cc98-399b-4fed-953c-340ea6ac0ffe None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:43.311531 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e815cc98-399b-4fed-953c-340ea6ac0ffe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:43.335811 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-e815cc98-399b-4fed-953c-340ea6ac0ffe None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:40:43.337190 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-e815cc98-399b-4fed-953c-340ea6ac0ffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:43.346765 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1358/2723] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:40:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:40:43.351544 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a03dc11-3041-4d47-bb1e-546a11668bc1 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:43.361862 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a03dc11-3041-4d47-bb1e-546a11668bc1 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:43.368063 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525a3404-2b73-4cf8-a683-1b827e6734b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:43.368661 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525a3404-2b73-4cf8-a683-1b827e6734b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:43.368927 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525a3404-2b73-4cf8-a683-1b827e6734b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:43.369192 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525a3404-2b73-4cf8-a683-1b827e6734b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:43.369845 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525a3404-2b73-4cf8-a683-1b827e6734b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:40:43.370149 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525a3404-2b73-4cf8-a683-1b827e6734b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:43.371850 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525a3404-2b73-4cf8-a683-1b827e6734b2 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:43.384016 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1366/2724] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 24 11:40:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:40:43.388546 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e815cc98-399b-4fed-953c-340ea6ac0ffe None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:43.398317 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e815cc98-399b-4fed-953c-340ea6ac0ffe None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:43.403443 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cc5d1b-32db-4b57-9a9e-82b015ca194c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:43.404055 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cc5d1b-32db-4b57-9a9e-82b015ca194c admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:43.404318 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cc5d1b-32db-4b57-9a9e-82b015ca194c admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:43.404588 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cc5d1b-32db-4b57-9a9e-82b015ca194c admin admin] PATH_INFO: `/v3/projects` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:43.405214 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cc5d1b-32db-4b57-9a9e-82b015ca194c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:43.407159 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cc5d1b-32db-4b57-9a9e-82b015ca194c admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:43.437193 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1359/2725] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 11:40:43 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:40:43.441576 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525a3404-2b73-4cf8-a683-1b827e6734b2 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:43.452666 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525a3404-2b73-4cf8-a683-1b827e6734b2 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:43.515934 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5b3bfc-b6f9-4a57-8294-819bbf4afafb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:43.516591 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5b3bfc-b6f9-4a57-8294-819bbf4afafb admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:43.516874 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5b3bfc-b6f9-4a57-8294-819bbf4afafb admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:43.517135 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5b3bfc-b6f9-4a57-8294-819bbf4afafb admin admin] PATH_INFO: `/v3/users` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:43.517826 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5b3bfc-b6f9-4a57-8294-819bbf4afafb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:43.519834 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5b3bfc-b6f9-4a57-8294-819bbf4afafb admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:43.544117 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1367/2726] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 11:40:43 2022] POST /identity/v3/users => generated 287 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:40:43.548321 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cc5d1b-32db-4b57-9a9e-82b015ca194c admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:43.559431 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cc5d1b-32db-4b57-9a9e-82b015ca194c admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:43.565216 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917ea3e8-226a-4e79-856c-cb2cc40fa531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:43.565883 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917ea3e8-226a-4e79-856c-cb2cc40fa531 admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:43.566125 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917ea3e8-226a-4e79-856c-cb2cc40fa531 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:43.566396 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917ea3e8-226a-4e79-856c-cb2cc40fa531 admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:43.567039 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917ea3e8-226a-4e79-856c-cb2cc40fa531 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:43.568677 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917ea3e8-226a-4e79-856c-cb2cc40fa531 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:43.580608 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1360/2727] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:40:43 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:40:43.585015 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5b3bfc-b6f9-4a57-8294-819bbf4afafb admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:43.596059 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5b3bfc-b6f9-4a57-8294-819bbf4afafb admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:43.601556 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caa2a77-1dfd-4fa2-80d1-6ffaf4d7f837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:43.602193 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caa2a77-1dfd-4fa2-80d1-6ffaf4d7f837 admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:43.602497 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caa2a77-1dfd-4fa2-80d1-6ffaf4d7f837 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:43.602780 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caa2a77-1dfd-4fa2-80d1-6ffaf4d7f837 admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:43.603482 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9caa2a77-1dfd-4fa2-80d1-6ffaf4d7f837 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:43.605226 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9caa2a77-1dfd-4fa2-80d1-6ffaf4d7f837 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:43.617488 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1368/2728] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:40:43 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:40:43.622289 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917ea3e8-226a-4e79-856c-cb2cc40fa531 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:43.633490 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917ea3e8-226a-4e79-856c-cb2cc40fa531 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:43.639245 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefd122f-cda0-464b-a138-09753bc2bde2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:43.640052 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefd122f-cda0-464b-a138-09753bc2bde2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:43.640469 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefd122f-cda0-464b-a138-09753bc2bde2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:43.640741 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefd122f-cda0-464b-a138-09753bc2bde2 admin admin] PATH_INFO: `/v3/projects/dadc539cb829414b8aefb94df22d9801/users/b80442b1eedf4039a913166f38ed9ae7/roles/27e3e65e24df4b86b0d3d18d3212101d` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:43.659424 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefd122f-cda0-464b-a138-09753bc2bde2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dadc539cb829414b8aefb94df22d9801, user_id=b80442b1eedf4039a913166f38ed9ae7, role_id=27e3e65e24df4b86b0d3d18d3212101d)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:43.662237 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefd122f-cda0-464b-a138-09753bc2bde2 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:43.676171 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1361/2729] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 11:40:43 2022] PUT /identity/v3/projects/dadc539cb829414b8aefb94df22d9801/users/b80442b1eedf4039a913166f38ed9ae7/roles/27e3e65e24df4b86b0d3d18d3212101d => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:40:43.681802 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ddce12-e570-4d40-ba37-b59326ad0e34 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:43.682083 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ddce12-e570-4d40-ba37-b59326ad0e34 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:43.682437 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ddce12-e570-4d40-ba37-b59326ad0e34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:43.701894 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-a4ddce12-e570-4d40-ba37-b59326ad0e34 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:40:43.703193 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-a4ddce12-e570-4d40-ba37-b59326ad0e34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:43.769789 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1369/2730] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:40:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:40:43.780317 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefd122f-cda0-464b-a138-09753bc2bde2 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:43.783807 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-cefd122f-cda0-464b-a138-09753bc2bde2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:43.845335 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefd122f-cda0-464b-a138-09753bc2bde2 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:43.849747 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27de0140-bcc6-4e0b-a437-0df1972a7195 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2d061d25d83443c9232218c90792d51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:43.850386 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27de0140-bcc6-4e0b-a437-0df1972a7195 service neutron] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:43.850661 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27de0140-bcc6-4e0b-a437-0df1972a7195 service neutron] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:43.850933 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27de0140-bcc6-4e0b-a437-0df1972a7195 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:43.860561 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27de0140-bcc6-4e0b-a437-0df1972a7195 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:43.861924 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27de0140-bcc6-4e0b-a437-0df1972a7195 service neutron] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:43.873453 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1362/2731] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:40:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:40:44.555238 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da94b89-491e-4a0a-bfb8-517dbceccbc1 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:44.556320 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da94b89-491e-4a0a-bfb8-517dbceccbc1 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:44.556776 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da94b89-491e-4a0a-bfb8-517dbceccbc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:44.598291 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-8da94b89-491e-4a0a-bfb8-517dbceccbc1 None None] MFA Rules not processed for user `b80442b1eedf4039a913166f38ed9ae7`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:40:44.599565 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-8da94b89-491e-4a0a-bfb8-517dbceccbc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:44.616521 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:40:44.671216 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1370/2732] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:40:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 11:40:44.682747 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27de0140-bcc6-4e0b-a437-0df1972a7195 service neutron] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:44.684310 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-27de0140-bcc6-4e0b-a437-0df1972a7195 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:44.706264 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:40:44.751753 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27de0140-bcc6-4e0b-a437-0df1972a7195 service neutron] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:44.755936 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f98d08-f04a-4903-a659-dfc924011186 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92862b76ba3b4513b5dc5b5c962faac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:44.756615 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f98d08-f04a-4903-a659-dfc924011186 service cinder] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:44.756968 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f98d08-f04a-4903-a659-dfc924011186 service cinder] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:44.757305 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f98d08-f04a-4903-a659-dfc924011186 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:44.766916 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f98d08-f04a-4903-a659-dfc924011186 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:44.768361 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f98d08-f04a-4903-a659-dfc924011186 service cinder] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:44.777940 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1363/2733] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:40:44 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:40:46.185954 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe46120-34ce-40b6-b564-05679b7c1160 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:46.186648 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe46120-34ce-40b6-b564-05679b7c1160 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:46.186648 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe46120-34ce-40b6-b564-05679b7c1160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:46.206830 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-cbe46120-34ce-40b6-b564-05679b7c1160 None None] MFA Rules not processed for user `b80442b1eedf4039a913166f38ed9ae7`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:40:46.208043 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-cbe46120-34ce-40b6-b564-05679b7c1160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:46.216034 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1371/2734] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:40:46 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:40:50.030999 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f98d08-f04a-4903-a659-dfc924011186 service cinder] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:50.032594 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-a5f98d08-f04a-4903-a659-dfc924011186 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:50.046633 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f98d08-f04a-4903-a659-dfc924011186 service cinder] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:50.051397 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944d87c8-b6b9-448d-9f7b-a052909b5981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:50.052150 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944d87c8-b6b9-448d-9f7b-a052909b5981 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:50.052426 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944d87c8-b6b9-448d-9f7b-a052909b5981 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:50.052696 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944d87c8-b6b9-448d-9f7b-a052909b5981 admin admin] PATH_INFO: `/v3/users/7edc193cb731428eb7ea947aa9e96b7c` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:50.053845 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944d87c8-b6b9-448d-9f7b-a052909b5981 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7edc193cb731428eb7ea947aa9e96b7c)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:50.055807 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944d87c8-b6b9-448d-9f7b-a052909b5981 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:50.105058 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-944d87c8-b6b9-448d-9f7b-a052909b5981 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7edc193cb731428eb7ea947aa9e96b7c'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:50.105734 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-944d87c8-b6b9-448d-9f7b-a052909b5981 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7edc193cb731428eb7ea947aa9e96b7c'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:50.116472 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-944d87c8-b6b9-448d-9f7b-a052909b5981 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7edc193cb731428eb7ea947aa9e96b7c'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:50.124064 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-944d87c8-b6b9-448d-9f7b-a052909b5981 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7edc193cb731428eb7ea947aa9e96b7c'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:50.124731 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-944d87c8-b6b9-448d-9f7b-a052909b5981 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7edc193cb731428eb7ea947aa9e96b7c'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:50.147665 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1364/2735] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 11:40:50 2022] DELETE /identity/v3/users/7edc193cb731428eb7ea947aa9e96b7c => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 11:40:50.152342 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a16b691-cb58-44ca-920c-43e09658d8a2 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:50.152879 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a16b691-cb58-44ca-920c-43e09658d8a2 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:50.152879 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a16b691-cb58-44ca-920c-43e09658d8a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:50.172020 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-5a16b691-cb58-44ca-920c-43e09658d8a2 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:40:50.173231 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-5a16b691-cb58-44ca-920c-43e09658d8a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:50.234960 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1372/2736] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:40:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:40:50.246871 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944d87c8-b6b9-448d-9f7b-a052909b5981 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:50.248379 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-944d87c8-b6b9-448d-9f7b-a052909b5981 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:50.308845 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944d87c8-b6b9-448d-9f7b-a052909b5981 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:50.312669 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d2865b-c33b-4871-8707-5ccc9e620c8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2d061d25d83443c9232218c90792d51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:50.313288 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d2865b-c33b-4871-8707-5ccc9e620c8c service neutron] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:50.313564 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d2865b-c33b-4871-8707-5ccc9e620c8c service neutron] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:50.313837 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d2865b-c33b-4871-8707-5ccc9e620c8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:50.324206 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d2865b-c33b-4871-8707-5ccc9e620c8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:50.325638 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d2865b-c33b-4871-8707-5ccc9e620c8c service neutron] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:50.335345 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1365/2737] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:40:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 11:40:50.625227 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a16b691-cb58-44ca-920c-43e09658d8a2 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:50.626956 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-5a16b691-cb58-44ca-920c-43e09658d8a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:50.643370 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a16b691-cb58-44ca-920c-43e09658d8a2 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:50.649496 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1e4154-36a8-4d7e-b322-a1cb56ece9cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:50.651527 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1e4154-36a8-4d7e-b322-a1cb56ece9cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:50.651527 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1e4154-36a8-4d7e-b322-a1cb56ece9cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:50.651527 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1e4154-36a8-4d7e-b322-a1cb56ece9cc admin admin] PATH_INFO: `/v3/projects/540eac0603544e23a7162f9fa4cfba64` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:50.653041 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1e4154-36a8-4d7e-b322-a1cb56ece9cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=540eac0603544e23a7162f9fa4cfba64)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:50.655281 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1e4154-36a8-4d7e-b322-a1cb56ece9cc admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:50.707160 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-ab1e4154-36a8-4d7e-b322-a1cb56ece9cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '540eac0603544e23a7162f9fa4cfba64', 'request_id': 'req-ab1e4154-36a8-4d7e-b322-a1cb56ece9cc'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:50.713534 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-ab1e4154-36a8-4d7e-b322-a1cb56ece9cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '540eac0603544e23a7162f9fa4cfba64', 'request_id': 'req-ab1e4154-36a8-4d7e-b322-a1cb56ece9cc'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:50.719367 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-ab1e4154-36a8-4d7e-b322-a1cb56ece9cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '540eac0603544e23a7162f9fa4cfba64', 'request_id': 'req-ab1e4154-36a8-4d7e-b322-a1cb56ece9cc'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:50.733060 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-ab1e4154-36a8-4d7e-b322-a1cb56ece9cc admin admin] The token cache is being invalidate because project 540eac0603544e23a7162f9fa4cfba64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81501) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:40:50.733354 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-ab1e4154-36a8-4d7e-b322-a1cb56ece9cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:50.733979 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-ab1e4154-36a8-4d7e-b322-a1cb56ece9cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:50.735560 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1373/2738] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 11:40:50 2022] DELETE /identity/v3/projects/540eac0603544e23a7162f9fa4cfba64 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:40:50.739633 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d2865b-c33b-4871-8707-5ccc9e620c8c service neutron] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:50.749775 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d2865b-c33b-4871-8707-5ccc9e620c8c service neutron] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:50.780104 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:40:50.810571 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7104af43-fd02-4171-875b-c8c03ca8a5f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:50.811422 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7104af43-fd02-4171-875b-c8c03ca8a5f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:50.811803 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7104af43-fd02-4171-875b-c8c03ca8a5f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:50.812169 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7104af43-fd02-4171-875b-c8c03ca8a5f7 admin admin] PATH_INFO: `/v3/users/96e992091adb41989fb12fa03f8d2372` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:50.813407 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7104af43-fd02-4171-875b-c8c03ca8a5f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=96e992091adb41989fb12fa03f8d2372)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:50.815504 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7104af43-fd02-4171-875b-c8c03ca8a5f7 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:50.868095 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-7104af43-fd02-4171-875b-c8c03ca8a5f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96e992091adb41989fb12fa03f8d2372'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:50.869054 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-7104af43-fd02-4171-875b-c8c03ca8a5f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96e992091adb41989fb12fa03f8d2372'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:50.877902 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-7104af43-fd02-4171-875b-c8c03ca8a5f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96e992091adb41989fb12fa03f8d2372'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:50.886446 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-7104af43-fd02-4171-875b-c8c03ca8a5f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96e992091adb41989fb12fa03f8d2372'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:50.887232 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-7104af43-fd02-4171-875b-c8c03ca8a5f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96e992091adb41989fb12fa03f8d2372'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:50.908621 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1366/2739] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 11:40:50 2022] DELETE /identity/v3/users/96e992091adb41989fb12fa03f8d2372 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:40:51.210239 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1e4154-36a8-4d7e-b322-a1cb56ece9cc admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:51.211851 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-ab1e4154-36a8-4d7e-b322-a1cb56ece9cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:51.238148 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1e4154-36a8-4d7e-b322-a1cb56ece9cc admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:51.277458 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:40:51.310009 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914bfa18-58d1-4e81-aa90-acc07ca18fc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:51.310009 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914bfa18-58d1-4e81-aa90-acc07ca18fc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:51.310009 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914bfa18-58d1-4e81-aa90-acc07ca18fc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:51.310009 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914bfa18-58d1-4e81-aa90-acc07ca18fc0 admin admin] PATH_INFO: `/v3/projects/7f9e726708464f7fbaf0fb094613386e` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:51.310377 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914bfa18-58d1-4e81-aa90-acc07ca18fc0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f9e726708464f7fbaf0fb094613386e)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:51.311241 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914bfa18-58d1-4e81-aa90-acc07ca18fc0 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:51.368057 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-914bfa18-58d1-4e81-aa90-acc07ca18fc0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f9e726708464f7fbaf0fb094613386e', 'request_id': 'req-914bfa18-58d1-4e81-aa90-acc07ca18fc0'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:51.368718 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-914bfa18-58d1-4e81-aa90-acc07ca18fc0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f9e726708464f7fbaf0fb094613386e', 'request_id': 'req-914bfa18-58d1-4e81-aa90-acc07ca18fc0'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:51.375951 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-914bfa18-58d1-4e81-aa90-acc07ca18fc0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f9e726708464f7fbaf0fb094613386e', 'request_id': 'req-914bfa18-58d1-4e81-aa90-acc07ca18fc0'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:51.391492 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-914bfa18-58d1-4e81-aa90-acc07ca18fc0 admin admin] The token cache is being invalidate because project 7f9e726708464f7fbaf0fb094613386e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81501) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:40:51.391787 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-914bfa18-58d1-4e81-aa90-acc07ca18fc0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:51.392469 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-914bfa18-58d1-4e81-aa90-acc07ca18fc0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:51.395699 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1374/2740] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 11:40:51 2022] DELETE /identity/v3/projects/7f9e726708464f7fbaf0fb094613386e => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:40:51.400731 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1db5eb1-effa-4b4c-8a44-851e00257e08 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:51.400731 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1db5eb1-effa-4b4c-8a44-851e00257e08 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:51.400731 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1db5eb1-effa-4b4c-8a44-851e00257e08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:51.426161 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-d1db5eb1-effa-4b4c-8a44-851e00257e08 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:40:51.427427 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-d1db5eb1-effa-4b4c-8a44-851e00257e08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:51.497416 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1367/2741] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:40:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:40:51.505290 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f275f7c-c20d-41cb-80f9-48f85f041173 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:51.505570 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f275f7c-c20d-41cb-80f9-48f85f041173 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:51.505846 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f275f7c-c20d-41cb-80f9-48f85f041173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:51.530078 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-1f275f7c-c20d-41cb-80f9-48f85f041173 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:40:51.531622 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-1f275f7c-c20d-41cb-80f9-48f85f041173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:51.542089 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1375/2742] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:40:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:40:51.546824 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1db5eb1-effa-4b4c-8a44-851e00257e08 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:51.557683 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1db5eb1-effa-4b4c-8a44-851e00257e08 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:51.567107 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031141b0-183f-4bb3-b775-4b69298a7043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:51.568270 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031141b0-183f-4bb3-b775-4b69298a7043 admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:51.568270 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031141b0-183f-4bb3-b775-4b69298a7043 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:51.568770 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031141b0-183f-4bb3-b775-4b69298a7043 admin admin] PATH_INFO: `/v3/domains` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:51.571222 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031141b0-183f-4bb3-b775-4b69298a7043 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:40:51.571632 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031141b0-183f-4bb3-b775-4b69298a7043 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:51.573445 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031141b0-183f-4bb3-b775-4b69298a7043 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:51.591733 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1368/2743] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 24 11:40:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:40:51.593015 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f275f7c-c20d-41cb-80f9-48f85f041173 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:51.605766 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f275f7c-c20d-41cb-80f9-48f85f041173 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:51.611662 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58f30c2-9d71-4e1e-babd-e6381060c832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:51.612295 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58f30c2-9d71-4e1e-babd-e6381060c832 admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:51.612554 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58f30c2-9d71-4e1e-babd-e6381060c832 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:51.612944 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58f30c2-9d71-4e1e-babd-e6381060c832 admin admin] PATH_INFO: `/v3/projects` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:51.613600 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58f30c2-9d71-4e1e-babd-e6381060c832 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:51.615962 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58f30c2-9d71-4e1e-babd-e6381060c832 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:51.649492 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1376/2744] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 11:40:51 2022] POST /identity/v3/projects => generated 369 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:40:51.650811 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031141b0-183f-4bb3-b775-4b69298a7043 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:51.663556 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031141b0-183f-4bb3-b775-4b69298a7043 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:51.725255 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:40:51.755216 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53505822-fee7-4216-8916-07d4e43e848b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:51.755842 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53505822-fee7-4216-8916-07d4e43e848b admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:51.756154 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53505822-fee7-4216-8916-07d4e43e848b admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:51.756422 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53505822-fee7-4216-8916-07d4e43e848b admin admin] PATH_INFO: `/v3/users` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:51.757062 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53505822-fee7-4216-8916-07d4e43e848b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:51.760159 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53505822-fee7-4216-8916-07d4e43e848b admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:51.790263 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1369/2745] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 11:40:51 2022] POST /identity/v3/users => generated 285 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:40:51.791683 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58f30c2-9d71-4e1e-babd-e6381060c832 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:51.802588 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58f30c2-9d71-4e1e-babd-e6381060c832 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:51.808563 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a39deba-162b-4f1e-908c-fcf89bfa227f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:51.809170 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a39deba-162b-4f1e-908c-fcf89bfa227f admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:51.809443 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a39deba-162b-4f1e-908c-fcf89bfa227f admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:51.809707 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a39deba-162b-4f1e-908c-fcf89bfa227f admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:51.810347 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a39deba-162b-4f1e-908c-fcf89bfa227f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:51.811976 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a39deba-162b-4f1e-908c-fcf89bfa227f admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:51.823536 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1377/2746] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:40:51 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:40:51.828504 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53505822-fee7-4216-8916-07d4e43e848b admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:51.839073 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53505822-fee7-4216-8916-07d4e43e848b admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:51.843831 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2380639-53ba-4963-9df6-bca0bcf7ed83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:51.844494 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2380639-53ba-4963-9df6-bca0bcf7ed83 admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:51.844769 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2380639-53ba-4963-9df6-bca0bcf7ed83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:51.845041 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2380639-53ba-4963-9df6-bca0bcf7ed83 admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:51.845781 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2380639-53ba-4963-9df6-bca0bcf7ed83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:51.847656 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2380639-53ba-4963-9df6-bca0bcf7ed83 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:51.858107 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1370/2747] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:40:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:40:51.862433 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a39deba-162b-4f1e-908c-fcf89bfa227f admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:51.872884 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a39deba-162b-4f1e-908c-fcf89bfa227f admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:51.877731 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb384ce9-24ac-405d-a781-bef0ceef8bb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:51.878411 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb384ce9-24ac-405d-a781-bef0ceef8bb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:51.878691 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb384ce9-24ac-405d-a781-bef0ceef8bb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:51.878960 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb384ce9-24ac-405d-a781-bef0ceef8bb5 admin admin] PATH_INFO: `/v3/projects/e41a2b4e83d64cb9929a525cc40e3e2c/users/6b405cd0c66d40f2aa467190a7208620/roles/27e3e65e24df4b86b0d3d18d3212101d` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:51.894121 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb384ce9-24ac-405d-a781-bef0ceef8bb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e41a2b4e83d64cb9929a525cc40e3e2c, user_id=6b405cd0c66d40f2aa467190a7208620, role_id=27e3e65e24df4b86b0d3d18d3212101d)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:51.896902 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb384ce9-24ac-405d-a781-bef0ceef8bb5 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:51.910714 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1378/2748] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 11:40:51 2022] PUT /identity/v3/projects/e41a2b4e83d64cb9929a525cc40e3e2c/users/6b405cd0c66d40f2aa467190a7208620/roles/27e3e65e24df4b86b0d3d18d3212101d => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 11:40:51.923278 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d3fb73-2270-423b-b327-266619d78ae0 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:51.923562 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d3fb73-2270-423b-b327-266619d78ae0 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:51.923833 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d3fb73-2270-423b-b327-266619d78ae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:51.963658 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-b3d3fb73-2270-423b-b327-266619d78ae0 None None] MFA Rules not processed for user `6b405cd0c66d40f2aa467190a7208620`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:40:51.964877 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-b3d3fb73-2270-423b-b327-266619d78ae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:52.032564 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1371/2749] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:40:51 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:40:52.035603 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb384ce9-24ac-405d-a781-bef0ceef8bb5 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:52.100064 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb384ce9-24ac-405d-a781-bef0ceef8bb5 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:52.104814 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f604afa5-74c2-4e53-b9b5-0d856f1f5047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:52.105430 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f604afa5-74c2-4e53-b9b5-0d856f1f5047 admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:52.105707 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f604afa5-74c2-4e53-b9b5-0d856f1f5047 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:52.105978 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f604afa5-74c2-4e53-b9b5-0d856f1f5047 admin admin] PATH_INFO: `/v3/projects` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:52.107112 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f604afa5-74c2-4e53-b9b5-0d856f1f5047 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:52.108564 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f604afa5-74c2-4e53-b9b5-0d856f1f5047 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:52.114182 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:40:52.139447 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1379/2750] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 11:40:52 2022] POST /identity/v3/projects => generated 367 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 11:40:52.143593 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d3fb73-2270-423b-b327-266619d78ae0 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:52.154307 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d3fb73-2270-423b-b327-266619d78ae0 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:52.213910 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f32e17-1f62-4f53-ad34-e1c15278a505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:52.214549 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f32e17-1f62-4f53-ad34-e1c15278a505 admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:52.214823 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f32e17-1f62-4f53-ad34-e1c15278a505 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:52.215088 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f32e17-1f62-4f53-ad34-e1c15278a505 admin admin] PATH_INFO: `/v3/users` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:52.215699 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f32e17-1f62-4f53-ad34-e1c15278a505 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:52.217612 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f32e17-1f62-4f53-ad34-e1c15278a505 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:52.241492 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1372/2751] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 11:40:52 2022] POST /identity/v3/users => generated 290 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:40:52.246099 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f604afa5-74c2-4e53-b9b5-0d856f1f5047 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:52.257439 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f604afa5-74c2-4e53-b9b5-0d856f1f5047 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:52.262390 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73a6838-9f1a-4d9e-a21e-598418d945d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:52.262985 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73a6838-9f1a-4d9e-a21e-598418d945d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:52.263259 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73a6838-9f1a-4d9e-a21e-598418d945d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:52.263494 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73a6838-9f1a-4d9e-a21e-598418d945d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:52.264195 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73a6838-9f1a-4d9e-a21e-598418d945d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:52.265816 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73a6838-9f1a-4d9e-a21e-598418d945d2 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:52.276114 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1380/2752] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:40:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:40:52.280309 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f32e17-1f62-4f53-ad34-e1c15278a505 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:52.290914 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f32e17-1f62-4f53-ad34-e1c15278a505 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:52.295972 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d9581a-1728-4fa5-9c4c-a75c4ca9c5b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:52.296616 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d9581a-1728-4fa5-9c4c-a75c4ca9c5b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:52.296890 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d9581a-1728-4fa5-9c4c-a75c4ca9c5b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:52.297163 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d9581a-1728-4fa5-9c4c-a75c4ca9c5b7 admin admin] PATH_INFO: `/v3/projects/0652d1b4b1704950acc7c2d87fbecf3e/users/89013b83c87240faa848d1cad564714d/roles/30bb1e97257f4ca5b90c88545777317b` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:52.312369 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d9581a-1728-4fa5-9c4c-a75c4ca9c5b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0652d1b4b1704950acc7c2d87fbecf3e, user_id=89013b83c87240faa848d1cad564714d, role_id=30bb1e97257f4ca5b90c88545777317b)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:52.315065 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d9581a-1728-4fa5-9c4c-a75c4ca9c5b7 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:52.330048 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1373/2753] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 11:40:52 2022] PUT /identity/v3/projects/0652d1b4b1704950acc7c2d87fbecf3e/users/89013b83c87240faa848d1cad564714d/roles/30bb1e97257f4ca5b90c88545777317b => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:40:52.334120 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73a6838-9f1a-4d9e-a21e-598418d945d2 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:52.344809 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73a6838-9f1a-4d9e-a21e-598418d945d2 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:52.410631 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fe7f26-16bd-429d-bf99-caadd4418473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:52.411238 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fe7f26-16bd-429d-bf99-caadd4418473 admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:52.411513 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fe7f26-16bd-429d-bf99-caadd4418473 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:52.411782 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fe7f26-16bd-429d-bf99-caadd4418473 admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:52.412425 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fe7f26-16bd-429d-bf99-caadd4418473 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:52.414060 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fe7f26-16bd-429d-bf99-caadd4418473 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:52.424387 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1381/2754] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:40:52 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:40:52.428772 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d9581a-1728-4fa5-9c4c-a75c4ca9c5b7 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:52.439409 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d9581a-1728-4fa5-9c4c-a75c4ca9c5b7 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:52.444418 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edbf02a-2c24-4c77-892b-c22a5b3cfa1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:52.445057 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edbf02a-2c24-4c77-892b-c22a5b3cfa1a admin admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:52.445337 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edbf02a-2c24-4c77-892b-c22a5b3cfa1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:52.445581 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edbf02a-2c24-4c77-892b-c22a5b3cfa1a admin admin] PATH_INFO: `/v3/projects/0652d1b4b1704950acc7c2d87fbecf3e/users/89013b83c87240faa848d1cad564714d/roles/30bb1e97257f4ca5b90c88545777317b` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:52.447645 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edbf02a-2c24-4c77-892b-c22a5b3cfa1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0652d1b4b1704950acc7c2d87fbecf3e, user_id=89013b83c87240faa848d1cad564714d, role_id=30bb1e97257f4ca5b90c88545777317b)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:52.450268 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edbf02a-2c24-4c77-892b-c22a5b3cfa1a admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:52.456666 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:40:52.461498 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1374/2755] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 11:40:52 2022] PUT /identity/v3/projects/0652d1b4b1704950acc7c2d87fbecf3e/users/89013b83c87240faa848d1cad564714d/roles/30bb1e97257f4ca5b90c88545777317b => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:40:52.471519 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8ae098-11e5-41f2-b401-a02e21b2c067 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:52.471806 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8ae098-11e5-41f2-b401-a02e21b2c067 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:52.472081 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8ae098-11e5-41f2-b401-a02e21b2c067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:52.500946 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-1e8ae098-11e5-41f2-b401-a02e21b2c067 None None] MFA Rules not processed for user `89013b83c87240faa848d1cad564714d`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:40:52.502122 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-1e8ae098-11e5-41f2-b401-a02e21b2c067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:52.575440 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1382/2756] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:40:52 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:40:52.587064 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edbf02a-2c24-4c77-892b-c22a5b3cfa1a admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:52.589016 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-6edbf02a-2c24-4c77-892b-c22a5b3cfa1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:52.648663 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edbf02a-2c24-4c77-892b-c22a5b3cfa1a admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:52.652581 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6955a1ef-2b61-4fa5-8824-f8215b89e288 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92862b76ba3b4513b5dc5b5c962faac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:52.653196 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6955a1ef-2b61-4fa5-8824-f8215b89e288 service cinder] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:52.653464 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6955a1ef-2b61-4fa5-8824-f8215b89e288 service cinder] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:52.653928 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6955a1ef-2b61-4fa5-8824-f8215b89e288 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:52.663696 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6955a1ef-2b61-4fa5-8824-f8215b89e288 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:52.665130 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6955a1ef-2b61-4fa5-8824-f8215b89e288 service cinder] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:52.674790 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1375/2757] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:40:52 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:40:54.130710 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8ae098-11e5-41f2-b401-a02e21b2c067 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:54.190594 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:40:54.195552 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8ae098-11e5-41f2-b401-a02e21b2c067 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:54.201093 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70736bb7-dddc-4116-86ab-c0d82b1f865f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:54.201731 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70736bb7-dddc-4116-86ab-c0d82b1f865f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:54.202010 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70736bb7-dddc-4116-86ab-c0d82b1f865f admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:54.202276 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70736bb7-dddc-4116-86ab-c0d82b1f865f admin admin] PATH_INFO: `/v3/users/6b405cd0c66d40f2aa467190a7208620` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:54.203542 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70736bb7-dddc-4116-86ab-c0d82b1f865f admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b405cd0c66d40f2aa467190a7208620)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:54.205563 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70736bb7-dddc-4116-86ab-c0d82b1f865f admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:54.253711 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-70736bb7-dddc-4116-86ab-c0d82b1f865f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b405cd0c66d40f2aa467190a7208620'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:54.254384 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-70736bb7-dddc-4116-86ab-c0d82b1f865f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b405cd0c66d40f2aa467190a7208620'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:54.254999 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-70736bb7-dddc-4116-86ab-c0d82b1f865f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b405cd0c66d40f2aa467190a7208620'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:54.262883 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-70736bb7-dddc-4116-86ab-c0d82b1f865f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b405cd0c66d40f2aa467190a7208620'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:54.270012 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-70736bb7-dddc-4116-86ab-c0d82b1f865f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b405cd0c66d40f2aa467190a7208620'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:54.287011 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1383/2758] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 11:40:54 2022] DELETE /identity/v3/users/6b405cd0c66d40f2aa467190a7208620 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:40:54.291641 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016ecfe4-531a-46fd-9422-ee8dacc7b3b2 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:54.292133 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016ecfe4-531a-46fd-9422-ee8dacc7b3b2 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:54.292257 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016ecfe4-531a-46fd-9422-ee8dacc7b3b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:54.311352 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-016ecfe4-531a-46fd-9422-ee8dacc7b3b2 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:40:54.312549 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-016ecfe4-531a-46fd-9422-ee8dacc7b3b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:54.372835 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1376/2759] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:40:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:40:54.382787 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70736bb7-dddc-4116-86ab-c0d82b1f865f admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:54.384360 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-70736bb7-dddc-4116-86ab-c0d82b1f865f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:54.444059 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70736bb7-dddc-4116-86ab-c0d82b1f865f admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:54.448537 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360d0a8f-7fd2-4acb-8e6f-abba6d4dcf63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2d061d25d83443c9232218c90792d51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:54.449177 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360d0a8f-7fd2-4acb-8e6f-abba6d4dcf63 service neutron] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:54.449471 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360d0a8f-7fd2-4acb-8e6f-abba6d4dcf63 service neutron] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:54.449747 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360d0a8f-7fd2-4acb-8e6f-abba6d4dcf63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:54.460095 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360d0a8f-7fd2-4acb-8e6f-abba6d4dcf63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:54.461558 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360d0a8f-7fd2-4acb-8e6f-abba6d4dcf63 service neutron] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:54.471357 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1384/2760] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:40:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:40:54.742225 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016ecfe4-531a-46fd-9422-ee8dacc7b3b2 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:54.743841 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-016ecfe4-531a-46fd-9422-ee8dacc7b3b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:54.756289 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016ecfe4-531a-46fd-9422-ee8dacc7b3b2 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:54.761712 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48206cb5-d5f8-4cbf-8749-4d78335916c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:54.762673 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48206cb5-d5f8-4cbf-8749-4d78335916c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:54.763009 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48206cb5-d5f8-4cbf-8749-4d78335916c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:54.763443 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48206cb5-d5f8-4cbf-8749-4d78335916c3 admin admin] PATH_INFO: `/v3/projects/e41a2b4e83d64cb9929a525cc40e3e2c` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:54.764682 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48206cb5-d5f8-4cbf-8749-4d78335916c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e41a2b4e83d64cb9929a525cc40e3e2c)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:54.766646 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48206cb5-d5f8-4cbf-8749-4d78335916c3 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:54.816491 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-48206cb5-d5f8-4cbf-8749-4d78335916c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e41a2b4e83d64cb9929a525cc40e3e2c', 'request_id': 'req-48206cb5-d5f8-4cbf-8749-4d78335916c3'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:54.822880 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-48206cb5-d5f8-4cbf-8749-4d78335916c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e41a2b4e83d64cb9929a525cc40e3e2c', 'request_id': 'req-48206cb5-d5f8-4cbf-8749-4d78335916c3'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:54.828853 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-48206cb5-d5f8-4cbf-8749-4d78335916c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e41a2b4e83d64cb9929a525cc40e3e2c', 'request_id': 'req-48206cb5-d5f8-4cbf-8749-4d78335916c3'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:54.842736 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-48206cb5-d5f8-4cbf-8749-4d78335916c3 admin admin] The token cache is being invalidate because project e41a2b4e83d64cb9929a525cc40e3e2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:40:54.843014 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-48206cb5-d5f8-4cbf-8749-4d78335916c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:54.843700 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-48206cb5-d5f8-4cbf-8749-4d78335916c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:54.845399 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1377/2761] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 11:40:54 2022] DELETE /identity/v3/projects/e41a2b4e83d64cb9929a525cc40e3e2c => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:40:54.849531 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360d0a8f-7fd2-4acb-8e6f-abba6d4dcf63 service neutron] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:54.859844 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360d0a8f-7fd2-4acb-8e6f-abba6d4dcf63 service neutron] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:54.921398 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4098a29-37a8-4ef9-8a82-80dbbe765513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:54.921947 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4098a29-37a8-4ef9-8a82-80dbbe765513 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:54.922222 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4098a29-37a8-4ef9-8a82-80dbbe765513 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:54.922519 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4098a29-37a8-4ef9-8a82-80dbbe765513 admin admin] PATH_INFO: `/v3/users/89013b83c87240faa848d1cad564714d` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:54.923662 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4098a29-37a8-4ef9-8a82-80dbbe765513 admin admin] RBAC: Authorizing `identity:delete_user(user_id=89013b83c87240faa848d1cad564714d)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:54.925612 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4098a29-37a8-4ef9-8a82-80dbbe765513 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:54.946496 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:40:54.973363 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-e4098a29-37a8-4ef9-8a82-80dbbe765513 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89013b83c87240faa848d1cad564714d'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:54.973991 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-e4098a29-37a8-4ef9-8a82-80dbbe765513 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89013b83c87240faa848d1cad564714d'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:54.974643 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-e4098a29-37a8-4ef9-8a82-80dbbe765513 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89013b83c87240faa848d1cad564714d'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:54.983659 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-e4098a29-37a8-4ef9-8a82-80dbbe765513 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89013b83c87240faa848d1cad564714d'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:54.990859 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-e4098a29-37a8-4ef9-8a82-80dbbe765513 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89013b83c87240faa848d1cad564714d'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:55.008082 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1385/2762] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 11:40:54 2022] DELETE /identity/v3/users/89013b83c87240faa848d1cad564714d => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:40:55.300020 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48206cb5-d5f8-4cbf-8749-4d78335916c3 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:55.301574 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-48206cb5-d5f8-4cbf-8749-4d78335916c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:55.316329 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48206cb5-d5f8-4cbf-8749-4d78335916c3 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:55.341730 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:40:55.379981 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154dbeb0-183c-4056-b46e-85c6a6027ed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:55.380764 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154dbeb0-183c-4056-b46e-85c6a6027ed4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:55.381007 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154dbeb0-183c-4056-b46e-85c6a6027ed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:55.381283 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154dbeb0-183c-4056-b46e-85c6a6027ed4 admin admin] PATH_INFO: `/v3/projects/0652d1b4b1704950acc7c2d87fbecf3e` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:55.382506 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154dbeb0-183c-4056-b46e-85c6a6027ed4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0652d1b4b1704950acc7c2d87fbecf3e)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:55.384461 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154dbeb0-183c-4056-b46e-85c6a6027ed4 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:55.433377 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-154dbeb0-183c-4056-b46e-85c6a6027ed4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0652d1b4b1704950acc7c2d87fbecf3e', 'request_id': 'req-154dbeb0-183c-4056-b46e-85c6a6027ed4'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:55.440332 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-154dbeb0-183c-4056-b46e-85c6a6027ed4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0652d1b4b1704950acc7c2d87fbecf3e', 'request_id': 'req-154dbeb0-183c-4056-b46e-85c6a6027ed4'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:55.446122 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-154dbeb0-183c-4056-b46e-85c6a6027ed4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0652d1b4b1704950acc7c2d87fbecf3e', 'request_id': 'req-154dbeb0-183c-4056-b46e-85c6a6027ed4'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:55.459157 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-154dbeb0-183c-4056-b46e-85c6a6027ed4 admin admin] The token cache is being invalidate because project 0652d1b4b1704950acc7c2d87fbecf3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:40:55.459436 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-154dbeb0-183c-4056-b46e-85c6a6027ed4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:55.460036 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-154dbeb0-183c-4056-b46e-85c6a6027ed4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:55.461535 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1378/2763] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 11:40:55 2022] DELETE /identity/v3/projects/0652d1b4b1704950acc7c2d87fbecf3e => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:40:55.466673 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7d56d7-1875-4130-9ae3-970e6560c9bf None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:55.467141 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7d56d7-1875-4130-9ae3-970e6560c9bf None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:55.467240 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7d56d7-1875-4130-9ae3-970e6560c9bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:55.487035 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-7c7d56d7-1875-4130-9ae3-970e6560c9bf None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:40:55.488322 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-7c7d56d7-1875-4130-9ae3-970e6560c9bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:55.549361 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1386/2764] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:40:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 11:40:55.557442 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713990d3-d43b-4637-9ada-f6c029c91d44 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:55.557730 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713990d3-d43b-4637-9ada-f6c029c91d44 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:55.558000 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713990d3-d43b-4637-9ada-f6c029c91d44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:55.579968 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-713990d3-d43b-4637-9ada-f6c029c91d44 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:40:55.581185 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-713990d3-d43b-4637-9ada-f6c029c91d44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:55.589672 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1379/2765] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:40:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:40:55.594025 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7d56d7-1875-4130-9ae3-970e6560c9bf None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:55.604972 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7d56d7-1875-4130-9ae3-970e6560c9bf None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:55.610076 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abddef43-7f77-4fa3-be48-d875d494905e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:55.610725 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abddef43-7f77-4fa3-be48-d875d494905e admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:55.611001 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abddef43-7f77-4fa3-be48-d875d494905e admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:55.611254 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abddef43-7f77-4fa3-be48-d875d494905e admin admin] PATH_INFO: `/v3/domains` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:55.611940 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abddef43-7f77-4fa3-be48-d875d494905e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:40:55.612241 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abddef43-7f77-4fa3-be48-d875d494905e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:55.613863 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abddef43-7f77-4fa3-be48-d875d494905e admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:55.626107 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1387/2766] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 24 11:40:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:40:55.630333 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713990d3-d43b-4637-9ada-f6c029c91d44 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:55.639791 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713990d3-d43b-4637-9ada-f6c029c91d44 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:55.644952 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48065fdb-d4cf-4d25-b50e-e0711a0b3fbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:55.645674 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48065fdb-d4cf-4d25-b50e-e0711a0b3fbc admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:55.645953 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48065fdb-d4cf-4d25-b50e-e0711a0b3fbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:55.646220 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48065fdb-d4cf-4d25-b50e-e0711a0b3fbc admin admin] PATH_INFO: `/v3/projects` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:55.646858 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48065fdb-d4cf-4d25-b50e-e0711a0b3fbc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:55.648912 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48065fdb-d4cf-4d25-b50e-e0711a0b3fbc admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:55.677003 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1380/2767] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 11:40:55 2022] POST /identity/v3/projects => generated 381 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:40:55.681294 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abddef43-7f77-4fa3-be48-d875d494905e admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:55.691800 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abddef43-7f77-4fa3-be48-d875d494905e admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:55.750431 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9887d1-db37-4c79-8dfc-81e3dc971db7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:55.751064 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9887d1-db37-4c79-8dfc-81e3dc971db7 admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:55.751342 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9887d1-db37-4c79-8dfc-81e3dc971db7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:55.751615 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9887d1-db37-4c79-8dfc-81e3dc971db7 admin admin] PATH_INFO: `/v3/users` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:55.752269 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9887d1-db37-4c79-8dfc-81e3dc971db7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:55.754224 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9887d1-db37-4c79-8dfc-81e3dc971db7 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:55.777667 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1388/2768] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 11:40:55 2022] POST /identity/v3/users => generated 291 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 11:40:55.781959 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48065fdb-d4cf-4d25-b50e-e0711a0b3fbc admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:55.792577 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48065fdb-d4cf-4d25-b50e-e0711a0b3fbc admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:55.798261 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2e9897-242d-4669-a07a-f735375c568b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:55.798899 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2e9897-242d-4669-a07a-f735375c568b admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:55.799180 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2e9897-242d-4669-a07a-f735375c568b admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:55.799447 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2e9897-242d-4669-a07a-f735375c568b admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:55.800264 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2e9897-242d-4669-a07a-f735375c568b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:55.801888 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2e9897-242d-4669-a07a-f735375c568b admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:55.813090 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1381/2769] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:40:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:40:55.817149 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9887d1-db37-4c79-8dfc-81e3dc971db7 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:55.827439 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9887d1-db37-4c79-8dfc-81e3dc971db7 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:55.833062 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b80e22a-d57a-4c4a-892f-ac18b33be8a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:55.833664 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b80e22a-d57a-4c4a-892f-ac18b33be8a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:55.833941 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b80e22a-d57a-4c4a-892f-ac18b33be8a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:55.834239 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b80e22a-d57a-4c4a-892f-ac18b33be8a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:55.834904 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b80e22a-d57a-4c4a-892f-ac18b33be8a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:55.836540 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b80e22a-d57a-4c4a-892f-ac18b33be8a1 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:55.847867 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1389/2770] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:40:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:40:55.852229 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2e9897-242d-4669-a07a-f735375c568b admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:55.863180 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2e9897-242d-4669-a07a-f735375c568b admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:55.869205 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb02c3e-831b-4705-8c64-92dc0d5ee270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:55.869874 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb02c3e-831b-4705-8c64-92dc0d5ee270 admin admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:55.870149 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb02c3e-831b-4705-8c64-92dc0d5ee270 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:55.870447 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb02c3e-831b-4705-8c64-92dc0d5ee270 admin admin] PATH_INFO: `/v3/projects/5d48612d7c3a4ae3b159e6134d1b6354/users/9861b8d3681b4e68b0f5851765ffbba2/roles/27e3e65e24df4b86b0d3d18d3212101d` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:55.885853 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb02c3e-831b-4705-8c64-92dc0d5ee270 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d48612d7c3a4ae3b159e6134d1b6354, user_id=9861b8d3681b4e68b0f5851765ffbba2, role_id=27e3e65e24df4b86b0d3d18d3212101d)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:55.888530 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb02c3e-831b-4705-8c64-92dc0d5ee270 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:55.904524 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1382/2771] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 11:40:55 2022] PUT /identity/v3/projects/5d48612d7c3a4ae3b159e6134d1b6354/users/9861b8d3681b4e68b0f5851765ffbba2/roles/27e3e65e24df4b86b0d3d18d3212101d => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:40:55.916190 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6991d51f-bbb5-4df0-b127-91eb9449678b None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:55.916502 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6991d51f-bbb5-4df0-b127-91eb9449678b None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:55.916796 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6991d51f-bbb5-4df0-b127-91eb9449678b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:55.925520 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:40:55.947793 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-6991d51f-bbb5-4df0-b127-91eb9449678b None None] MFA Rules not processed for user `9861b8d3681b4e68b0f5851765ffbba2`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:40:55.948924 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-6991d51f-bbb5-4df0-b127-91eb9449678b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:56.015415 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1390/2772] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:40:55 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:40:56.021620 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb02c3e-831b-4705-8c64-92dc0d5ee270 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:56.080740 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:40:56.091586 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb02c3e-831b-4705-8c64-92dc0d5ee270 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:56.097393 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a46f15c-21dd-4126-a817-22c47acaa49f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:56.098000 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a46f15c-21dd-4126-a817-22c47acaa49f admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:56.098274 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a46f15c-21dd-4126-a817-22c47acaa49f admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:56.098568 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a46f15c-21dd-4126-a817-22c47acaa49f admin admin] PATH_INFO: `/v3/projects` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:56.099189 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a46f15c-21dd-4126-a817-22c47acaa49f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:56.101089 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a46f15c-21dd-4126-a817-22c47acaa49f admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:56.130572 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1383/2773] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 11:40:56 2022] POST /identity/v3/projects => generated 381 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:40:56.134707 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6991d51f-bbb5-4df0-b127-91eb9449678b None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:56.145329 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6991d51f-bbb5-4df0-b127-91eb9449678b None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:56.201752 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd41be7-484d-469a-9041-e0f031c764ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:56.202298 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd41be7-484d-469a-9041-e0f031c764ad admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:56.203066 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd41be7-484d-469a-9041-e0f031c764ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:56.203066 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd41be7-484d-469a-9041-e0f031c764ad admin admin] PATH_INFO: `/v3/users` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:56.203637 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd41be7-484d-469a-9041-e0f031c764ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:56.205602 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd41be7-484d-469a-9041-e0f031c764ad admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:56.232106 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1391/2774] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 11:40:56 2022] POST /identity/v3/users => generated 297 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:40:56.233368 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a46f15c-21dd-4126-a817-22c47acaa49f admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:56.244207 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a46f15c-21dd-4126-a817-22c47acaa49f admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:56.248811 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd32782a-3ced-4f4f-aee4-07f476086242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:56.249404 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd32782a-3ced-4f4f-aee4-07f476086242 admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:56.249779 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd32782a-3ced-4f4f-aee4-07f476086242 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:56.250047 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd32782a-3ced-4f4f-aee4-07f476086242 admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:56.250726 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd32782a-3ced-4f4f-aee4-07f476086242 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:56.252356 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd32782a-3ced-4f4f-aee4-07f476086242 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:56.263729 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1384/2775] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:40:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:40:56.268081 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd41be7-484d-469a-9041-e0f031c764ad admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:56.277982 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd41be7-484d-469a-9041-e0f031c764ad admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:56.283080 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfed9b3-ed7c-4680-8aa2-67907d73a732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:56.283713 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfed9b3-ed7c-4680-8aa2-67907d73a732 admin admin] REQUEST_METHOD: `PUT` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:56.284008 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfed9b3-ed7c-4680-8aa2-67907d73a732 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:56.284276 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfed9b3-ed7c-4680-8aa2-67907d73a732 admin admin] PATH_INFO: `/v3/projects/65a44a3cf0094bdeb57d499d391a854b/users/e191c0aedff24aa5bf8a03187f62aaa2/roles/30bb1e97257f4ca5b90c88545777317b` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:56.304395 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfed9b3-ed7c-4680-8aa2-67907d73a732 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65a44a3cf0094bdeb57d499d391a854b, user_id=e191c0aedff24aa5bf8a03187f62aaa2, role_id=30bb1e97257f4ca5b90c88545777317b)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:56.307881 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfed9b3-ed7c-4680-8aa2-67907d73a732 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:56.319431 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd32782a-3ced-4f4f-aee4-07f476086242 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:56.321430 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-dd32782a-3ced-4f4f-aee4-07f476086242 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:56.325552 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1392/2776] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 11:40:56 2022] PUT /identity/v3/projects/65a44a3cf0094bdeb57d499d391a854b/users/e191c0aedff24aa5bf8a03187f62aaa2/roles/30bb1e97257f4ca5b90c88545777317b => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:40:56.329509 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfed9b3-ed7c-4680-8aa2-67907d73a732 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:56.340170 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd32782a-3ced-4f4f-aee4-07f476086242 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:56.399068 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfed9b3-ed7c-4680-8aa2-67907d73a732 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:56.403906 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1779e6-b676-4c42-bc27-089a6d79a06c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:56.404772 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1779e6-b676-4c42-bc27-089a6d79a06c admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:56.404772 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1779e6-b676-4c42-bc27-089a6d79a06c admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:56.405028 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1779e6-b676-4c42-bc27-089a6d79a06c admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:56.405675 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1779e6-b676-4c42-bc27-089a6d79a06c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:56.407445 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1779e6-b676-4c42-bc27-089a6d79a06c admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:56.408775 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:40:56.411139 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab8c39c-584a-4d09-9e5c-58f11fd7f9da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:56.411909 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab8c39c-584a-4d09-9e5c-58f11fd7f9da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:56.412293 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab8c39c-584a-4d09-9e5c-58f11fd7f9da admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:56.412638 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab8c39c-584a-4d09-9e5c-58f11fd7f9da admin admin] PATH_INFO: `/v3/users/777bc203d9f5473b938d54f6dfd7516a` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:56.413953 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab8c39c-584a-4d09-9e5c-58f11fd7f9da admin admin] RBAC: Authorizing `identity:delete_user(user_id=777bc203d9f5473b938d54f6dfd7516a)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:56.416467 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab8c39c-584a-4d09-9e5c-58f11fd7f9da admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:56.419911 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1393/2777] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:40:56 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 11:40:56.423584 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1779e6-b676-4c42-bc27-089a6d79a06c admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:56.433928 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1779e6-b676-4c42-bc27-089a6d79a06c admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:56.438630 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a931bd-7f62-4d02-b45c-357633da38e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:56.439392 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a931bd-7f62-4d02-b45c-357633da38e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:56.439724 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a931bd-7f62-4d02-b45c-357633da38e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:56.440001 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a931bd-7f62-4d02-b45c-357633da38e7 admin admin] PATH_INFO: `/v3/projects/65a44a3cf0094bdeb57d499d391a854b/users/e191c0aedff24aa5bf8a03187f62aaa2/roles/30bb1e97257f4ca5b90c88545777317b` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:56.441955 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a931bd-7f62-4d02-b45c-357633da38e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65a44a3cf0094bdeb57d499d391a854b, user_id=e191c0aedff24aa5bf8a03187f62aaa2, role_id=30bb1e97257f4ca5b90c88545777317b)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:56.444698 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a931bd-7f62-4d02-b45c-357633da38e7 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:56.456932 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1394/2778] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 11:40:56 2022] PUT /identity/v3/projects/65a44a3cf0094bdeb57d499d391a854b/users/e191c0aedff24aa5bf8a03187f62aaa2/roles/30bb1e97257f4ca5b90c88545777317b => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 11:40:56.467302 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab04757d-5a01-4a46-afc1-9ad5d6305ff4 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:56.467925 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab04757d-5a01-4a46-afc1-9ad5d6305ff4 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:56.467925 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab04757d-5a01-4a46-afc1-9ad5d6305ff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:56.468660 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-6ab8c39c-584a-4d09-9e5c-58f11fd7f9da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '777bc203d9f5473b938d54f6dfd7516a'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:56.469331 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-6ab8c39c-584a-4d09-9e5c-58f11fd7f9da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '777bc203d9f5473b938d54f6dfd7516a'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:56.479856 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-6ab8c39c-584a-4d09-9e5c-58f11fd7f9da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '777bc203d9f5473b938d54f6dfd7516a'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:56.487461 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-6ab8c39c-584a-4d09-9e5c-58f11fd7f9da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '777bc203d9f5473b938d54f6dfd7516a'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:56.488102 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-6ab8c39c-584a-4d09-9e5c-58f11fd7f9da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '777bc203d9f5473b938d54f6dfd7516a'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:56.496691 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-ab04757d-5a01-4a46-afc1-9ad5d6305ff4 None None] MFA Rules not processed for user `e191c0aedff24aa5bf8a03187f62aaa2`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:40:56.497935 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-ab04757d-5a01-4a46-afc1-9ad5d6305ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:56.507356 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1385/2779] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 11:40:56 2022] DELETE /identity/v3/users/777bc203d9f5473b938d54f6dfd7516a => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:40:56.512207 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3553aedb-c07d-4e0e-ab1f-33675f859397 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:56.512613 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3553aedb-c07d-4e0e-ab1f-33675f859397 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:56.512893 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3553aedb-c07d-4e0e-ab1f-33675f859397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:56.533911 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-3553aedb-c07d-4e0e-ab1f-33675f859397 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:40:56.535300 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-3553aedb-c07d-4e0e-ab1f-33675f859397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:56.586040 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1395/2780] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:40:56 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 11:40:56.592332 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:40:56.594492 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab04757d-5a01-4a46-afc1-9ad5d6305ff4 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:56.596442 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-ab04757d-5a01-4a46-afc1-9ad5d6305ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:56.618518 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1386/2781] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:40:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 11:40:56.629961 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3553aedb-c07d-4e0e-ab1f-33675f859397 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:56.631562 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-3553aedb-c07d-4e0e-ab1f-33675f859397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:56.656784 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab04757d-5a01-4a46-afc1-9ad5d6305ff4 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:56.694041 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3553aedb-c07d-4e0e-ab1f-33675f859397 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:56.697795 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efcc97d-aa3d-4d9b-ac21-cc9dd593b9aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2d061d25d83443c9232218c90792d51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:56.698468 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efcc97d-aa3d-4d9b-ac21-cc9dd593b9aa service neutron] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:56.698766 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efcc97d-aa3d-4d9b-ac21-cc9dd593b9aa service neutron] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:56.699059 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efcc97d-aa3d-4d9b-ac21-cc9dd593b9aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:56.708330 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efcc97d-aa3d-4d9b-ac21-cc9dd593b9aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:56.709690 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efcc97d-aa3d-4d9b-ac21-cc9dd593b9aa service neutron] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:56.716343 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ba7b37-77f5-485d-91f3-c02a855e8310 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92862b76ba3b4513b5dc5b5c962faac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:56.717312 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ba7b37-77f5-485d-91f3-c02a855e8310 service cinder] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:56.717841 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ba7b37-77f5-485d-91f3-c02a855e8310 service cinder] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:56.718271 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ba7b37-77f5-485d-91f3-c02a855e8310 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:56.719481 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1387/2782] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:40:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 11:40:56.772878 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:40:56.801021 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ba7b37-77f5-485d-91f3-c02a855e8310 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:56.802491 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ba7b37-77f5-485d-91f3-c02a855e8310 service cinder] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:56.813711 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1396/2783] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:40:56 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:40:57.039885 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efcc97d-aa3d-4d9b-ac21-cc9dd593b9aa service neutron] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:57.041632 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-4efcc97d-aa3d-4d9b-ac21-cc9dd593b9aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:57.062921 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efcc97d-aa3d-4d9b-ac21-cc9dd593b9aa service neutron] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:57.071265 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a89ec6-9aa2-43b7-acde-5015d44d1d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:57.072086 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a89ec6-9aa2-43b7-acde-5015d44d1d7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:57.072397 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a89ec6-9aa2-43b7-acde-5015d44d1d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:57.072784 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a89ec6-9aa2-43b7-acde-5015d44d1d7d admin admin] PATH_INFO: `/v3/projects/a39a9c099be346cab4cb19da1ecc92f1` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:57.074221 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a89ec6-9aa2-43b7-acde-5015d44d1d7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a39a9c099be346cab4cb19da1ecc92f1)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:57.076560 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a89ec6-9aa2-43b7-acde-5015d44d1d7d admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:57.154286 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-e3a89ec6-9aa2-43b7-acde-5015d44d1d7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a39a9c099be346cab4cb19da1ecc92f1', 'request_id': 'req-e3a89ec6-9aa2-43b7-acde-5015d44d1d7d'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:57.165693 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-e3a89ec6-9aa2-43b7-acde-5015d44d1d7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a39a9c099be346cab4cb19da1ecc92f1', 'request_id': 'req-e3a89ec6-9aa2-43b7-acde-5015d44d1d7d'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:57.171747 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-e3a89ec6-9aa2-43b7-acde-5015d44d1d7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a39a9c099be346cab4cb19da1ecc92f1', 'request_id': 'req-e3a89ec6-9aa2-43b7-acde-5015d44d1d7d'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:57.186571 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-e3a89ec6-9aa2-43b7-acde-5015d44d1d7d admin admin] The token cache is being invalidate because project a39a9c099be346cab4cb19da1ecc92f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:40:57.186996 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-e3a89ec6-9aa2-43b7-acde-5015d44d1d7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:57.187617 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-e3a89ec6-9aa2-43b7-acde-5015d44d1d7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:57.189557 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1388/2784] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 11:40:57 2022] DELETE /identity/v3/projects/a39a9c099be346cab4cb19da1ecc92f1 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:40:57.195906 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec89cf0-1b35-484c-8687-a0e87d91a5f8 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:57.196217 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec89cf0-1b35-484c-8687-a0e87d91a5f8 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:57.196479 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec89cf0-1b35-484c-8687-a0e87d91a5f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:57.225812 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-6ec89cf0-1b35-484c-8687-a0e87d91a5f8 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:40:57.227138 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-6ec89cf0-1b35-484c-8687-a0e87d91a5f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:57.292323 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1397/2785] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:40:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:40:57.300514 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4de850-6f58-49e0-a5b8-7dab89da4ca5 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:57.300829 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4de850-6f58-49e0-a5b8-7dab89da4ca5 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:57.301102 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4de850-6f58-49e0-a5b8-7dab89da4ca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:57.315711 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec89cf0-1b35-484c-8687-a0e87d91a5f8 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:57.317232 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-6ec89cf0-1b35-484c-8687-a0e87d91a5f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:57.325805 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-9a4de850-6f58-49e0-a5b8-7dab89da4ca5 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:40:57.326455 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-9a4de850-6f58-49e0-a5b8-7dab89da4ca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:57.329294 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec89cf0-1b35-484c-8687-a0e87d91a5f8 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:57.334539 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d7bc73-265d-4e9e-8f71-7b2f2a20a58b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:57.334816 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1389/2786] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:40:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 11:40:57.335174 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d7bc73-265d-4e9e-8f71-7b2f2a20a58b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:57.335449 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d7bc73-265d-4e9e-8f71-7b2f2a20a58b admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:57.335716 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d7bc73-265d-4e9e-8f71-7b2f2a20a58b admin admin] PATH_INFO: `/v3/users/9861b8d3681b4e68b0f5851765ffbba2` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:57.336883 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d7bc73-265d-4e9e-8f71-7b2f2a20a58b admin admin] RBAC: Authorizing `identity:delete_user(user_id=9861b8d3681b4e68b0f5851765ffbba2)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:57.338972 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d7bc73-265d-4e9e-8f71-7b2f2a20a58b admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:57.339125 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4de850-6f58-49e0-a5b8-7dab89da4ca5 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:57.348265 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4de850-6f58-49e0-a5b8-7dab89da4ca5 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:57.353071 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e370bd20-fb13-4735-bc6a-1ae475e94732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:57.353690 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e370bd20-fb13-4735-bc6a-1ae475e94732 admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:57.353959 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e370bd20-fb13-4735-bc6a-1ae475e94732 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:57.354223 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e370bd20-fb13-4735-bc6a-1ae475e94732 admin admin] PATH_INFO: `/v3/domains` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:57.354890 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e370bd20-fb13-4735-bc6a-1ae475e94732 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:40:57.355187 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e370bd20-fb13-4735-bc6a-1ae475e94732 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:57.356778 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e370bd20-fb13-4735-bc6a-1ae475e94732 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:57.369431 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1390/2787] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 24 11:40:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:40:57.374464 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e370bd20-fb13-4735-bc6a-1ae475e94732 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:57.383876 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e370bd20-fb13-4735-bc6a-1ae475e94732 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:57.387406 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-c7d7bc73-265d-4e9e-8f71-7b2f2a20a58b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9861b8d3681b4e68b0f5851765ffbba2'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:57.388062 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-c7d7bc73-265d-4e9e-8f71-7b2f2a20a58b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9861b8d3681b4e68b0f5851765ffbba2'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:57.388509 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855a58aa-3745-4857-b73b-c9a72cf1de3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:57.388658 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-c7d7bc73-265d-4e9e-8f71-7b2f2a20a58b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9861b8d3681b4e68b0f5851765ffbba2'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:57.389078 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855a58aa-3745-4857-b73b-c9a72cf1de3e admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:57.389349 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855a58aa-3745-4857-b73b-c9a72cf1de3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:57.389611 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855a58aa-3745-4857-b73b-c9a72cf1de3e admin admin] PATH_INFO: `/v3/projects` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:57.390216 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855a58aa-3745-4857-b73b-c9a72cf1de3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:57.392126 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855a58aa-3745-4857-b73b-c9a72cf1de3e admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:57.396448 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-c7d7bc73-265d-4e9e-8f71-7b2f2a20a58b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9861b8d3681b4e68b0f5851765ffbba2'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:57.403690 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-c7d7bc73-265d-4e9e-8f71-7b2f2a20a58b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9861b8d3681b4e68b0f5851765ffbba2'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:57.421964 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1398/2788] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 11:40:57 2022] DELETE /identity/v3/users/9861b8d3681b4e68b0f5851765ffbba2 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 11:40:57.426900 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1391/2789] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 11:40:57 2022] POST /identity/v3/projects => generated 375 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 11:40:57.427032 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c359d8dd-eb4a-4de7-a405-d73a672c4555 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:57.427032 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c359d8dd-eb4a-4de7-a405-d73a672c4555 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:57.427032 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c359d8dd-eb4a-4de7-a405-d73a672c4555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:57.427850 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855a58aa-3745-4857-b73b-c9a72cf1de3e admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:57.429412 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-855a58aa-3745-4857-b73b-c9a72cf1de3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:57.445538 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-c359d8dd-eb4a-4de7-a405-d73a672c4555 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:40:57.446750 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-c359d8dd-eb4a-4de7-a405-d73a672c4555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:57.466071 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:40:57.489340 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:40:57.501175 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855a58aa-3745-4857-b73b-c9a72cf1de3e admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:57.506083 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbf2995-6b8f-4fcf-8990-1c6564d40f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:57.506715 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbf2995-6b8f-4fcf-8990-1c6564d40f37 admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:57.506990 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbf2995-6b8f-4fcf-8990-1c6564d40f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:57.507258 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbf2995-6b8f-4fcf-8990-1c6564d40f37 admin admin] PATH_INFO: `/v3/users` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:57.507873 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbf2995-6b8f-4fcf-8990-1c6564d40f37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:57.508997 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1399/2790] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:40:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 11:40:57.509984 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbf2995-6b8f-4fcf-8990-1c6564d40f37 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:57.519022 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c359d8dd-eb4a-4de7-a405-d73a672c4555 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:57.520471 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-c359d8dd-eb4a-4de7-a405-d73a672c4555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:57.531843 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1392/2791] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 11:40:57 2022] POST /identity/v3/users => generated 288 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 11:40:57.535887 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbf2995-6b8f-4fcf-8990-1c6564d40f37 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:57.545532 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbf2995-6b8f-4fcf-8990-1c6564d40f37 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:57.550046 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d122fa24-b8f5-4de6-b72c-03f5bdce51c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:57.550656 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d122fa24-b8f5-4de6-b72c-03f5bdce51c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:57.550931 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d122fa24-b8f5-4de6-b72c-03f5bdce51c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:57.551194 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d122fa24-b8f5-4de6-b72c-03f5bdce51c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:57.551827 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d122fa24-b8f5-4de6-b72c-03f5bdce51c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:57.553414 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d122fa24-b8f5-4de6-b72c-03f5bdce51c4 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:57.563521 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1393/2792] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:40:57 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 11:40:57.567192 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d122fa24-b8f5-4de6-b72c-03f5bdce51c4 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:57.577117 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d122fa24-b8f5-4de6-b72c-03f5bdce51c4 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:57.582311 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef774c3-bbca-4e57-9750-f3323a5f3fe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:57.582641 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c359d8dd-eb4a-4de7-a405-d73a672c4555 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:57.582923 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef774c3-bbca-4e57-9750-f3323a5f3fe0 admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:57.583193 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef774c3-bbca-4e57-9750-f3323a5f3fe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:57.583454 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef774c3-bbca-4e57-9750-f3323a5f3fe0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:57.584080 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef774c3-bbca-4e57-9750-f3323a5f3fe0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:57.585832 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef774c3-bbca-4e57-9750-f3323a5f3fe0 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:57.586724 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cda8ab-18e6-4f5a-9688-42db7ff552e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2d061d25d83443c9232218c90792d51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:57.587339 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cda8ab-18e6-4f5a-9688-42db7ff552e0 service neutron] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:57.587620 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cda8ab-18e6-4f5a-9688-42db7ff552e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:57.588259 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cda8ab-18e6-4f5a-9688-42db7ff552e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:57.597919 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cda8ab-18e6-4f5a-9688-42db7ff552e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:57.598338 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1394/2793] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:40:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 11:40:57.599447 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cda8ab-18e6-4f5a-9688-42db7ff552e0 service neutron] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:57.602503 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef774c3-bbca-4e57-9750-f3323a5f3fe0 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:57.610907 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1400/2794] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:40:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 11:40:57.615117 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef774c3-bbca-4e57-9750-f3323a5f3fe0 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:57.621050 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69203682-86f9-4cfa-a994-7f22bd71097c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:57.621694 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69203682-86f9-4cfa-a994-7f22bd71097c admin admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:57.621966 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69203682-86f9-4cfa-a994-7f22bd71097c admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:57.622227 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69203682-86f9-4cfa-a994-7f22bd71097c admin admin] PATH_INFO: `/v3/projects/8f196798e25c483683716b39759893ea/users/5df4c5f36fad4705b30239a0b293ce7b/roles/27e3e65e24df4b86b0d3d18d3212101d` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:57.641064 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69203682-86f9-4cfa-a994-7f22bd71097c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f196798e25c483683716b39759893ea, user_id=5df4c5f36fad4705b30239a0b293ce7b, role_id=27e3e65e24df4b86b0d3d18d3212101d)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:57.643765 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69203682-86f9-4cfa-a994-7f22bd71097c admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:57.659610 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1395/2795] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 11:40:57 2022] PUT /identity/v3/projects/8f196798e25c483683716b39759893ea/users/5df4c5f36fad4705b30239a0b293ce7b/roles/27e3e65e24df4b86b0d3d18d3212101d => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:40:57.671483 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef035dc-dc1e-4a38-b3a1-ad41605825fd None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:57.671808 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef035dc-dc1e-4a38-b3a1-ad41605825fd None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:57.672068 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef035dc-dc1e-4a38-b3a1-ad41605825fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:57.701385 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-eef035dc-dc1e-4a38-b3a1-ad41605825fd None None] MFA Rules not processed for user `5df4c5f36fad4705b30239a0b293ce7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:40:57.702637 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-eef035dc-dc1e-4a38-b3a1-ad41605825fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:57.773135 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1401/2796] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:40:57 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:40:57.783950 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69203682-86f9-4cfa-a994-7f22bd71097c admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:57.785644 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-69203682-86f9-4cfa-a994-7f22bd71097c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:57.844447 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69203682-86f9-4cfa-a994-7f22bd71097c admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:57.848470 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77bfab1-36d3-4392-b310-0afd728d5f41 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92862b76ba3b4513b5dc5b5c962faac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:57.849083 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77bfab1-36d3-4392-b310-0afd728d5f41 service cinder] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:57.849367 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77bfab1-36d3-4392-b310-0afd728d5f41 service cinder] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:57.849627 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77bfab1-36d3-4392-b310-0afd728d5f41 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:57.858936 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77bfab1-36d3-4392-b310-0afd728d5f41 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:57.860382 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77bfab1-36d3-4392-b310-0afd728d5f41 service cinder] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:57.870083 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1396/2797] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:40:57 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:40:57.898385 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef035dc-dc1e-4a38-b3a1-ad41605825fd None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:57.899905 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-eef035dc-dc1e-4a38-b3a1-ad41605825fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:57.971772 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef035dc-dc1e-4a38-b3a1-ad41605825fd None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:57.976676 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2915c4d9-381e-40ae-86cd-895c6e351892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:57.977319 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2915c4d9-381e-40ae-86cd-895c6e351892 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:57.977597 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2915c4d9-381e-40ae-86cd-895c6e351892 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:57.977894 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2915c4d9-381e-40ae-86cd-895c6e351892 admin admin] PATH_INFO: `/v3/projects/5d48612d7c3a4ae3b159e6134d1b6354` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:57.979118 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2915c4d9-381e-40ae-86cd-895c6e351892 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d48612d7c3a4ae3b159e6134d1b6354)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:57.981118 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2915c4d9-381e-40ae-86cd-895c6e351892 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:58.005000 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:40:58.029135 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-2915c4d9-381e-40ae-86cd-895c6e351892 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d48612d7c3a4ae3b159e6134d1b6354', 'request_id': 'req-2915c4d9-381e-40ae-86cd-895c6e351892'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:58.035144 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-2915c4d9-381e-40ae-86cd-895c6e351892 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d48612d7c3a4ae3b159e6134d1b6354', 'request_id': 'req-2915c4d9-381e-40ae-86cd-895c6e351892'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:58.040781 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-2915c4d9-381e-40ae-86cd-895c6e351892 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d48612d7c3a4ae3b159e6134d1b6354', 'request_id': 'req-2915c4d9-381e-40ae-86cd-895c6e351892'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:58.054862 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-2915c4d9-381e-40ae-86cd-895c6e351892 admin admin] The token cache is being invalidate because project 5d48612d7c3a4ae3b159e6134d1b6354 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81501) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:40:58.055144 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-2915c4d9-381e-40ae-86cd-895c6e351892 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:58.055761 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-2915c4d9-381e-40ae-86cd-895c6e351892 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:58.057348 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1402/2798] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 11:40:57 2022] DELETE /identity/v3/projects/5d48612d7c3a4ae3b159e6134d1b6354 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:40:58.061548 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77bfab1-36d3-4392-b310-0afd728d5f41 service cinder] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:58.072663 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77bfab1-36d3-4392-b310-0afd728d5f41 service cinder] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:58.139024 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6ef437-6703-40ee-afa0-a315b662f50b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:58.139754 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6ef437-6703-40ee-afa0-a315b662f50b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:58.140093 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6ef437-6703-40ee-afa0-a315b662f50b admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:58.140426 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6ef437-6703-40ee-afa0-a315b662f50b admin admin] PATH_INFO: `/v3/users/e191c0aedff24aa5bf8a03187f62aaa2` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:58.141620 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6ef437-6703-40ee-afa0-a315b662f50b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e191c0aedff24aa5bf8a03187f62aaa2)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:58.143680 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6ef437-6703-40ee-afa0-a315b662f50b admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:58.167427 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:40:58.218668 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-7b6ef437-6703-40ee-afa0-a315b662f50b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e191c0aedff24aa5bf8a03187f62aaa2'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:58.218668 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-7b6ef437-6703-40ee-afa0-a315b662f50b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e191c0aedff24aa5bf8a03187f62aaa2'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:58.225119 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-7b6ef437-6703-40ee-afa0-a315b662f50b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e191c0aedff24aa5bf8a03187f62aaa2'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:58.234050 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-7b6ef437-6703-40ee-afa0-a315b662f50b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e191c0aedff24aa5bf8a03187f62aaa2'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:58.234779 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-7b6ef437-6703-40ee-afa0-a315b662f50b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e191c0aedff24aa5bf8a03187f62aaa2'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:58.265089 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1397/2799] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 11:40:58 2022] DELETE /identity/v3/users/e191c0aedff24aa5bf8a03187f62aaa2 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 11:40:58.588025 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2915c4d9-381e-40ae-86cd-895c6e351892 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:58.589633 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-2915c4d9-381e-40ae-86cd-895c6e351892 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:58.602786 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2915c4d9-381e-40ae-86cd-895c6e351892 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:58.663748 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519b767e-65fd-44f2-8183-3f19b9389c24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:58.664399 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519b767e-65fd-44f2-8183-3f19b9389c24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:58.664674 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519b767e-65fd-44f2-8183-3f19b9389c24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:58.664944 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519b767e-65fd-44f2-8183-3f19b9389c24 admin admin] PATH_INFO: `/v3/projects/65a44a3cf0094bdeb57d499d391a854b` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:58.666251 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519b767e-65fd-44f2-8183-3f19b9389c24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=65a44a3cf0094bdeb57d499d391a854b)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:58.668222 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519b767e-65fd-44f2-8183-3f19b9389c24 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:58.719240 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-519b767e-65fd-44f2-8183-3f19b9389c24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65a44a3cf0094bdeb57d499d391a854b', 'request_id': 'req-519b767e-65fd-44f2-8183-3f19b9389c24'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:58.726223 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-519b767e-65fd-44f2-8183-3f19b9389c24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65a44a3cf0094bdeb57d499d391a854b', 'request_id': 'req-519b767e-65fd-44f2-8183-3f19b9389c24'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:58.732231 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-519b767e-65fd-44f2-8183-3f19b9389c24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65a44a3cf0094bdeb57d499d391a854b', 'request_id': 'req-519b767e-65fd-44f2-8183-3f19b9389c24'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:58.746164 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-519b767e-65fd-44f2-8183-3f19b9389c24 admin admin] The token cache is being invalidate because project 65a44a3cf0094bdeb57d499d391a854b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81501) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:40:58.746520 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-519b767e-65fd-44f2-8183-3f19b9389c24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:58.747194 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-519b767e-65fd-44f2-8183-3f19b9389c24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:58.748772 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1403/2800] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 11:40:58 2022] DELETE /identity/v3/projects/65a44a3cf0094bdeb57d499d391a854b => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:40:58.753768 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee36c3da-67a7-49c1-81d1-2082dc77b343 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:58.754255 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee36c3da-67a7-49c1-81d1-2082dc77b343 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:58.754379 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee36c3da-67a7-49c1-81d1-2082dc77b343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:58.776283 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-ee36c3da-67a7-49c1-81d1-2082dc77b343 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:40:58.777597 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-ee36c3da-67a7-49c1-81d1-2082dc77b343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:58.853194 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1398/2801] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:40:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:40:58.863209 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0baa39-299f-48c5-8c66-3c5f4aea6c56 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:58.863481 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0baa39-299f-48c5-8c66-3c5f4aea6c56 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:58.863828 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0baa39-299f-48c5-8c66-3c5f4aea6c56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:58.887617 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-ad0baa39-299f-48c5-8c66-3c5f4aea6c56 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:40:58.888876 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-ad0baa39-299f-48c5-8c66-3c5f4aea6c56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:58.898193 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1404/2802] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:40:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:40:58.902907 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee36c3da-67a7-49c1-81d1-2082dc77b343 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:58.914183 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee36c3da-67a7-49c1-81d1-2082dc77b343 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:58.919050 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa721b9f-8f44-4bff-bdfe-b6a34f33aa89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:58.919835 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa721b9f-8f44-4bff-bdfe-b6a34f33aa89 admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:58.920160 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa721b9f-8f44-4bff-bdfe-b6a34f33aa89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:58.920431 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa721b9f-8f44-4bff-bdfe-b6a34f33aa89 admin admin] PATH_INFO: `/v3/domains` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:58.921172 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa721b9f-8f44-4bff-bdfe-b6a34f33aa89 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:40:58.921589 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa721b9f-8f44-4bff-bdfe-b6a34f33aa89 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:58.923318 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa721b9f-8f44-4bff-bdfe-b6a34f33aa89 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:58.935616 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1399/2803] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 24 11:40:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:40:58.940124 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0baa39-299f-48c5-8c66-3c5f4aea6c56 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:58.949962 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0baa39-299f-48c5-8c66-3c5f4aea6c56 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:58.954927 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac9ccf1-b9d6-4636-9fd7-dce4f047a527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:58.956132 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac9ccf1-b9d6-4636-9fd7-dce4f047a527 admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:58.956435 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac9ccf1-b9d6-4636-9fd7-dce4f047a527 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:58.956713 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac9ccf1-b9d6-4636-9fd7-dce4f047a527 admin admin] PATH_INFO: `/v3/projects` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:58.957517 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac9ccf1-b9d6-4636-9fd7-dce4f047a527 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:58.959504 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac9ccf1-b9d6-4636-9fd7-dce4f047a527 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:58.989329 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1405/2804] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 11:40:58 2022] POST /identity/v3/projects => generated 385 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:40:58.994278 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa721b9f-8f44-4bff-bdfe-b6a34f33aa89 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:59.007076 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa721b9f-8f44-4bff-bdfe-b6a34f33aa89 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:59.085767 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4101b0-723d-43d8-b3cc-816337711181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:59.086275 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4101b0-723d-43d8-b3cc-816337711181 admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:59.086577 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4101b0-723d-43d8-b3cc-816337711181 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:59.086841 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4101b0-723d-43d8-b3cc-816337711181 admin admin] PATH_INFO: `/v3/users` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:59.087462 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4101b0-723d-43d8-b3cc-816337711181 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:59.089378 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4101b0-723d-43d8-b3cc-816337711181 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:59.112172 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1400/2805] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 11:40:58 2022] POST /identity/v3/users => generated 293 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 11:40:59.116774 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac9ccf1-b9d6-4636-9fd7-dce4f047a527 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:59.130741 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac9ccf1-b9d6-4636-9fd7-dce4f047a527 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:59.137092 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7c968d-fb24-48f7-ad94-83f0e977c1af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:59.137690 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7c968d-fb24-48f7-ad94-83f0e977c1af admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:59.137966 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7c968d-fb24-48f7-ad94-83f0e977c1af admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:59.138234 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7c968d-fb24-48f7-ad94-83f0e977c1af admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:59.138964 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7c968d-fb24-48f7-ad94-83f0e977c1af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:59.140605 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7c968d-fb24-48f7-ad94-83f0e977c1af admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:59.146187 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:INSERT=3 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:40:59.151587 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1406/2806] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:40:59 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:40:59.156023 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4101b0-723d-43d8-b3cc-816337711181 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:59.166230 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4101b0-723d-43d8-b3cc-816337711181 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:59.171202 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd96b347-20ba-49d2-92c8-607ea09abfd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:59.171802 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd96b347-20ba-49d2-92c8-607ea09abfd7 admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:59.172075 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd96b347-20ba-49d2-92c8-607ea09abfd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:59.172342 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd96b347-20ba-49d2-92c8-607ea09abfd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:59.173019 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd96b347-20ba-49d2-92c8-607ea09abfd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:59.174673 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd96b347-20ba-49d2-92c8-607ea09abfd7 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:59.185862 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1401/2807] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:40:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:40:59.189701 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7c968d-fb24-48f7-ad94-83f0e977c1af admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:59.199995 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7c968d-fb24-48f7-ad94-83f0e977c1af admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:59.204927 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fa02c1-c0dd-4997-98ef-832300cd388a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:59.205609 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fa02c1-c0dd-4997-98ef-832300cd388a admin admin] REQUEST_METHOD: `PUT` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:59.205853 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fa02c1-c0dd-4997-98ef-832300cd388a admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:59.206106 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fa02c1-c0dd-4997-98ef-832300cd388a admin admin] PATH_INFO: `/v3/projects/53b8ace4ceda48bf818d68c96c3da3ef/users/c1114c0eb3c54a5d8a2a36ff4b4fa91e/roles/27e3e65e24df4b86b0d3d18d3212101d` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:59.222289 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fa02c1-c0dd-4997-98ef-832300cd388a admin admin] RBAC: Authorizing `identity:create_grant(project_id=53b8ace4ceda48bf818d68c96c3da3ef, user_id=c1114c0eb3c54a5d8a2a36ff4b4fa91e, role_id=27e3e65e24df4b86b0d3d18d3212101d)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:59.225081 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fa02c1-c0dd-4997-98ef-832300cd388a admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:59.239043 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1407/2808] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 11:40:59 2022] PUT /identity/v3/projects/53b8ace4ceda48bf818d68c96c3da3ef/users/c1114c0eb3c54a5d8a2a36ff4b4fa91e/roles/27e3e65e24df4b86b0d3d18d3212101d => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:40:59.252789 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7135ab5-1653-4a17-b2f6-78edcb947591 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:59.253061 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7135ab5-1653-4a17-b2f6-78edcb947591 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:59.253315 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7135ab5-1653-4a17-b2f6-78edcb947591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:59.261202 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:DELETE=8,keystone:SELECT=88,keystone:INSERT=4 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:40:59.284853 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-e7135ab5-1653-4a17-b2f6-78edcb947591 None None] MFA Rules not processed for user `c1114c0eb3c54a5d8a2a36ff4b4fa91e`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:40:59.286025 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-e7135ab5-1653-4a17-b2f6-78edcb947591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:59.353172 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1402/2809] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:40:59 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:40:59.365271 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fa02c1-c0dd-4997-98ef-832300cd388a admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:59.367166 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-f2fa02c1-c0dd-4997-98ef-832300cd388a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:59.428516 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fa02c1-c0dd-4997-98ef-832300cd388a admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:59.432288 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662a4b36-02c6-4adb-8385-b4df06c82405 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92862b76ba3b4513b5dc5b5c962faac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:59.433025 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662a4b36-02c6-4adb-8385-b4df06c82405 service cinder] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:59.433514 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662a4b36-02c6-4adb-8385-b4df06c82405 service cinder] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:59.433896 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662a4b36-02c6-4adb-8385-b4df06c82405 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:59.457169 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e065b0-3492-4927-853b-def20d0be5ef None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:59.457169 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e065b0-3492-4927-853b-def20d0be5ef None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:59.457169 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e065b0-3492-4927-853b-def20d0be5ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:59.461298 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662a4b36-02c6-4adb-8385-b4df06c82405 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:59.462932 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662a4b36-02c6-4adb-8385-b4df06c82405 service cinder] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:59.472685 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1408/2810] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:40:59 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:40:59.478408 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-d0e065b0-3492-4927-853b-def20d0be5ef None None] MFA Rules not processed for user `b80442b1eedf4039a913166f38ed9ae7`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:40:59.479677 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-d0e065b0-3492-4927-853b-def20d0be5ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:59.492210 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662a4b36-02c6-4adb-8385-b4df06c82405 service cinder] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:59.547828 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1403/2811] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:40:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 11:40:59.579461 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662a4b36-02c6-4adb-8385-b4df06c82405 service cinder] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:59.585533 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af1ca54-bbe6-4759-807a-bdc8c5bb6ac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:59.586242 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af1ca54-bbe6-4759-807a-bdc8c5bb6ac4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:59.586714 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af1ca54-bbe6-4759-807a-bdc8c5bb6ac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:59.587063 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af1ca54-bbe6-4759-807a-bdc8c5bb6ac4 admin admin] PATH_INFO: `/v3/users/c1114c0eb3c54a5d8a2a36ff4b4fa91e` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:59.589169 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af1ca54-bbe6-4759-807a-bdc8c5bb6ac4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1114c0eb3c54a5d8a2a36ff4b4fa91e)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:59.591937 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af1ca54-bbe6-4759-807a-bdc8c5bb6ac4 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:59.645811 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-9af1ca54-bbe6-4759-807a-bdc8c5bb6ac4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1114c0eb3c54a5d8a2a36ff4b4fa91e'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:59.646530 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-9af1ca54-bbe6-4759-807a-bdc8c5bb6ac4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1114c0eb3c54a5d8a2a36ff4b4fa91e'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:59.647575 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-9af1ca54-bbe6-4759-807a-bdc8c5bb6ac4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1114c0eb3c54a5d8a2a36ff4b4fa91e'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:59.658519 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-9af1ca54-bbe6-4759-807a-bdc8c5bb6ac4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1114c0eb3c54a5d8a2a36ff4b4fa91e'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:59.668334 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-9af1ca54-bbe6-4759-807a-bdc8c5bb6ac4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1114c0eb3c54a5d8a2a36ff4b4fa91e'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:40:59.684212 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:40:59.693565 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1409/2812] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 11:40:59 2022] DELETE /identity/v3/users/c1114c0eb3c54a5d8a2a36ff4b4fa91e => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 11:40:59.695133 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154b6b8e-9cd6-4d65-bb35-14e5ab2eaef5 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:59.695425 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154b6b8e-9cd6-4d65-bb35-14e5ab2eaef5 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:59.695699 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154b6b8e-9cd6-4d65-bb35-14e5ab2eaef5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:59.731865 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-154b6b8e-9cd6-4d65-bb35-14e5ab2eaef5 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:40:59.733446 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-154b6b8e-9cd6-4d65-bb35-14e5ab2eaef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:59.818130 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af1ca54-bbe6-4759-807a-bdc8c5bb6ac4 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:59.819318 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1404/2813] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:40:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:40:59.822997 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-9af1ca54-bbe6-4759-807a-bdc8c5bb6ac4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:59.830317 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154b6b8e-9cd6-4d65-bb35-14e5ab2eaef5 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:59.831753 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-154b6b8e-9cd6-4d65-bb35-14e5ab2eaef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:59.878038 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:40:59.886783 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af1ca54-bbe6-4759-807a-bdc8c5bb6ac4 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:59.890707 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364b5995-8325-4801-a9b5-28ce4a617ec0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2d061d25d83443c9232218c90792d51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:59.891323 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364b5995-8325-4801-a9b5-28ce4a617ec0 service neutron] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:59.891719 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364b5995-8325-4801-a9b5-28ce4a617ec0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:59.892005 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364b5995-8325-4801-a9b5-28ce4a617ec0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:59.893918 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-364b5995-8325-4801-a9b5-28ce4a617ec0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:59.894138 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154b6b8e-9cd6-4d65-bb35-14e5ab2eaef5 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:59.897709 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3debd1da-a7bc-47a2-abe5-2b318fb47650 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2d061d25d83443c9232218c90792d51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:59.898321 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3debd1da-a7bc-47a2-abe5-2b318fb47650 service neutron] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:59.898625 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3debd1da-a7bc-47a2-abe5-2b318fb47650 service neutron] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:59.898895 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3debd1da-a7bc-47a2-abe5-2b318fb47650 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:59.903922 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364b5995-8325-4801-a9b5-28ce4a617ec0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:59.905362 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364b5995-8325-4801-a9b5-28ce4a617ec0 service neutron] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:59.909074 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3debd1da-a7bc-47a2-abe5-2b318fb47650 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:59.910724 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3debd1da-a7bc-47a2-abe5-2b318fb47650 service neutron] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:59.913518 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1410/2814] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:40:59 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:40:59.922233 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1405/2815] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:40:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:41:00.349013 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364b5995-8325-4801-a9b5-28ce4a617ec0 service neutron] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:41:00.350703 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-364b5995-8325-4801-a9b5-28ce4a617ec0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:41:00.373298 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364b5995-8325-4801-a9b5-28ce4a617ec0 service neutron] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:41:00.379776 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad32256c-b6b2-4590-8aa6-78c83361e5ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:41:00.380663 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad32256c-b6b2-4590-8aa6-78c83361e5ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:41:00.381096 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad32256c-b6b2-4590-8aa6-78c83361e5ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:41:00.381544 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad32256c-b6b2-4590-8aa6-78c83361e5ec admin admin] PATH_INFO: `/v3/projects/53b8ace4ceda48bf818d68c96c3da3ef` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:41:00.383762 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad32256c-b6b2-4590-8aa6-78c83361e5ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=53b8ace4ceda48bf818d68c96c3da3ef)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:41:00.385939 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad32256c-b6b2-4590-8aa6-78c83361e5ec admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:41:00.440516 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-ad32256c-b6b2-4590-8aa6-78c83361e5ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53b8ace4ceda48bf818d68c96c3da3ef', 'request_id': 'req-ad32256c-b6b2-4590-8aa6-78c83361e5ec'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:41:00.447691 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-ad32256c-b6b2-4590-8aa6-78c83361e5ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53b8ace4ceda48bf818d68c96c3da3ef', 'request_id': 'req-ad32256c-b6b2-4590-8aa6-78c83361e5ec'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:41:00.453755 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-ad32256c-b6b2-4590-8aa6-78c83361e5ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53b8ace4ceda48bf818d68c96c3da3ef', 'request_id': 'req-ad32256c-b6b2-4590-8aa6-78c83361e5ec'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:41:00.467240 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-ad32256c-b6b2-4590-8aa6-78c83361e5ec admin admin] The token cache is being invalidate because project 53b8ace4ceda48bf818d68c96c3da3ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81501) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:41:00.467412 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-ad32256c-b6b2-4590-8aa6-78c83361e5ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:41:00.468068 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-ad32256c-b6b2-4590-8aa6-78c83361e5ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:41:00.469551 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1411/2816] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 11:41:00 2022] DELETE /identity/v3/projects/53b8ace4ceda48bf818d68c96c3da3ef => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:41:00.474740 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8443e1-88b8-42ed-8a81-ce55ea420539 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:41:00.475109 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8443e1-88b8-42ed-8a81-ce55ea420539 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:41:00.475388 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8443e1-88b8-42ed-8a81-ce55ea420539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:41:00.495484 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-fc8443e1-88b8-42ed-8a81-ce55ea420539 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:41:00.496657 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-fc8443e1-88b8-42ed-8a81-ce55ea420539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:41:00.565794 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1406/2817] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:41:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:41:00.567770 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6459c9a5-ccdc-438b-aef1-bd6a521cdc99 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:41:00.568055 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6459c9a5-ccdc-438b-aef1-bd6a521cdc99 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:41:00.568686 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6459c9a5-ccdc-438b-aef1-bd6a521cdc99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:41:00.589309 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-6459c9a5-ccdc-438b-aef1-bd6a521cdc99 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:41:00.590457 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-6459c9a5-ccdc-438b-aef1-bd6a521cdc99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:41:00.599012 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1412/2818] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:41:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 11:41:00.603308 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8443e1-88b8-42ed-8a81-ce55ea420539 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:41:00.614115 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8443e1-88b8-42ed-8a81-ce55ea420539 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:41:00.619391 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6842c6-0671-4d00-9c12-f894ba0c33d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:41:00.619997 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6842c6-0671-4d00-9c12-f894ba0c33d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:41:00.620392 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6842c6-0671-4d00-9c12-f894ba0c33d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:41:00.620667 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6842c6-0671-4d00-9c12-f894ba0c33d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:41:00.621456 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6842c6-0671-4d00-9c12-f894ba0c33d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:41:00.621639 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6842c6-0671-4d00-9c12-f894ba0c33d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:41:00.623398 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6842c6-0671-4d00-9c12-f894ba0c33d7 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:41:00.637157 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1407/2819] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 24 11:41:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:41:00.641416 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6459c9a5-ccdc-438b-aef1-bd6a521cdc99 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:41:00.650950 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6459c9a5-ccdc-438b-aef1-bd6a521cdc99 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:41:00.656079 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2333fd50-8028-4b82-a3d1-d5c91835328c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:41:00.656629 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2333fd50-8028-4b82-a3d1-d5c91835328c admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:41:00.656920 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2333fd50-8028-4b82-a3d1-d5c91835328c admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:41:00.657170 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2333fd50-8028-4b82-a3d1-d5c91835328c admin admin] PATH_INFO: `/v3/projects` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:41:00.657798 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2333fd50-8028-4b82-a3d1-d5c91835328c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:41:00.659745 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2333fd50-8028-4b82-a3d1-d5c91835328c admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:41:00.689243 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1413/2820] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 11:41:00 2022] POST /identity/v3/projects => generated 375 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 11:41:00.693480 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6842c6-0671-4d00-9c12-f894ba0c33d7 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:41:00.704490 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6842c6-0671-4d00-9c12-f894ba0c33d7 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:41:00.769273 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3d44e6-0b26-4181-b2ce-1c404d7a464e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:41:00.769885 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3d44e6-0b26-4181-b2ce-1c404d7a464e admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:41:00.770163 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3d44e6-0b26-4181-b2ce-1c404d7a464e admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:41:00.770529 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3d44e6-0b26-4181-b2ce-1c404d7a464e admin admin] PATH_INFO: `/v3/users` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:41:00.771176 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3d44e6-0b26-4181-b2ce-1c404d7a464e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:41:00.773108 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3d44e6-0b26-4181-b2ce-1c404d7a464e admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:41:00.798218 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1408/2821] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 11:41:00 2022] POST /identity/v3/users => generated 288 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:41:00.802451 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2333fd50-8028-4b82-a3d1-d5c91835328c admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:41:00.814742 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2333fd50-8028-4b82-a3d1-d5c91835328c admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:41:00.821155 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ec6c86-381d-47e8-ad9a-ecfc0ff68901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:41:00.822554 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ec6c86-381d-47e8-ad9a-ecfc0ff68901 admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:41:00.823134 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ec6c86-381d-47e8-ad9a-ecfc0ff68901 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:41:00.823568 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ec6c86-381d-47e8-ad9a-ecfc0ff68901 admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:41:00.836148 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ec6c86-381d-47e8-ad9a-ecfc0ff68901 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:41:00.838178 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ec6c86-381d-47e8-ad9a-ecfc0ff68901 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:41:00.850393 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1414/2822] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:41:00 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:41:00.854687 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3d44e6-0b26-4181-b2ce-1c404d7a464e admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:41:00.866683 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3d44e6-0b26-4181-b2ce-1c404d7a464e admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:41:00.871709 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eb05fe-89e5-43bb-9058-6aacad7f2671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:41:00.872319 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eb05fe-89e5-43bb-9058-6aacad7f2671 admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:41:00.872594 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eb05fe-89e5-43bb-9058-6aacad7f2671 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:41:00.872863 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eb05fe-89e5-43bb-9058-6aacad7f2671 admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:41:00.873514 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2eb05fe-89e5-43bb-9058-6aacad7f2671 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:41:00.875157 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2eb05fe-89e5-43bb-9058-6aacad7f2671 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:41:00.889906 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1409/2823] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:41:00 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:41:00.891432 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ec6c86-381d-47e8-ad9a-ecfc0ff68901 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:41:00.902239 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ec6c86-381d-47e8-ad9a-ecfc0ff68901 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:41:00.907015 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c464c1-5c4a-4390-9040-eeac89b63a7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:41:00.907701 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c464c1-5c4a-4390-9040-eeac89b63a7f admin admin] REQUEST_METHOD: `PUT` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:41:00.907986 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c464c1-5c4a-4390-9040-eeac89b63a7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:41:00.908251 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c464c1-5c4a-4390-9040-eeac89b63a7f admin admin] PATH_INFO: `/v3/projects/882ddf3b66ef4a1dabe243f6be7f536c/users/1135aa7684f6409faa61711ee83d11c0/roles/27e3e65e24df4b86b0d3d18d3212101d` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:41:00.925981 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c464c1-5c4a-4390-9040-eeac89b63a7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=882ddf3b66ef4a1dabe243f6be7f536c, user_id=1135aa7684f6409faa61711ee83d11c0, role_id=27e3e65e24df4b86b0d3d18d3212101d)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:41:00.929010 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c464c1-5c4a-4390-9040-eeac89b63a7f admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:41:00.944828 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1415/2824] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 11:41:00 2022] PUT /identity/v3/projects/882ddf3b66ef4a1dabe243f6be7f536c/users/1135aa7684f6409faa61711ee83d11c0/roles/27e3e65e24df4b86b0d3d18d3212101d => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:41:00.956889 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ca6b1c-58de-4dc0-8325-57c9f4138af6 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:41:00.957201 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ca6b1c-58de-4dc0-8325-57c9f4138af6 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:41:00.957474 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ca6b1c-58de-4dc0-8325-57c9f4138af6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:41:00.991036 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-b8ca6b1c-58de-4dc0-8325-57c9f4138af6 None None] MFA Rules not processed for user `1135aa7684f6409faa61711ee83d11c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:41:00.992387 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-b8ca6b1c-58de-4dc0-8325-57c9f4138af6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:41:01.028508 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:41:01.064660 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1410/2825] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:41:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:41:01.069566 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c464c1-5c4a-4390-9040-eeac89b63a7f admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:41:01.091526 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:41:01.157330 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c464c1-5c4a-4390-9040-eeac89b63a7f admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:41:01.162273 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542621bc-d63f-4791-be1c-5162b7a4ebbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:41:01.162911 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542621bc-d63f-4791-be1c-5162b7a4ebbe admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:41:01.163555 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542621bc-d63f-4791-be1c-5162b7a4ebbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:41:01.163555 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542621bc-d63f-4791-be1c-5162b7a4ebbe admin admin] PATH_INFO: `/v3/projects` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:41:01.164140 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542621bc-d63f-4791-be1c-5162b7a4ebbe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:41:01.166230 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542621bc-d63f-4791-be1c-5162b7a4ebbe admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:41:01.203045 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1416/2826] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 11:41:01 2022] POST /identity/v3/projects => generated 371 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 11:41:01.207707 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ca6b1c-58de-4dc0-8325-57c9f4138af6 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:41:01.220779 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ca6b1c-58de-4dc0-8325-57c9f4138af6 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:41:01.284186 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3235a939-92fc-4a8f-9887-cf51664fdc88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:41:01.284828 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3235a939-92fc-4a8f-9887-cf51664fdc88 admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:41:01.285092 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3235a939-92fc-4a8f-9887-cf51664fdc88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:41:01.285365 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3235a939-92fc-4a8f-9887-cf51664fdc88 admin admin] PATH_INFO: `/v3/users` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:41:01.286018 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3235a939-92fc-4a8f-9887-cf51664fdc88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:41:01.288326 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3235a939-92fc-4a8f-9887-cf51664fdc88 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:41:01.313980 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1411/2827] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 11:41:01 2022] POST /identity/v3/users => generated 292 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:41:01.319161 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542621bc-d63f-4791-be1c-5162b7a4ebbe admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:41:01.330344 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542621bc-d63f-4791-be1c-5162b7a4ebbe admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:41:01.335360 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fed29b-bd34-4762-ba34-f0500e8acfae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:41:01.335980 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fed29b-bd34-4762-ba34-f0500e8acfae admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:41:01.336258 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fed29b-bd34-4762-ba34-f0500e8acfae admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:41:01.336530 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fed29b-bd34-4762-ba34-f0500e8acfae admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:41:01.337185 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fed29b-bd34-4762-ba34-f0500e8acfae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:41:01.338955 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fed29b-bd34-4762-ba34-f0500e8acfae admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:41:01.350788 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1417/2828] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:41:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:41:01.355619 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3235a939-92fc-4a8f-9887-cf51664fdc88 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:41:01.368193 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3235a939-92fc-4a8f-9887-cf51664fdc88 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:41:01.374143 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41085eab-9f71-48a8-83c8-d32bdc636b3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:41:01.374850 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41085eab-9f71-48a8-83c8-d32bdc636b3e admin admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:41:01.375173 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41085eab-9f71-48a8-83c8-d32bdc636b3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:41:01.375675 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41085eab-9f71-48a8-83c8-d32bdc636b3e admin admin] PATH_INFO: `/v3/projects/b33b811ad3ee4b9a928b18dd1fd70ef5/users/a6811a76b2984c6eaff47a2136ddf72c/roles/30bb1e97257f4ca5b90c88545777317b` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:41:01.395816 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41085eab-9f71-48a8-83c8-d32bdc636b3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b33b811ad3ee4b9a928b18dd1fd70ef5, user_id=a6811a76b2984c6eaff47a2136ddf72c, role_id=30bb1e97257f4ca5b90c88545777317b)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:41:01.398464 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41085eab-9f71-48a8-83c8-d32bdc636b3e admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:41:01.416525 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1412/2829] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 11:41:01 2022] PUT /identity/v3/projects/b33b811ad3ee4b9a928b18dd1fd70ef5/users/a6811a76b2984c6eaff47a2136ddf72c/roles/30bb1e97257f4ca5b90c88545777317b => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:41:01.420529 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fed29b-bd34-4762-ba34-f0500e8acfae admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:41:01.432270 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fed29b-bd34-4762-ba34-f0500e8acfae admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:41:01.505773 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e10f261-ea8b-4df3-a85d-2aefb2f47be8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:41:01.506445 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e10f261-ea8b-4df3-a85d-2aefb2f47be8 admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:41:01.506721 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e10f261-ea8b-4df3-a85d-2aefb2f47be8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:41:01.507153 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e10f261-ea8b-4df3-a85d-2aefb2f47be8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:41:01.507807 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e10f261-ea8b-4df3-a85d-2aefb2f47be8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:41:01.509421 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e10f261-ea8b-4df3-a85d-2aefb2f47be8 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:41:01.520585 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1418/2830] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:41:01 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:41:01.525172 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41085eab-9f71-48a8-83c8-d32bdc636b3e admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:41:01.535831 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41085eab-9f71-48a8-83c8-d32bdc636b3e admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:41:01.540912 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408c2c9a-0e2e-47db-8d96-80039e3c1266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:41:01.541592 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408c2c9a-0e2e-47db-8d96-80039e3c1266 admin admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:41:01.541871 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408c2c9a-0e2e-47db-8d96-80039e3c1266 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:41:01.542150 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408c2c9a-0e2e-47db-8d96-80039e3c1266 admin admin] PATH_INFO: `/v3/projects/b33b811ad3ee4b9a928b18dd1fd70ef5/users/a6811a76b2984c6eaff47a2136ddf72c/roles/30bb1e97257f4ca5b90c88545777317b` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:41:01.544171 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408c2c9a-0e2e-47db-8d96-80039e3c1266 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b33b811ad3ee4b9a928b18dd1fd70ef5, user_id=a6811a76b2984c6eaff47a2136ddf72c, role_id=30bb1e97257f4ca5b90c88545777317b)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:41:01.546860 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408c2c9a-0e2e-47db-8d96-80039e3c1266 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:41:01.558394 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1413/2831] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 11:41:01 2022] PUT /identity/v3/projects/b33b811ad3ee4b9a928b18dd1fd70ef5/users/a6811a76b2984c6eaff47a2136ddf72c/roles/30bb1e97257f4ca5b90c88545777317b => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:41:01.568628 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c7f43c-4eb5-44db-b510-12f0a34e4c5e None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:41:01.569197 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c7f43c-4eb5-44db-b510-12f0a34e4c5e None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:41:01.569533 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c7f43c-4eb5-44db-b510-12f0a34e4c5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:41:01.601375 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-59c7f43c-4eb5-44db-b510-12f0a34e4c5e None None] MFA Rules not processed for user `a6811a76b2984c6eaff47a2136ddf72c`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:41:01.602716 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-59c7f43c-4eb5-44db-b510-12f0a34e4c5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:41:01.673934 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1419/2832] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:41:01 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:41:01.685289 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408c2c9a-0e2e-47db-8d96-80039e3c1266 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:41:01.687177 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-408c2c9a-0e2e-47db-8d96-80039e3c1266 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:41:01.750582 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408c2c9a-0e2e-47db-8d96-80039e3c1266 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:41:01.754279 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f585a1-3f20-4974-bab4-414f7f310608 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92862b76ba3b4513b5dc5b5c962faac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:41:01.754919 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f585a1-3f20-4974-bab4-414f7f310608 service cinder] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:41:01.755197 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f585a1-3f20-4974-bab4-414f7f310608 service cinder] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:41:01.755465 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f585a1-3f20-4974-bab4-414f7f310608 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:41:01.797896 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:41:01.814808 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f585a1-3f20-4974-bab4-414f7f310608 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:41:01.816257 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f585a1-3f20-4974-bab4-414f7f310608 service cinder] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:41:01.826099 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1414/2833] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:41:01 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:41:04.392532 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c7f43c-4eb5-44db-b510-12f0a34e4c5e None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:41:04.412022 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:41:04.461005 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c7f43c-4eb5-44db-b510-12f0a34e4c5e None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:41:04.465601 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7375bda1-68d2-4bf1-95dc-a6408fc33bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:41:04.466237 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7375bda1-68d2-4bf1-95dc-a6408fc33bc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:41:04.466545 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7375bda1-68d2-4bf1-95dc-a6408fc33bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:41:04.466816 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7375bda1-68d2-4bf1-95dc-a6408fc33bc5 admin admin] PATH_INFO: `/v3/users/1135aa7684f6409faa61711ee83d11c0` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:41:04.467931 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7375bda1-68d2-4bf1-95dc-a6408fc33bc5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1135aa7684f6409faa61711ee83d11c0)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:41:04.469999 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7375bda1-68d2-4bf1-95dc-a6408fc33bc5 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:41:04.522072 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-7375bda1-68d2-4bf1-95dc-a6408fc33bc5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1135aa7684f6409faa61711ee83d11c0'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:41:04.522818 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-7375bda1-68d2-4bf1-95dc-a6408fc33bc5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1135aa7684f6409faa61711ee83d11c0'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:41:04.523480 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-7375bda1-68d2-4bf1-95dc-a6408fc33bc5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1135aa7684f6409faa61711ee83d11c0'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:41:04.530998 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-7375bda1-68d2-4bf1-95dc-a6408fc33bc5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1135aa7684f6409faa61711ee83d11c0'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:41:04.542442 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-7375bda1-68d2-4bf1-95dc-a6408fc33bc5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1135aa7684f6409faa61711ee83d11c0'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:41:04.563825 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1420/2834] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 11:41:04 2022] DELETE /identity/v3/users/1135aa7684f6409faa61711ee83d11c0 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:41:04.568418 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83da9e8-f066-4fee-93bc-1c9c2bacc511 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:41:04.568932 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83da9e8-f066-4fee-93bc-1c9c2bacc511 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:41:04.568932 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83da9e8-f066-4fee-93bc-1c9c2bacc511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:41:04.590111 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-c83da9e8-f066-4fee-93bc-1c9c2bacc511 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:41:04.590306 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-c83da9e8-f066-4fee-93bc-1c9c2bacc511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:41:04.657594 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1415/2835] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:41:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:41:04.668225 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7375bda1-68d2-4bf1-95dc-a6408fc33bc5 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:41:04.669788 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-7375bda1-68d2-4bf1-95dc-a6408fc33bc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:41:04.730375 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7375bda1-68d2-4bf1-95dc-a6408fc33bc5 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:41:04.734429 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ec053d-750a-4bd0-a973-8c8e291276e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2d061d25d83443c9232218c90792d51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:41:04.735045 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ec053d-750a-4bd0-a973-8c8e291276e6 service neutron] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:41:04.735324 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ec053d-750a-4bd0-a973-8c8e291276e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:41:04.735594 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ec053d-750a-4bd0-a973-8c8e291276e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:41:04.745239 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ec053d-750a-4bd0-a973-8c8e291276e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:41:04.746799 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ec053d-750a-4bd0-a973-8c8e291276e6 service neutron] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:41:04.757165 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1421/2836] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:41:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:41:05.048468 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83da9e8-f066-4fee-93bc-1c9c2bacc511 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:41:05.050020 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-c83da9e8-f066-4fee-93bc-1c9c2bacc511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:41:05.063826 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83da9e8-f066-4fee-93bc-1c9c2bacc511 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:41:05.068779 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ef4b4a-2608-4288-96be-93a4a1723c53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:41:05.069508 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ef4b4a-2608-4288-96be-93a4a1723c53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:41:05.069846 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ef4b4a-2608-4288-96be-93a4a1723c53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:41:05.070184 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ef4b4a-2608-4288-96be-93a4a1723c53 admin admin] PATH_INFO: `/v3/projects/882ddf3b66ef4a1dabe243f6be7f536c` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:41:05.071352 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ef4b4a-2608-4288-96be-93a4a1723c53 admin admin] RBAC: Authorizing `identity:delete_project(project_id=882ddf3b66ef4a1dabe243f6be7f536c)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:41:05.073366 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ef4b4a-2608-4288-96be-93a4a1723c53 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:41:05.123644 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-93ef4b4a-2608-4288-96be-93a4a1723c53 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '882ddf3b66ef4a1dabe243f6be7f536c', 'request_id': 'req-93ef4b4a-2608-4288-96be-93a4a1723c53'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:41:05.130038 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-93ef4b4a-2608-4288-96be-93a4a1723c53 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '882ddf3b66ef4a1dabe243f6be7f536c', 'request_id': 'req-93ef4b4a-2608-4288-96be-93a4a1723c53'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:41:05.135761 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-93ef4b4a-2608-4288-96be-93a4a1723c53 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '882ddf3b66ef4a1dabe243f6be7f536c', 'request_id': 'req-93ef4b4a-2608-4288-96be-93a4a1723c53'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:41:05.149437 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-93ef4b4a-2608-4288-96be-93a4a1723c53 admin admin] The token cache is being invalidate because project 882ddf3b66ef4a1dabe243f6be7f536c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:41:05.149717 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-93ef4b4a-2608-4288-96be-93a4a1723c53 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:41:05.150312 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-93ef4b4a-2608-4288-96be-93a4a1723c53 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:41:05.151912 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1416/2837] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 11:41:05 2022] DELETE /identity/v3/projects/882ddf3b66ef4a1dabe243f6be7f536c => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:41:05.156043 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ec053d-750a-4bd0-a973-8c8e291276e6 service neutron] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:41:05.166502 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ec053d-750a-4bd0-a973-8c8e291276e6 service neutron] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:41:05.204804 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:41:05.229873 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47631461-21af-4f3e-9142-cbd0a644d47a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:41:05.230544 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47631461-21af-4f3e-9142-cbd0a644d47a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:41:05.230824 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47631461-21af-4f3e-9142-cbd0a644d47a admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:41:05.231096 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47631461-21af-4f3e-9142-cbd0a644d47a admin admin] PATH_INFO: `/v3/users/a6811a76b2984c6eaff47a2136ddf72c` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:41:05.232259 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47631461-21af-4f3e-9142-cbd0a644d47a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6811a76b2984c6eaff47a2136ddf72c)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:41:05.234203 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47631461-21af-4f3e-9142-cbd0a644d47a admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:41:05.286586 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-47631461-21af-4f3e-9142-cbd0a644d47a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6811a76b2984c6eaff47a2136ddf72c'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:41:05.287337 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-47631461-21af-4f3e-9142-cbd0a644d47a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6811a76b2984c6eaff47a2136ddf72c'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:41:05.288049 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-47631461-21af-4f3e-9142-cbd0a644d47a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6811a76b2984c6eaff47a2136ddf72c'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:41:05.296340 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-47631461-21af-4f3e-9142-cbd0a644d47a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6811a76b2984c6eaff47a2136ddf72c'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:41:05.304202 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-47631461-21af-4f3e-9142-cbd0a644d47a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6811a76b2984c6eaff47a2136ddf72c'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:41:05.322654 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1422/2838] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 11:41:05 2022] DELETE /identity/v3/users/a6811a76b2984c6eaff47a2136ddf72c => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 11:41:05.620718 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ef4b4a-2608-4288-96be-93a4a1723c53 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:41:05.622370 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-93ef4b4a-2608-4288-96be-93a4a1723c53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:41:05.636810 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ef4b4a-2608-4288-96be-93a4a1723c53 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:41:05.696546 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602576d6-0c7f-4040-a699-a568abc38a7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:41:05.697249 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602576d6-0c7f-4040-a699-a568abc38a7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:41:05.697527 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602576d6-0c7f-4040-a699-a568abc38a7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:41:05.697797 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602576d6-0c7f-4040-a699-a568abc38a7a admin admin] PATH_INFO: `/v3/projects/b33b811ad3ee4b9a928b18dd1fd70ef5` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:41:05.698964 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602576d6-0c7f-4040-a699-a568abc38a7a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b33b811ad3ee4b9a928b18dd1fd70ef5)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:41:05.700878 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602576d6-0c7f-4040-a699-a568abc38a7a admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:41:05.709084 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:41:05.755959 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-602576d6-0c7f-4040-a699-a568abc38a7a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b33b811ad3ee4b9a928b18dd1fd70ef5', 'request_id': 'req-602576d6-0c7f-4040-a699-a568abc38a7a'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:41:05.763540 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-602576d6-0c7f-4040-a699-a568abc38a7a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b33b811ad3ee4b9a928b18dd1fd70ef5', 'request_id': 'req-602576d6-0c7f-4040-a699-a568abc38a7a'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:41:05.771030 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-602576d6-0c7f-4040-a699-a568abc38a7a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b33b811ad3ee4b9a928b18dd1fd70ef5', 'request_id': 'req-602576d6-0c7f-4040-a699-a568abc38a7a'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:41:05.788299 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-602576d6-0c7f-4040-a699-a568abc38a7a admin admin] The token cache is being invalidate because project b33b811ad3ee4b9a928b18dd1fd70ef5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:41:05.788746 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-602576d6-0c7f-4040-a699-a568abc38a7a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:41:05.789449 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-602576d6-0c7f-4040-a699-a568abc38a7a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:41:05.791535 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1417/2839] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 11:41:05 2022] DELETE /identity/v3/projects/b33b811ad3ee4b9a928b18dd1fd70ef5 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:41:05.796857 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8d064c-031a-4951-8014-91c4a052f8fb None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:41:05.797365 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8d064c-031a-4951-8014-91c4a052f8fb None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:41:05.798249 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8d064c-031a-4951-8014-91c4a052f8fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:41:05.826190 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-ca8d064c-031a-4951-8014-91c4a052f8fb None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:41:05.827930 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-ca8d064c-031a-4951-8014-91c4a052f8fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:41:05.894312 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1423/2840] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:41:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:41:05.902403 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b55c4c-26e5-4a16-8efd-de08940f3550 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:41:05.902806 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b55c4c-26e5-4a16-8efd-de08940f3550 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:41:05.903187 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b55c4c-26e5-4a16-8efd-de08940f3550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:41:05.926064 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-57b55c4c-26e5-4a16-8efd-de08940f3550 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:41:05.927488 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-57b55c4c-26e5-4a16-8efd-de08940f3550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:41:05.936582 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1418/2841] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:41:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:41:05.941326 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8d064c-031a-4951-8014-91c4a052f8fb None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:41:05.951323 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8d064c-031a-4951-8014-91c4a052f8fb None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:41:05.956171 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a8764e-1c03-4034-a72f-cbc92192e981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:41:05.956775 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a8764e-1c03-4034-a72f-cbc92192e981 admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:41:05.957050 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a8764e-1c03-4034-a72f-cbc92192e981 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:41:05.957445 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a8764e-1c03-4034-a72f-cbc92192e981 admin admin] PATH_INFO: `/v3/domains` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:41:05.958139 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a8764e-1c03-4034-a72f-cbc92192e981 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:41:05.958482 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a8764e-1c03-4034-a72f-cbc92192e981 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:41:05.960274 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a8764e-1c03-4034-a72f-cbc92192e981 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:41:05.973592 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1424/2842] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 24 11:41:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:41:05.978018 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b55c4c-26e5-4a16-8efd-de08940f3550 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:41:05.987848 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b55c4c-26e5-4a16-8efd-de08940f3550 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:41:05.993942 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94fa88d-8cdf-4393-b4c7-b5d6940cf968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:41:05.994593 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94fa88d-8cdf-4393-b4c7-b5d6940cf968 admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:41:05.994868 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94fa88d-8cdf-4393-b4c7-b5d6940cf968 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:41:05.995573 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94fa88d-8cdf-4393-b4c7-b5d6940cf968 admin admin] PATH_INFO: `/v3/projects` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:41:05.995784 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94fa88d-8cdf-4393-b4c7-b5d6940cf968 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:41:05.997710 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94fa88d-8cdf-4393-b4c7-b5d6940cf968 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:41:06.031071 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1419/2843] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 11:41:05 2022] POST /identity/v3/projects => generated 377 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:41:06.032388 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a8764e-1c03-4034-a72f-cbc92192e981 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:41:06.042545 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a8764e-1c03-4034-a72f-cbc92192e981 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:41:06.089638 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:41:06.107999 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d4e2ed-faf8-44cc-b499-e45032ce4f1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:41:06.108748 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d4e2ed-faf8-44cc-b499-e45032ce4f1c admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:41:06.109026 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d4e2ed-faf8-44cc-b499-e45032ce4f1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:41:06.109320 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d4e2ed-faf8-44cc-b499-e45032ce4f1c admin admin] PATH_INFO: `/v3/users` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:41:06.109954 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d4e2ed-faf8-44cc-b499-e45032ce4f1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:41:06.111960 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d4e2ed-faf8-44cc-b499-e45032ce4f1c admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:41:06.135862 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1425/2844] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 11:41:06 2022] POST /identity/v3/users => generated 289 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:41:06.141160 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94fa88d-8cdf-4393-b4c7-b5d6940cf968 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:41:06.151923 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94fa88d-8cdf-4393-b4c7-b5d6940cf968 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:41:06.159286 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31466c5e-11d8-4232-ab11-4dc305d6d15c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:41:06.160267 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31466c5e-11d8-4232-ab11-4dc305d6d15c admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:41:06.160628 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31466c5e-11d8-4232-ab11-4dc305d6d15c admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:41:06.160971 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31466c5e-11d8-4232-ab11-4dc305d6d15c admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:41:06.161898 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31466c5e-11d8-4232-ab11-4dc305d6d15c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:41:06.164423 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31466c5e-11d8-4232-ab11-4dc305d6d15c admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:41:06.175033 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1420/2845] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:41:06 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 11:41:06.179257 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d4e2ed-faf8-44cc-b499-e45032ce4f1c admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:41:06.189887 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d4e2ed-faf8-44cc-b499-e45032ce4f1c admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:41:06.195787 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9ac3d2-beae-4e94-8ee1-fa2b8329aad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:41:06.196386 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9ac3d2-beae-4e94-8ee1-fa2b8329aad4 admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:41:06.196689 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9ac3d2-beae-4e94-8ee1-fa2b8329aad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:41:06.196958 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9ac3d2-beae-4e94-8ee1-fa2b8329aad4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:41:06.197758 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9ac3d2-beae-4e94-8ee1-fa2b8329aad4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:41:06.199403 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9ac3d2-beae-4e94-8ee1-fa2b8329aad4 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:41:06.213846 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1426/2846] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:41:06 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:41:06.218705 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31466c5e-11d8-4232-ab11-4dc305d6d15c admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:41:06.233667 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31466c5e-11d8-4232-ab11-4dc305d6d15c admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:41:06.242771 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e9aed8-b1e9-4521-a98a-cbd066c3a535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:41:06.243705 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e9aed8-b1e9-4521-a98a-cbd066c3a535 admin admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:41:06.244120 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e9aed8-b1e9-4521-a98a-cbd066c3a535 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:41:06.244408 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e9aed8-b1e9-4521-a98a-cbd066c3a535 admin admin] PATH_INFO: `/v3/projects/e52590e0f95a4663bceddb8e9db83fb3/users/5a6b9ce0cd2c4d7db2460af04b384f3f/roles/27e3e65e24df4b86b0d3d18d3212101d` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:41:06.260625 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e9aed8-b1e9-4521-a98a-cbd066c3a535 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e52590e0f95a4663bceddb8e9db83fb3, user_id=5a6b9ce0cd2c4d7db2460af04b384f3f, role_id=27e3e65e24df4b86b0d3d18d3212101d)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:41:06.263278 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e9aed8-b1e9-4521-a98a-cbd066c3a535 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:41:06.279694 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1421/2847] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 11:41:06 2022] PUT /identity/v3/projects/e52590e0f95a4663bceddb8e9db83fb3/users/5a6b9ce0cd2c4d7db2460af04b384f3f/roles/27e3e65e24df4b86b0d3d18d3212101d => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:41:06.349032 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f95b17-1e1e-4226-ba45-fbf460bb0249 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:41:06.349302 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f95b17-1e1e-4226-ba45-fbf460bb0249 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:41:06.349588 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f95b17-1e1e-4226-ba45-fbf460bb0249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:41:06.379974 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-81f95b17-1e1e-4226-ba45-fbf460bb0249 None None] MFA Rules not processed for user `5a6b9ce0cd2c4d7db2460af04b384f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:41:06.381180 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-81f95b17-1e1e-4226-ba45-fbf460bb0249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:41:06.444439 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1427/2848] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:41:06 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:41:06.455861 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e9aed8-b1e9-4521-a98a-cbd066c3a535 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:41:06.457853 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-83e9aed8-b1e9-4521-a98a-cbd066c3a535 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:41:06.521976 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e9aed8-b1e9-4521-a98a-cbd066c3a535 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:41:06.525883 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2492f43b-1ae3-47be-9032-d75c9b81f594 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92862b76ba3b4513b5dc5b5c962faac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:41:06.526524 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2492f43b-1ae3-47be-9032-d75c9b81f594 service cinder] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:41:06.526805 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2492f43b-1ae3-47be-9032-d75c9b81f594 service cinder] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:41:06.527174 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2492f43b-1ae3-47be-9032-d75c9b81f594 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:41:06.535321 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2492f43b-1ae3-47be-9032-d75c9b81f594 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:41:06.536748 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2492f43b-1ae3-47be-9032-d75c9b81f594 service cinder] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:41:06.545318 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1422/2849] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:41:06 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:41:08.026716 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f95b17-1e1e-4226-ba45-fbf460bb0249 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:41:08.028217 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-81f95b17-1e1e-4226-ba45-fbf460bb0249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:41:08.099166 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f95b17-1e1e-4226-ba45-fbf460bb0249 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:41:08.110180 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf960695-5f33-43e8-8d65-12bc99616121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:41:08.110881 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf960695-5f33-43e8-8d65-12bc99616121 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:41:08.111160 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf960695-5f33-43e8-8d65-12bc99616121 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:41:08.111430 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf960695-5f33-43e8-8d65-12bc99616121 admin admin] PATH_INFO: `/v3/users/5df4c5f36fad4705b30239a0b293ce7b` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:41:08.112558 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf960695-5f33-43e8-8d65-12bc99616121 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5df4c5f36fad4705b30239a0b293ce7b)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:41:08.115238 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf960695-5f33-43e8-8d65-12bc99616121 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:41:08.165543 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-bf960695-5f33-43e8-8d65-12bc99616121 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5df4c5f36fad4705b30239a0b293ce7b'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:41:08.166527 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-bf960695-5f33-43e8-8d65-12bc99616121 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5df4c5f36fad4705b30239a0b293ce7b'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:41:08.167153 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-bf960695-5f33-43e8-8d65-12bc99616121 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5df4c5f36fad4705b30239a0b293ce7b'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:41:08.175277 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-bf960695-5f33-43e8-8d65-12bc99616121 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5df4c5f36fad4705b30239a0b293ce7b'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:41:08.176608 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:41:08.184090 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-bf960695-5f33-43e8-8d65-12bc99616121 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5df4c5f36fad4705b30239a0b293ce7b'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:41:08.203554 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1428/2850] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 11:41:08 2022] DELETE /identity/v3/users/5df4c5f36fad4705b30239a0b293ce7b => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:41:08.208391 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df10912-a331-42e3-abbf-94e5879e864e None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:41:08.208866 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df10912-a331-42e3-abbf-94e5879e864e None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:41:08.208989 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df10912-a331-42e3-abbf-94e5879e864e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:41:08.230148 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-2df10912-a331-42e3-abbf-94e5879e864e None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:41:08.231426 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-2df10912-a331-42e3-abbf-94e5879e864e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:41:08.266026 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:41:08.304290 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1423/2851] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:41:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 11:41:08.314888 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf960695-5f33-43e8-8d65-12bc99616121 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:41:08.316364 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-bf960695-5f33-43e8-8d65-12bc99616121 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:41:08.375436 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf960695-5f33-43e8-8d65-12bc99616121 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:41:08.379166 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51b1181-204b-4773-97b9-dd1d30fa4d19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2d061d25d83443c9232218c90792d51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:41:08.379785 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51b1181-204b-4773-97b9-dd1d30fa4d19 service neutron] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:41:08.380060 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51b1181-204b-4773-97b9-dd1d30fa4d19 service neutron] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:41:08.380328 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51b1181-204b-4773-97b9-dd1d30fa4d19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:41:08.390100 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51b1181-204b-4773-97b9-dd1d30fa4d19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:41:08.391646 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51b1181-204b-4773-97b9-dd1d30fa4d19 service neutron] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:41:08.401787 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1429/2852] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:41:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:41:08.675511 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df10912-a331-42e3-abbf-94e5879e864e None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:41:08.677085 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-2df10912-a331-42e3-abbf-94e5879e864e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:41:08.689737 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df10912-a331-42e3-abbf-94e5879e864e None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:41:08.694492 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd32e47-8faf-41fc-856a-dd2fce8f3fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:41:08.695130 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd32e47-8faf-41fc-856a-dd2fce8f3fd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:41:08.695406 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd32e47-8faf-41fc-856a-dd2fce8f3fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:41:08.695678 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd32e47-8faf-41fc-856a-dd2fce8f3fd0 admin admin] PATH_INFO: `/v3/projects/8f196798e25c483683716b39759893ea` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:41:08.696824 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd32e47-8faf-41fc-856a-dd2fce8f3fd0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f196798e25c483683716b39759893ea)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:41:08.699586 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd32e47-8faf-41fc-856a-dd2fce8f3fd0 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:41:08.750492 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-fbd32e47-8faf-41fc-856a-dd2fce8f3fd0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f196798e25c483683716b39759893ea', 'request_id': 'req-fbd32e47-8faf-41fc-856a-dd2fce8f3fd0'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:41:08.757227 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-fbd32e47-8faf-41fc-856a-dd2fce8f3fd0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f196798e25c483683716b39759893ea', 'request_id': 'req-fbd32e47-8faf-41fc-856a-dd2fce8f3fd0'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:41:08.763796 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-fbd32e47-8faf-41fc-856a-dd2fce8f3fd0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f196798e25c483683716b39759893ea', 'request_id': 'req-fbd32e47-8faf-41fc-856a-dd2fce8f3fd0'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:41:08.780803 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-fbd32e47-8faf-41fc-856a-dd2fce8f3fd0 admin admin] The token cache is being invalidate because project 8f196798e25c483683716b39759893ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:41:08.781096 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-fbd32e47-8faf-41fc-856a-dd2fce8f3fd0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:41:08.781968 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-fbd32e47-8faf-41fc-856a-dd2fce8f3fd0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:41:08.783855 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1424/2853] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 11:41:08 2022] DELETE /identity/v3/projects/8f196798e25c483683716b39759893ea => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:41:15.813263 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cf9577-5d55-44c8-bcac-b3f29f7b11e1 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:41:15.813772 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cf9577-5d55-44c8-bcac-b3f29f7b11e1 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:41:15.813772 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cf9577-5d55-44c8-bcac-b3f29f7b11e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:41:15.836011 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-84cf9577-5d55-44c8-bcac-b3f29f7b11e1 None None] MFA Rules not processed for user `a5915030f01941fc89f92228ff57c7f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:41:15.837226 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-84cf9577-5d55-44c8-bcac-b3f29f7b11e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:41:15.894335 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1430/2854] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Aug 24 11:41:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:41:15.938776 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd32e47-8faf-41fc-856a-dd2fce8f3fd0 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:41:15.940249 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-fbd32e47-8faf-41fc-856a-dd2fce8f3fd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:41:16.016682 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd32e47-8faf-41fc-856a-dd2fce8f3fd0 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:41:16.022403 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8f0115-f8cd-4742-8f8e-4c72912dcbde service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1069558c085449f9e4c9f06013b2a85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:41:16.023268 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8f0115-f8cd-4742-8f8e-4c72912dcbde service swift] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:41:16.023550 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8f0115-f8cd-4742-8f8e-4c72912dcbde service swift] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:41:16.023816 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8f0115-f8cd-4742-8f8e-4c72912dcbde service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:41:16.032529 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8f0115-f8cd-4742-8f8e-4c72912dcbde service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:41:16.034112 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8f0115-f8cd-4742-8f8e-4c72912dcbde service swift] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:41:16.042697 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1425/2855] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Aug 24 11:41:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 11:41:18.160471 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cf9577-5d55-44c8-bcac-b3f29f7b11e1 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:41:18.162211 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-84cf9577-5d55-44c8-bcac-b3f29f7b11e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:41:18.251797 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cf9577-5d55-44c8-bcac-b3f29f7b11e1 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:41:18.257855 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54232624-7117-4bdf-ae1d-a3edf69e54f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:41:18.258635 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54232624-7117-4bdf-ae1d-a3edf69e54f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:41:18.258999 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54232624-7117-4bdf-ae1d-a3edf69e54f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:41:18.259349 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54232624-7117-4bdf-ae1d-a3edf69e54f6 admin admin] PATH_INFO: `/v3/users/5a6b9ce0cd2c4d7db2460af04b384f3f` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:41:18.260619 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54232624-7117-4bdf-ae1d-a3edf69e54f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a6b9ce0cd2c4d7db2460af04b384f3f)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:41:18.263477 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54232624-7117-4bdf-ae1d-a3edf69e54f6 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:41:18.300946 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:41:18.338539 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-54232624-7117-4bdf-ae1d-a3edf69e54f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a6b9ce0cd2c4d7db2460af04b384f3f'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:41:18.339790 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-54232624-7117-4bdf-ae1d-a3edf69e54f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a6b9ce0cd2c4d7db2460af04b384f3f'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:41:18.340830 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-54232624-7117-4bdf-ae1d-a3edf69e54f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a6b9ce0cd2c4d7db2460af04b384f3f'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:41:18.351552 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-54232624-7117-4bdf-ae1d-a3edf69e54f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a6b9ce0cd2c4d7db2460af04b384f3f'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:41:18.361403 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-54232624-7117-4bdf-ae1d-a3edf69e54f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a6b9ce0cd2c4d7db2460af04b384f3f'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:41:18.383609 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1431/2856] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 11:41:18 2022] DELETE /identity/v3/users/5a6b9ce0cd2c4d7db2460af04b384f3f => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:41:18.389193 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996a71f1-b8df-4b43-a569-e4d676e3c5ce None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:41:18.389790 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996a71f1-b8df-4b43-a569-e4d676e3c5ce None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:41:18.390038 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996a71f1-b8df-4b43-a569-e4d676e3c5ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:41:18.412612 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-996a71f1-b8df-4b43-a569-e4d676e3c5ce None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:41:18.414412 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-996a71f1-b8df-4b43-a569-e4d676e3c5ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:41:18.485246 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:41:18.527150 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1426/2857] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:41:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:41:18.537184 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54232624-7117-4bdf-ae1d-a3edf69e54f6 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:41:18.538692 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-54232624-7117-4bdf-ae1d-a3edf69e54f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:41:18.654226 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54232624-7117-4bdf-ae1d-a3edf69e54f6 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:41:18.664337 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9bfde1-2840-4d7c-821a-bdad9f8b52e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2d061d25d83443c9232218c90792d51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:41:18.665862 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9bfde1-2840-4d7c-821a-bdad9f8b52e7 service neutron] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:41:18.665862 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9bfde1-2840-4d7c-821a-bdad9f8b52e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:41:18.665862 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9bfde1-2840-4d7c-821a-bdad9f8b52e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:41:18.679225 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9bfde1-2840-4d7c-821a-bdad9f8b52e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:41:18.687567 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9bfde1-2840-4d7c-821a-bdad9f8b52e7 service neutron] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:41:18.699738 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1432/2858] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:41:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:41:19.002877 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996a71f1-b8df-4b43-a569-e4d676e3c5ce None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:41:19.004369 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-996a71f1-b8df-4b43-a569-e4d676e3c5ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:41:19.016680 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996a71f1-b8df-4b43-a569-e4d676e3c5ce None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:41:19.022473 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f25fb5-f2b7-4b1e-b669-2d7165c19d85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:41:19.023506 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f25fb5-f2b7-4b1e-b669-2d7165c19d85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:41:19.023762 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f25fb5-f2b7-4b1e-b669-2d7165c19d85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:41:19.024208 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f25fb5-f2b7-4b1e-b669-2d7165c19d85 admin admin] PATH_INFO: `/v3/projects/e52590e0f95a4663bceddb8e9db83fb3` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:41:19.025761 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f25fb5-f2b7-4b1e-b669-2d7165c19d85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e52590e0f95a4663bceddb8e9db83fb3)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:41:19.027924 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f25fb5-f2b7-4b1e-b669-2d7165c19d85 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:41:19.085757 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-50f25fb5-f2b7-4b1e-b669-2d7165c19d85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e52590e0f95a4663bceddb8e9db83fb3', 'request_id': 'req-50f25fb5-f2b7-4b1e-b669-2d7165c19d85'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:41:19.093247 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-50f25fb5-f2b7-4b1e-b669-2d7165c19d85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e52590e0f95a4663bceddb8e9db83fb3', 'request_id': 'req-50f25fb5-f2b7-4b1e-b669-2d7165c19d85'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:41:19.103667 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-50f25fb5-f2b7-4b1e-b669-2d7165c19d85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e52590e0f95a4663bceddb8e9db83fb3', 'request_id': 'req-50f25fb5-f2b7-4b1e-b669-2d7165c19d85'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:41:19.129534 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-50f25fb5-f2b7-4b1e-b669-2d7165c19d85 admin admin] The token cache is being invalidate because project e52590e0f95a4663bceddb8e9db83fb3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:41:19.138615 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-50f25fb5-f2b7-4b1e-b669-2d7165c19d85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:41:19.138615 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-50f25fb5-f2b7-4b1e-b669-2d7165c19d85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:41:19.138872 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1427/2859] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 11:41:19 2022] DELETE /identity/v3/projects/e52590e0f95a4663bceddb8e9db83fb3 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:41:19.140234 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f9f0c9-f7a8-4636-9a34-9959bf6fd47d None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:41:19.140523 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f9f0c9-f7a8-4636-9a34-9959bf6fd47d None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:41:19.140798 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f9f0c9-f7a8-4636-9a34-9959bf6fd47d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:41:19.162097 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-f8f9f0c9-f7a8-4636-9a34-9959bf6fd47d None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:41:19.163372 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-f8f9f0c9-f7a8-4636-9a34-9959bf6fd47d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:41:19.254806 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1433/2860] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:41:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:41:19.264049 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1481eba-fffb-409a-adcf-4a9c9786a3d9 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:41:19.264332 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1481eba-fffb-409a-adcf-4a9c9786a3d9 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:41:19.264602 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1481eba-fffb-409a-adcf-4a9c9786a3d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:41:19.291366 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-d1481eba-fffb-409a-adcf-4a9c9786a3d9 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:41:19.293099 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-d1481eba-fffb-409a-adcf-4a9c9786a3d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:41:19.306264 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1428/2861] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:41:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:41:19.311512 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f9f0c9-f7a8-4636-9a34-9959bf6fd47d None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:41:19.324633 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f9f0c9-f7a8-4636-9a34-9959bf6fd47d None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:41:19.329999 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0c726e-4ad4-4013-8a9e-f0a66db90623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:41:19.330814 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0c726e-4ad4-4013-8a9e-f0a66db90623 admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:41:19.331095 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0c726e-4ad4-4013-8a9e-f0a66db90623 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:41:19.331365 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0c726e-4ad4-4013-8a9e-f0a66db90623 admin admin] PATH_INFO: `/v3/domains` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:41:19.332018 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0c726e-4ad4-4013-8a9e-f0a66db90623 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:41:19.332320 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0c726e-4ad4-4013-8a9e-f0a66db90623 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:41:19.333955 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0c726e-4ad4-4013-8a9e-f0a66db90623 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:41:19.350428 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1434/2862] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 24 11:41:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:41:19.353703 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1481eba-fffb-409a-adcf-4a9c9786a3d9 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:41:19.365171 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1481eba-fffb-409a-adcf-4a9c9786a3d9 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:41:19.369979 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbc9a3f-3309-4a7f-9231-5e376af00573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:41:19.371941 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbc9a3f-3309-4a7f-9231-5e376af00573 admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:41:19.371941 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbc9a3f-3309-4a7f-9231-5e376af00573 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:41:19.371941 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbc9a3f-3309-4a7f-9231-5e376af00573 admin admin] PATH_INFO: `/v3/projects` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:41:19.372388 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbc9a3f-3309-4a7f-9231-5e376af00573 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:41:19.374206 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbc9a3f-3309-4a7f-9231-5e376af00573 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:41:19.410395 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1429/2863] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 11:41:19 2022] POST /identity/v3/projects => generated 391 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 11:41:19.414021 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0c726e-4ad4-4013-8a9e-f0a66db90623 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:41:19.427094 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0c726e-4ad4-4013-8a9e-f0a66db90623 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:41:19.457360 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:41:19.495986 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fabb6e-0b29-471f-bba7-3e0c088b1945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:41:19.496643 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fabb6e-0b29-471f-bba7-3e0c088b1945 admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:41:19.496934 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fabb6e-0b29-471f-bba7-3e0c088b1945 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:41:19.497204 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fabb6e-0b29-471f-bba7-3e0c088b1945 admin admin] PATH_INFO: `/v3/users` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:41:19.497878 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fabb6e-0b29-471f-bba7-3e0c088b1945 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:41:19.500069 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fabb6e-0b29-471f-bba7-3e0c088b1945 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:41:19.525528 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1435/2864] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 11:41:19 2022] POST /identity/v3/users => generated 296 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 11:41:19.530429 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbc9a3f-3309-4a7f-9231-5e376af00573 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:41:19.543278 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbc9a3f-3309-4a7f-9231-5e376af00573 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:41:19.555374 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d36a937-269f-45f5-ad02-0f3dd83ccfdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:41:19.556083 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d36a937-269f-45f5-ad02-0f3dd83ccfdc admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:41:19.556390 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d36a937-269f-45f5-ad02-0f3dd83ccfdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:41:19.556618 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d36a937-269f-45f5-ad02-0f3dd83ccfdc admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:41:19.557366 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d36a937-269f-45f5-ad02-0f3dd83ccfdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:41:19.559081 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d36a937-269f-45f5-ad02-0f3dd83ccfdc admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:41:19.571785 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1430/2865] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:41:19 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:41:19.575831 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fabb6e-0b29-471f-bba7-3e0c088b1945 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:41:19.587816 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fabb6e-0b29-471f-bba7-3e0c088b1945 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:41:19.594589 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe76507-30cc-4b12-8587-ec7e890bf272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:41:19.595457 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe76507-30cc-4b12-8587-ec7e890bf272 admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:41:19.595824 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe76507-30cc-4b12-8587-ec7e890bf272 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:41:19.596199 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe76507-30cc-4b12-8587-ec7e890bf272 admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:41:19.597131 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe76507-30cc-4b12-8587-ec7e890bf272 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:41:19.599294 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe76507-30cc-4b12-8587-ec7e890bf272 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:41:19.612654 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1436/2866] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:41:19 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:41:19.617316 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d36a937-269f-45f5-ad02-0f3dd83ccfdc admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:41:19.628862 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d36a937-269f-45f5-ad02-0f3dd83ccfdc admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:41:19.633778 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6967a2f2-592b-4ff8-a2d1-00daf88c7f38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:41:19.634549 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6967a2f2-592b-4ff8-a2d1-00daf88c7f38 admin admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:41:19.634827 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6967a2f2-592b-4ff8-a2d1-00daf88c7f38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:41:19.635254 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6967a2f2-592b-4ff8-a2d1-00daf88c7f38 admin admin] PATH_INFO: `/v3/projects/b11ad0c1745243068ebbb9dfed031b8e/users/a26f18c1fe034f82a9ff0a29cdbf2522/roles/27e3e65e24df4b86b0d3d18d3212101d` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:41:19.658252 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6967a2f2-592b-4ff8-a2d1-00daf88c7f38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b11ad0c1745243068ebbb9dfed031b8e, user_id=a26f18c1fe034f82a9ff0a29cdbf2522, role_id=27e3e65e24df4b86b0d3d18d3212101d)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:41:19.665911 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6967a2f2-592b-4ff8-a2d1-00daf88c7f38 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:41:19.690477 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1431/2867] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 11:41:19 2022] PUT /identity/v3/projects/b11ad0c1745243068ebbb9dfed031b8e/users/a26f18c1fe034f82a9ff0a29cdbf2522/roles/27e3e65e24df4b86b0d3d18d3212101d => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 11:41:19.696741 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faf1b4d-9b7c-4957-93c7-e65914818796 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:41:19.697030 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faf1b4d-9b7c-4957-93c7-e65914818796 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:41:19.697310 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faf1b4d-9b7c-4957-93c7-e65914818796 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:41:19.746455 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-6faf1b4d-9b7c-4957-93c7-e65914818796 None None] MFA Rules not processed for user `a26f18c1fe034f82a9ff0a29cdbf2522`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:41:19.747660 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-6faf1b4d-9b7c-4957-93c7-e65914818796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:41:19.843725 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1437/2868] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:41:19 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:41:19.856410 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6967a2f2-592b-4ff8-a2d1-00daf88c7f38 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:41:19.858673 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-6967a2f2-592b-4ff8-a2d1-00daf88c7f38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:41:19.959678 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6967a2f2-592b-4ff8-a2d1-00daf88c7f38 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:41:19.963336 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68607aed-9517-4062-b16b-0a9bf5b04585 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92862b76ba3b4513b5dc5b5c962faac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:41:19.964067 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68607aed-9517-4062-b16b-0a9bf5b04585 service cinder] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:41:19.964407 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68607aed-9517-4062-b16b-0a9bf5b04585 service cinder] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:41:19.964673 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68607aed-9517-4062-b16b-0a9bf5b04585 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:41:19.974299 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68607aed-9517-4062-b16b-0a9bf5b04585 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:41:19.975762 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68607aed-9517-4062-b16b-0a9bf5b04585 service cinder] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:41:19.985409 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1432/2869] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:41:19 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:41:29.839923 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=53,keystone:INSERT=3 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:41:29.981214 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=85,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:41:30.625442 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faf1b4d-9b7c-4957-93c7-e65914818796 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:41:30.673681 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079db01b-abb3-4e87-97cf-920cb7a31686 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:41:30.673958 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079db01b-abb3-4e87-97cf-920cb7a31686 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:41:30.674227 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079db01b-abb3-4e87-97cf-920cb7a31686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:41:30.716486 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-079db01b-abb3-4e87-97cf-920cb7a31686 None None] MFA Rules not processed for user `a5915030f01941fc89f92228ff57c7f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:41:30.717728 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-079db01b-abb3-4e87-97cf-920cb7a31686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:41:30.734160 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faf1b4d-9b7c-4957-93c7-e65914818796 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:41:30.739816 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725b90e7-f8e2-45a7-9524-131aa7bf480a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:41:30.740609 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725b90e7-f8e2-45a7-9524-131aa7bf480a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:41:30.740905 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725b90e7-f8e2-45a7-9524-131aa7bf480a admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:41:30.741178 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725b90e7-f8e2-45a7-9524-131aa7bf480a admin admin] PATH_INFO: `/v3/users/a26f18c1fe034f82a9ff0a29cdbf2522` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:41:30.742335 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725b90e7-f8e2-45a7-9524-131aa7bf480a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a26f18c1fe034f82a9ff0a29cdbf2522)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:41:30.744315 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725b90e7-f8e2-45a7-9524-131aa7bf480a admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:41:30.793422 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-725b90e7-f8e2-45a7-9524-131aa7bf480a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a26f18c1fe034f82a9ff0a29cdbf2522'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:41:30.794262 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-725b90e7-f8e2-45a7-9524-131aa7bf480a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a26f18c1fe034f82a9ff0a29cdbf2522'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:41:30.794923 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-725b90e7-f8e2-45a7-9524-131aa7bf480a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a26f18c1fe034f82a9ff0a29cdbf2522'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:41:30.797597 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1433/2870] 10.222.0.27 () {58 vars in 967 bytes} [Wed Aug 24 11:41:30 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 11:41:30.803610 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-725b90e7-f8e2-45a7-9524-131aa7bf480a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a26f18c1fe034f82a9ff0a29cdbf2522'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:41:30.811119 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-725b90e7-f8e2-45a7-9524-131aa7bf480a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a26f18c1fe034f82a9ff0a29cdbf2522'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:41:30.811956 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079db01b-abb3-4e87-97cf-920cb7a31686 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:41:30.813542 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-079db01b-abb3-4e87-97cf-920cb7a31686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:41:30.828530 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1438/2871] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 11:41:30 2022] DELETE /identity/v3/users/a26f18c1fe034f82a9ff0a29cdbf2522 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:41:30.832862 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b7e2e3-8a86-4982-a4e8-b678eae97124 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:41:30.833272 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b7e2e3-8a86-4982-a4e8-b678eae97124 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:41:30.833553 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b7e2e3-8a86-4982-a4e8-b678eae97124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:41:30.876932 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-76b7e2e3-8a86-4982-a4e8-b678eae97124 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:41:30.878057 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-76b7e2e3-8a86-4982-a4e8-b678eae97124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:41:30.890761 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079db01b-abb3-4e87-97cf-920cb7a31686 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:41:30.892397 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:41:30.959151 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a2df90-8741-4ee0-b735-baad2235b039 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1069558c085449f9e4c9f06013b2a85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:41:30.959912 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a2df90-8741-4ee0-b735-baad2235b039 service swift] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:41:30.960196 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a2df90-8741-4ee0-b735-baad2235b039 service swift] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:41:30.960462 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a2df90-8741-4ee0-b735-baad2235b039 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:41:30.962724 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-20a2df90-8741-4ee0-b735-baad2235b039 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:41:30.973639 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:41:31.027121 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a2df90-8741-4ee0-b735-baad2235b039 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:41:31.028756 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a2df90-8741-4ee0-b735-baad2235b039 service swift] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:41:31.037654 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1434/2872] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Aug 24 11:41:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 24 11:41:31.083008 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1439/2873] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:41:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:41:31.092936 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a2df90-8741-4ee0-b735-baad2235b039 service swift] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:41:31.094492 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-20a2df90-8741-4ee0-b735-baad2235b039 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:41:31.160029 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a2df90-8741-4ee0-b735-baad2235b039 service swift] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:41:31.163927 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cb53c1-bf10-4af3-9b7b-af474301e476 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2d061d25d83443c9232218c90792d51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:41:31.164588 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cb53c1-bf10-4af3-9b7b-af474301e476 service neutron] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:41:31.164915 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cb53c1-bf10-4af3-9b7b-af474301e476 service neutron] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:41:31.165165 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cb53c1-bf10-4af3-9b7b-af474301e476 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:41:31.174971 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cb53c1-bf10-4af3-9b7b-af474301e476 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:41:31.176410 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cb53c1-bf10-4af3-9b7b-af474301e476 service neutron] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:41:31.186853 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1435/2874] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:41:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 11:41:31.486685 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b7e2e3-8a86-4982-a4e8-b678eae97124 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:41:31.488763 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-76b7e2e3-8a86-4982-a4e8-b678eae97124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:41:31.503316 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b7e2e3-8a86-4982-a4e8-b678eae97124 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:41:31.508804 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f0cbbc-79ba-4b50-be69-6f758b42d6ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:41:31.510269 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f0cbbc-79ba-4b50-be69-6f758b42d6ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:41:31.510795 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f0cbbc-79ba-4b50-be69-6f758b42d6ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:41:31.511103 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f0cbbc-79ba-4b50-be69-6f758b42d6ca admin admin] PATH_INFO: `/v3/projects/b11ad0c1745243068ebbb9dfed031b8e` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:41:31.512415 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f0cbbc-79ba-4b50-be69-6f758b42d6ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=b11ad0c1745243068ebbb9dfed031b8e)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:41:31.515251 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f0cbbc-79ba-4b50-be69-6f758b42d6ca admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:41:31.563138 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-88f0cbbc-79ba-4b50-be69-6f758b42d6ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b11ad0c1745243068ebbb9dfed031b8e', 'request_id': 'req-88f0cbbc-79ba-4b50-be69-6f758b42d6ca'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:41:31.569489 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-88f0cbbc-79ba-4b50-be69-6f758b42d6ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b11ad0c1745243068ebbb9dfed031b8e', 'request_id': 'req-88f0cbbc-79ba-4b50-be69-6f758b42d6ca'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:41:31.575940 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-88f0cbbc-79ba-4b50-be69-6f758b42d6ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b11ad0c1745243068ebbb9dfed031b8e', 'request_id': 'req-88f0cbbc-79ba-4b50-be69-6f758b42d6ca'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:41:31.592343 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-88f0cbbc-79ba-4b50-be69-6f758b42d6ca admin admin] The token cache is being invalidate because project b11ad0c1745243068ebbb9dfed031b8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81501) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:41:31.592977 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-88f0cbbc-79ba-4b50-be69-6f758b42d6ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:41:31.594034 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-88f0cbbc-79ba-4b50-be69-6f758b42d6ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:41:31.596912 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1440/2875] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 11:41:31 2022] DELETE /identity/v3/projects/b11ad0c1745243068ebbb9dfed031b8e => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:41:31.602397 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5540147-7518-44c6-99b2-dad692ae8ccc None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:41:31.602766 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5540147-7518-44c6-99b2-dad692ae8ccc None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:41:31.603091 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5540147-7518-44c6-99b2-dad692ae8ccc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:41:31.654600 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-e5540147-7518-44c6-99b2-dad692ae8ccc None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:41:31.655940 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-e5540147-7518-44c6-99b2-dad692ae8ccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:41:31.716517 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1436/2876] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:41:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:41:31.724585 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385b2b96-2e8d-4c90-949e-a35b220a4c71 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:41:31.724865 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385b2b96-2e8d-4c90-949e-a35b220a4c71 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:41:31.725129 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385b2b96-2e8d-4c90-949e-a35b220a4c71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:41:31.746130 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-385b2b96-2e8d-4c90-949e-a35b220a4c71 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:41:31.747421 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-385b2b96-2e8d-4c90-949e-a35b220a4c71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:41:31.755788 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1441/2877] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:41:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:41:31.760378 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5540147-7518-44c6-99b2-dad692ae8ccc None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:41:31.770348 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5540147-7518-44c6-99b2-dad692ae8ccc None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:41:31.775312 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90d6a15-1e4f-4d91-a830-ca31329b2b24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:41:31.775910 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90d6a15-1e4f-4d91-a830-ca31329b2b24 admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:41:31.776185 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90d6a15-1e4f-4d91-a830-ca31329b2b24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:41:31.776453 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90d6a15-1e4f-4d91-a830-ca31329b2b24 admin admin] PATH_INFO: `/v3/domains` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:41:31.777187 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90d6a15-1e4f-4d91-a830-ca31329b2b24 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:41:31.777385 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90d6a15-1e4f-4d91-a830-ca31329b2b24 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:41:31.779257 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90d6a15-1e4f-4d91-a830-ca31329b2b24 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:41:31.790885 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1437/2878] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 24 11:41:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:41:31.795413 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385b2b96-2e8d-4c90-949e-a35b220a4c71 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:41:31.804761 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385b2b96-2e8d-4c90-949e-a35b220a4c71 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:41:31.809878 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5e2729-de72-4851-a056-b676318e0ef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:41:31.810503 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5e2729-de72-4851-a056-b676318e0ef0 admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:41:31.810779 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5e2729-de72-4851-a056-b676318e0ef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:41:31.811049 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5e2729-de72-4851-a056-b676318e0ef0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:41:31.811707 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5e2729-de72-4851-a056-b676318e0ef0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:41:31.813616 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5e2729-de72-4851-a056-b676318e0ef0 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:41:31.843323 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1442/2879] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 11:41:31 2022] POST /identity/v3/projects => generated 399 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:41:31.847742 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90d6a15-1e4f-4d91-a830-ca31329b2b24 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:41:31.857896 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90d6a15-1e4f-4d91-a830-ca31329b2b24 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:41:31.869815 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:41:31.919657 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ab3afb-099b-475b-8320-79fd0d89fb36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:41:31.920190 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ab3afb-099b-475b-8320-79fd0d89fb36 admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:41:31.920468 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ab3afb-099b-475b-8320-79fd0d89fb36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:41:31.920739 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ab3afb-099b-475b-8320-79fd0d89fb36 admin admin] PATH_INFO: `/v3/users` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:41:31.921437 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ab3afb-099b-475b-8320-79fd0d89fb36 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:41:31.923431 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ab3afb-099b-475b-8320-79fd0d89fb36 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:41:31.951281 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1438/2880] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 11:41:31 2022] POST /identity/v3/users => generated 300 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:41:31.956013 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5e2729-de72-4851-a056-b676318e0ef0 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:41:31.966475 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5e2729-de72-4851-a056-b676318e0ef0 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:41:31.971344 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad3260d-04b4-4c3b-bf41-6d5aed667a7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:41:31.971939 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad3260d-04b4-4c3b-bf41-6d5aed667a7f admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:41:31.972214 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad3260d-04b4-4c3b-bf41-6d5aed667a7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:41:31.972482 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad3260d-04b4-4c3b-bf41-6d5aed667a7f admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:41:31.973174 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad3260d-04b4-4c3b-bf41-6d5aed667a7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:41:31.974848 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad3260d-04b4-4c3b-bf41-6d5aed667a7f admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:41:31.984969 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1443/2881] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:41:31 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 11:41:31.989612 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ab3afb-099b-475b-8320-79fd0d89fb36 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:41:31.999826 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ab3afb-099b-475b-8320-79fd0d89fb36 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:41:32.004698 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd431fca-6bbf-4e50-9ef6-12d81431efbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:41:32.005281 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd431fca-6bbf-4e50-9ef6-12d81431efbf admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:41:32.005556 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd431fca-6bbf-4e50-9ef6-12d81431efbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:41:32.005820 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd431fca-6bbf-4e50-9ef6-12d81431efbf admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:41:32.006496 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd431fca-6bbf-4e50-9ef6-12d81431efbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:41:32.008102 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd431fca-6bbf-4e50-9ef6-12d81431efbf admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:41:32.018104 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1439/2882] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:41:31 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:41:32.022273 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad3260d-04b4-4c3b-bf41-6d5aed667a7f admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:41:32.032370 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad3260d-04b4-4c3b-bf41-6d5aed667a7f admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:41:32.037617 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3edae5b-341f-454f-a9dc-e1ba4e924d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:41:32.038255 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3edae5b-341f-454f-a9dc-e1ba4e924d3d admin admin] REQUEST_METHOD: `PUT` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:41:32.038572 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3edae5b-341f-454f-a9dc-e1ba4e924d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:41:32.038843 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3edae5b-341f-454f-a9dc-e1ba4e924d3d admin admin] PATH_INFO: `/v3/projects/35ffc812aea74479a809e3c793d5b3fe/users/e1e52509f054413d990e1c880cdaeed7/roles/27e3e65e24df4b86b0d3d18d3212101d` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:41:32.054214 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3edae5b-341f-454f-a9dc-e1ba4e924d3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=35ffc812aea74479a809e3c793d5b3fe, user_id=e1e52509f054413d990e1c880cdaeed7, role_id=27e3e65e24df4b86b0d3d18d3212101d)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:41:32.056903 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3edae5b-341f-454f-a9dc-e1ba4e924d3d admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:41:32.072659 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1444/2883] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 11:41:32 2022] PUT /identity/v3/projects/35ffc812aea74479a809e3c793d5b3fe/users/e1e52509f054413d990e1c880cdaeed7/roles/27e3e65e24df4b86b0d3d18d3212101d => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:41:32.084229 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f707753d-6ff2-40fc-af32-f9160d4ecff8 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:41:32.084768 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f707753d-6ff2-40fc-af32-f9160d4ecff8 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:41:32.084768 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f707753d-6ff2-40fc-af32-f9160d4ecff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:41:32.119341 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-f707753d-6ff2-40fc-af32-f9160d4ecff8 None None] MFA Rules not processed for user `e1e52509f054413d990e1c880cdaeed7`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:41:32.120584 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-f707753d-6ff2-40fc-af32-f9160d4ecff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:41:32.187893 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1440/2884] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:41:32 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:41:32.201460 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3edae5b-341f-454f-a9dc-e1ba4e924d3d admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:41:32.203588 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-c3edae5b-341f-454f-a9dc-e1ba4e924d3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:41:32.253355 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:41:32.270250 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3edae5b-341f-454f-a9dc-e1ba4e924d3d admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:41:32.274231 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d7451a-2779-4ff4-b19e-0d723c777b14 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92862b76ba3b4513b5dc5b5c962faac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:41:32.274877 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d7451a-2779-4ff4-b19e-0d723c777b14 service cinder] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:41:32.275183 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d7451a-2779-4ff4-b19e-0d723c777b14 service cinder] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:41:32.275432 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d7451a-2779-4ff4-b19e-0d723c777b14 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:41:32.284259 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d7451a-2779-4ff4-b19e-0d723c777b14 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:41:32.285716 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d7451a-2779-4ff4-b19e-0d723c777b14 service cinder] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:41:32.294765 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1445/2885] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:41:32 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:41:33.013988 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f707753d-6ff2-40fc-af32-f9160d4ecff8 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:41:33.015632 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-f707753d-6ff2-40fc-af32-f9160d4ecff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:41:33.085808 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f707753d-6ff2-40fc-af32-f9160d4ecff8 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:41:33.091358 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21065381-55d7-495f-b5bd-ea3742cf4af4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:41:33.091992 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21065381-55d7-495f-b5bd-ea3742cf4af4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:41:33.092268 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21065381-55d7-495f-b5bd-ea3742cf4af4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:41:33.092555 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21065381-55d7-495f-b5bd-ea3742cf4af4 admin admin] PATH_INFO: `/v3/users/b80442b1eedf4039a913166f38ed9ae7` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:41:33.093820 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21065381-55d7-495f-b5bd-ea3742cf4af4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b80442b1eedf4039a913166f38ed9ae7)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:41:33.095812 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21065381-55d7-495f-b5bd-ea3742cf4af4 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:41:33.126304 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:41:33.146543 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-21065381-55d7-495f-b5bd-ea3742cf4af4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b80442b1eedf4039a913166f38ed9ae7'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:41:33.147224 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-21065381-55d7-495f-b5bd-ea3742cf4af4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b80442b1eedf4039a913166f38ed9ae7'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:41:33.155644 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-21065381-55d7-495f-b5bd-ea3742cf4af4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b80442b1eedf4039a913166f38ed9ae7'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:41:33.162638 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-21065381-55d7-495f-b5bd-ea3742cf4af4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b80442b1eedf4039a913166f38ed9ae7'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:41:33.163284 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-21065381-55d7-495f-b5bd-ea3742cf4af4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b80442b1eedf4039a913166f38ed9ae7'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:41:33.181277 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1441/2886] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 11:41:33 2022] DELETE /identity/v3/users/b80442b1eedf4039a913166f38ed9ae7 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:41:33.366416 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d7451a-2779-4ff4-b19e-0d723c777b14 service cinder] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:41:33.378645 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d7451a-2779-4ff4-b19e-0d723c777b14 service cinder] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:41:33.439897 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55807058-a97e-4f5e-85c0-3de0263dda2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:41:33.440578 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55807058-a97e-4f5e-85c0-3de0263dda2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:41:33.440854 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55807058-a97e-4f5e-85c0-3de0263dda2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:41:33.441130 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55807058-a97e-4f5e-85c0-3de0263dda2e admin admin] PATH_INFO: `/v3/projects/dadc539cb829414b8aefb94df22d9801` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:41:33.442457 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55807058-a97e-4f5e-85c0-3de0263dda2e admin admin] RBAC: Authorizing `identity:delete_project(project_id=dadc539cb829414b8aefb94df22d9801)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:41:33.444322 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55807058-a97e-4f5e-85c0-3de0263dda2e admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:41:33.496597 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-55807058-a97e-4f5e-85c0-3de0263dda2e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dadc539cb829414b8aefb94df22d9801', 'request_id': 'req-55807058-a97e-4f5e-85c0-3de0263dda2e'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:41:33.505970 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-55807058-a97e-4f5e-85c0-3de0263dda2e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dadc539cb829414b8aefb94df22d9801', 'request_id': 'req-55807058-a97e-4f5e-85c0-3de0263dda2e'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:41:33.514726 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-55807058-a97e-4f5e-85c0-3de0263dda2e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dadc539cb829414b8aefb94df22d9801', 'request_id': 'req-55807058-a97e-4f5e-85c0-3de0263dda2e'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:41:33.529470 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-55807058-a97e-4f5e-85c0-3de0263dda2e admin admin] The token cache is being invalidate because project dadc539cb829414b8aefb94df22d9801 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81501) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:41:33.529757 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-55807058-a97e-4f5e-85c0-3de0263dda2e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:41:33.530456 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-55807058-a97e-4f5e-85c0-3de0263dda2e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:41:33.531952 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1446/2887] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 11:41:33 2022] DELETE /identity/v3/projects/dadc539cb829414b8aefb94df22d9801 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:41:33.537043 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e315c5de-b031-40f9-b48d-812deba03014 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:41:33.537330 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e315c5de-b031-40f9-b48d-812deba03014 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:41:33.537606 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e315c5de-b031-40f9-b48d-812deba03014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:41:33.558243 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-e315c5de-b031-40f9-b48d-812deba03014 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:41:33.559497 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-e315c5de-b031-40f9-b48d-812deba03014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:41:33.623340 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1442/2888] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:41:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:41:33.631261 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087cd332-60d7-4fb2-a03b-d2020a83ef69 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:41:33.631564 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087cd332-60d7-4fb2-a03b-d2020a83ef69 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:41:33.631877 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087cd332-60d7-4fb2-a03b-d2020a83ef69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:41:33.653633 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-087cd332-60d7-4fb2-a03b-d2020a83ef69 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:41:33.654986 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-087cd332-60d7-4fb2-a03b-d2020a83ef69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:41:33.664591 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1447/2889] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:41:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:41:33.669053 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e315c5de-b031-40f9-b48d-812deba03014 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:41:33.679020 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e315c5de-b031-40f9-b48d-812deba03014 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:41:33.683866 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a39aee9-2f93-4113-873a-1c2894d9cebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:41:33.684475 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a39aee9-2f93-4113-873a-1c2894d9cebf admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:41:33.684760 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a39aee9-2f93-4113-873a-1c2894d9cebf admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:41:33.685052 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a39aee9-2f93-4113-873a-1c2894d9cebf admin admin] PATH_INFO: `/v3/domains` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:41:33.685700 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a39aee9-2f93-4113-873a-1c2894d9cebf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:41:33.685999 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a39aee9-2f93-4113-873a-1c2894d9cebf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:41:33.687685 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a39aee9-2f93-4113-873a-1c2894d9cebf admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:41:33.699366 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1443/2890] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 24 11:41:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:41:33.703776 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087cd332-60d7-4fb2-a03b-d2020a83ef69 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:41:33.713099 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087cd332-60d7-4fb2-a03b-d2020a83ef69 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:41:33.718384 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93175b22-3235-41f8-97ce-ff6eb6dd5569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:41:33.718990 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93175b22-3235-41f8-97ce-ff6eb6dd5569 admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:41:33.719267 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93175b22-3235-41f8-97ce-ff6eb6dd5569 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:41:33.719537 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93175b22-3235-41f8-97ce-ff6eb6dd5569 admin admin] PATH_INFO: `/v3/projects` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:41:33.720167 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93175b22-3235-41f8-97ce-ff6eb6dd5569 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:41:33.722084 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93175b22-3235-41f8-97ce-ff6eb6dd5569 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:41:33.752119 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1448/2891] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 24 11:41:33 2022] POST /identity/v3/projects => generated 367 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 11:41:33.757746 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a39aee9-2f93-4113-873a-1c2894d9cebf admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:41:33.770947 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a39aee9-2f93-4113-873a-1c2894d9cebf admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:41:33.834232 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41da10d0-bec5-4ccb-98cc-86827fd9abbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:41:33.834617 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41da10d0-bec5-4ccb-98cc-86827fd9abbf admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:41:33.834900 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41da10d0-bec5-4ccb-98cc-86827fd9abbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:41:33.835175 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41da10d0-bec5-4ccb-98cc-86827fd9abbf admin admin] PATH_INFO: `/v3/users` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:41:33.835798 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41da10d0-bec5-4ccb-98cc-86827fd9abbf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:41:33.837711 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41da10d0-bec5-4ccb-98cc-86827fd9abbf admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:41:33.865245 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1444/2892] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 24 11:41:33 2022] POST /identity/v3/users => generated 284 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 11:41:33.866441 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93175b22-3235-41f8-97ce-ff6eb6dd5569 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:41:33.877935 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93175b22-3235-41f8-97ce-ff6eb6dd5569 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:41:33.883272 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55500a8a-a3c3-4a19-b601-fa599c0e246d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:41:33.883960 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55500a8a-a3c3-4a19-b601-fa599c0e246d admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:41:33.884304 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55500a8a-a3c3-4a19-b601-fa599c0e246d admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:41:33.884637 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55500a8a-a3c3-4a19-b601-fa599c0e246d admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:41:33.885388 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55500a8a-a3c3-4a19-b601-fa599c0e246d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:41:33.887276 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55500a8a-a3c3-4a19-b601-fa599c0e246d admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:41:33.902432 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1449/2893] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:41:33 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 11:41:33.903721 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41da10d0-bec5-4ccb-98cc-86827fd9abbf admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:41:33.914572 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41da10d0-bec5-4ccb-98cc-86827fd9abbf admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:41:33.919468 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54831aff-5ef8-4260-b913-63ee7498af6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:41:33.920142 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54831aff-5ef8-4260-b913-63ee7498af6f admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:41:33.920508 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54831aff-5ef8-4260-b913-63ee7498af6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:41:33.920870 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54831aff-5ef8-4260-b913-63ee7498af6f admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:41:33.921574 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54831aff-5ef8-4260-b913-63ee7498af6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:41:33.923296 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54831aff-5ef8-4260-b913-63ee7498af6f admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:41:33.934086 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1445/2894] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 24 11:41:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:41:33.938689 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55500a8a-a3c3-4a19-b601-fa599c0e246d admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:41:33.949498 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55500a8a-a3c3-4a19-b601-fa599c0e246d admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:41:33.954219 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7fb654-55d7-493a-b488-415aff483cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:41:33.960974 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7fb654-55d7-493a-b488-415aff483cb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:41:33.961394 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7fb654-55d7-493a-b488-415aff483cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:41:33.961752 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7fb654-55d7-493a-b488-415aff483cb5 admin admin] PATH_INFO: `/v3/projects/6c52838320ff4ff69996047df672aa4e/users/cae04bafe0c24faaaf12adfbfb67d466/roles/27e3e65e24df4b86b0d3d18d3212101d` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:41:33.979786 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7fb654-55d7-493a-b488-415aff483cb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c52838320ff4ff69996047df672aa4e, user_id=cae04bafe0c24faaaf12adfbfb67d466, role_id=27e3e65e24df4b86b0d3d18d3212101d)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:41:33.982664 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7fb654-55d7-493a-b488-415aff483cb5 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:41:33.997179 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1450/2895] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 24 11:41:33 2022] PUT /identity/v3/projects/6c52838320ff4ff69996047df672aa4e/users/cae04bafe0c24faaaf12adfbfb67d466/roles/27e3e65e24df4b86b0d3d18d3212101d => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:41:34.008400 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c48b5c-3bea-4931-bcfd-bc4eb5312b8e None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:41:34.008701 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c48b5c-3bea-4931-bcfd-bc4eb5312b8e None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:41:34.009031 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c48b5c-3bea-4931-bcfd-bc4eb5312b8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:41:34.028528 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:41:34.038559 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-b0c48b5c-3bea-4931-bcfd-bc4eb5312b8e None None] MFA Rules not processed for user `cae04bafe0c24faaaf12adfbfb67d466`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:41:34.040225 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-b0c48b5c-3bea-4931-bcfd-bc4eb5312b8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:41:34.108994 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1446/2896] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:41:34 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:41:34.121934 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7fb654-55d7-493a-b488-415aff483cb5 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:41:34.123930 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-bb7fb654-55d7-493a-b488-415aff483cb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:41:34.135136 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:41:34.184251 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7fb654-55d7-493a-b488-415aff483cb5 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:41:34.187938 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266d6ea5-1db0-45d2-9822-df2b8fe17147 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abffba24649e49d28a01cbee51924ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:41:34.188545 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266d6ea5-1db0-45d2-9822-df2b8fe17147 service glance] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:41:34.188817 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266d6ea5-1db0-45d2-9822-df2b8fe17147 service glance] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:41:34.189081 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266d6ea5-1db0-45d2-9822-df2b8fe17147 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:41:34.197316 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266d6ea5-1db0-45d2-9822-df2b8fe17147 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:41:34.198821 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266d6ea5-1db0-45d2-9822-df2b8fe17147 service glance] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:41:34.207741 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1451/2897] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:41:34 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:41:37.362106 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c48b5c-3bea-4931-bcfd-bc4eb5312b8e None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:41:37.364082 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-b0c48b5c-3bea-4931-bcfd-bc4eb5312b8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:41:37.433839 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c48b5c-3bea-4931-bcfd-bc4eb5312b8e None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:41:37.442641 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4594c481-a1c9-405b-8167-2733ef02accd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:41:37.443601 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4594c481-a1c9-405b-8167-2733ef02accd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:41:37.443955 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4594c481-a1c9-405b-8167-2733ef02accd admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:41:37.444308 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4594c481-a1c9-405b-8167-2733ef02accd admin admin] PATH_INFO: `/v3/users/e1e52509f054413d990e1c880cdaeed7` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:41:37.446186 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4594c481-a1c9-405b-8167-2733ef02accd admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1e52509f054413d990e1c880cdaeed7)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:41:37.448500 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4594c481-a1c9-405b-8167-2733ef02accd admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:41:37.504372 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-4594c481-a1c9-405b-8167-2733ef02accd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1e52509f054413d990e1c880cdaeed7'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:41:37.505018 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-4594c481-a1c9-405b-8167-2733ef02accd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1e52509f054413d990e1c880cdaeed7'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:41:37.512042 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-4594c481-a1c9-405b-8167-2733ef02accd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1e52509f054413d990e1c880cdaeed7'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:41:37.518977 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-4594c481-a1c9-405b-8167-2733ef02accd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1e52509f054413d990e1c880cdaeed7'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:41:37.519601 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-4594c481-a1c9-405b-8167-2733ef02accd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1e52509f054413d990e1c880cdaeed7'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:41:37.538220 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1447/2898] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 11:41:37 2022] DELETE /identity/v3/users/e1e52509f054413d990e1c880cdaeed7 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:41:37.543760 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e360e451-6d7d-4df7-864c-e8fa6de2e90b None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:41:37.544285 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e360e451-6d7d-4df7-864c-e8fa6de2e90b None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:41:37.544285 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e360e451-6d7d-4df7-864c-e8fa6de2e90b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:41:37.570344 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-e360e451-6d7d-4df7-864c-e8fa6de2e90b None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:41:37.571622 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-e360e451-6d7d-4df7-864c-e8fa6de2e90b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:41:37.635522 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1452/2899] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:41:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:41:37.645696 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4594c481-a1c9-405b-8167-2733ef02accd admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:41:37.647408 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-4594c481-a1c9-405b-8167-2733ef02accd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:41:37.669642 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:41:37.710112 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4594c481-a1c9-405b-8167-2733ef02accd admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:41:37.714309 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717e6fad-2b0d-47a2-802f-8c2786f6f131 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2d061d25d83443c9232218c90792d51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:41:37.714935 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717e6fad-2b0d-47a2-802f-8c2786f6f131 service neutron] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:41:37.715209 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717e6fad-2b0d-47a2-802f-8c2786f6f131 service neutron] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:41:37.715479 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717e6fad-2b0d-47a2-802f-8c2786f6f131 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:41:37.725331 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717e6fad-2b0d-47a2-802f-8c2786f6f131 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:41:37.726795 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717e6fad-2b0d-47a2-802f-8c2786f6f131 service neutron] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:41:37.737140 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1448/2900] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:41:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:41:38.020373 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e360e451-6d7d-4df7-864c-e8fa6de2e90b None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:41:38.022008 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-e360e451-6d7d-4df7-864c-e8fa6de2e90b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:41:38.035289 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e360e451-6d7d-4df7-864c-e8fa6de2e90b None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:41:38.040643 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b55fcb-7dbd-43b6-9ab6-439cc6867cdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:41:38.041272 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b55fcb-7dbd-43b6-9ab6-439cc6867cdc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:41:38.041553 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b55fcb-7dbd-43b6-9ab6-439cc6867cdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:41:38.041825 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b55fcb-7dbd-43b6-9ab6-439cc6867cdc admin admin] PATH_INFO: `/v3/projects/35ffc812aea74479a809e3c793d5b3fe` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:41:38.043032 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b55fcb-7dbd-43b6-9ab6-439cc6867cdc admin admin] RBAC: Authorizing `identity:delete_project(project_id=35ffc812aea74479a809e3c793d5b3fe)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:41:38.044966 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b55fcb-7dbd-43b6-9ab6-439cc6867cdc admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:41:38.092852 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-03b55fcb-7dbd-43b6-9ab6-439cc6867cdc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35ffc812aea74479a809e3c793d5b3fe', 'request_id': 'req-03b55fcb-7dbd-43b6-9ab6-439cc6867cdc'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:41:38.098947 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-03b55fcb-7dbd-43b6-9ab6-439cc6867cdc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35ffc812aea74479a809e3c793d5b3fe', 'request_id': 'req-03b55fcb-7dbd-43b6-9ab6-439cc6867cdc'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:41:38.105022 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-03b55fcb-7dbd-43b6-9ab6-439cc6867cdc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35ffc812aea74479a809e3c793d5b3fe', 'request_id': 'req-03b55fcb-7dbd-43b6-9ab6-439cc6867cdc'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:41:38.121874 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-03b55fcb-7dbd-43b6-9ab6-439cc6867cdc admin admin] The token cache is being invalidate because project 35ffc812aea74479a809e3c793d5b3fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81501) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:41:38.122154 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-03b55fcb-7dbd-43b6-9ab6-439cc6867cdc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:41:38.122824 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-03b55fcb-7dbd-43b6-9ab6-439cc6867cdc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:41:38.124342 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1453/2901] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 11:41:38 2022] DELETE /identity/v3/projects/35ffc812aea74479a809e3c793d5b3fe => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:41:47.732193 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=18 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:41:48.118922 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=76,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:41:57.206985 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717e6fad-2b0d-47a2-802f-8c2786f6f131 service neutron] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:41:57.208704 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-717e6fad-2b0d-47a2-802f-8c2786f6f131 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:41:57.222824 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717e6fad-2b0d-47a2-802f-8c2786f6f131 service neutron] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:41:57.282894 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87bf72b-6794-4783-8055-0b71a8e642c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:41:57.283526 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87bf72b-6794-4783-8055-0b71a8e642c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:41:57.283806 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87bf72b-6794-4783-8055-0b71a8e642c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:41:57.284072 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87bf72b-6794-4783-8055-0b71a8e642c3 admin admin] PATH_INFO: `/v3/users/cae04bafe0c24faaaf12adfbfb67d466` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:41:57.285241 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87bf72b-6794-4783-8055-0b71a8e642c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cae04bafe0c24faaaf12adfbfb67d466)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:41:57.287225 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87bf72b-6794-4783-8055-0b71a8e642c3 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:41:57.336645 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-a87bf72b-6794-4783-8055-0b71a8e642c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cae04bafe0c24faaaf12adfbfb67d466'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:41:57.337328 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-a87bf72b-6794-4783-8055-0b71a8e642c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cae04bafe0c24faaaf12adfbfb67d466'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:41:57.345698 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-a87bf72b-6794-4783-8055-0b71a8e642c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cae04bafe0c24faaaf12adfbfb67d466'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:41:57.352976 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-a87bf72b-6794-4783-8055-0b71a8e642c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cae04bafe0c24faaaf12adfbfb67d466'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:41:57.353604 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-a87bf72b-6794-4783-8055-0b71a8e642c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cae04bafe0c24faaaf12adfbfb67d466'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:41:57.372287 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1449/2902] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 11:41:57 2022] DELETE /identity/v3/users/cae04bafe0c24faaaf12adfbfb67d466 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:41:57.376939 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb989ed-be2f-4241-89b9-08b701c9c040 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:41:57.377471 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb989ed-be2f-4241-89b9-08b701c9c040 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:41:57.377471 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb989ed-be2f-4241-89b9-08b701c9c040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:41:57.396782 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-9eb989ed-be2f-4241-89b9-08b701c9c040 None None] MFA Rules not processed for user `1e2e9ab325dc4dbf92dd6b59db4a0945`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:41:57.398069 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-9eb989ed-be2f-4241-89b9-08b701c9c040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:41:57.459519 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1454/2903] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 24 11:41:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 11:41:57.469827 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87bf72b-6794-4783-8055-0b71a8e642c3 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:41:57.471543 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-a87bf72b-6794-4783-8055-0b71a8e642c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:41:57.562453 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87bf72b-6794-4783-8055-0b71a8e642c3 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:41:57.567153 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdda631-e613-4764-ab60-4b2412d428af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2d061d25d83443c9232218c90792d51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:41:57.567752 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdda631-e613-4764-ab60-4b2412d428af service neutron] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:41:57.568022 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdda631-e613-4764-ab60-4b2412d428af service neutron] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:41:57.568283 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdda631-e613-4764-ab60-4b2412d428af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:41:57.578191 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdda631-e613-4764-ab60-4b2412d428af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:41:57.579649 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdda631-e613-4764-ab60-4b2412d428af service neutron] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:41:57.589743 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1450/2904] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:41:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:41:57.872033 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb989ed-be2f-4241-89b9-08b701c9c040 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:41:57.873649 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-9eb989ed-be2f-4241-89b9-08b701c9c040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:41:57.887931 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb989ed-be2f-4241-89b9-08b701c9c040 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:41:57.893459 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f1139c-0244-4437-88fb-7848b6448db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:41:57.894097 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f1139c-0244-4437-88fb-7848b6448db6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:41:57.894346 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f1139c-0244-4437-88fb-7848b6448db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:41:57.894652 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f1139c-0244-4437-88fb-7848b6448db6 admin admin] PATH_INFO: `/v3/projects/6c52838320ff4ff69996047df672aa4e` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:41:57.895813 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f1139c-0244-4437-88fb-7848b6448db6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c52838320ff4ff69996047df672aa4e)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:41:57.897818 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f1139c-0244-4437-88fb-7848b6448db6 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:41:57.947285 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-b8f1139c-0244-4437-88fb-7848b6448db6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c52838320ff4ff69996047df672aa4e', 'request_id': 'req-b8f1139c-0244-4437-88fb-7848b6448db6'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:41:57.953887 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-b8f1139c-0244-4437-88fb-7848b6448db6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c52838320ff4ff69996047df672aa4e', 'request_id': 'req-b8f1139c-0244-4437-88fb-7848b6448db6'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:41:57.960675 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-b8f1139c-0244-4437-88fb-7848b6448db6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c52838320ff4ff69996047df672aa4e', 'request_id': 'req-b8f1139c-0244-4437-88fb-7848b6448db6'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:41:57.975185 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-b8f1139c-0244-4437-88fb-7848b6448db6 admin admin] The token cache is being invalidate because project 6c52838320ff4ff69996047df672aa4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81501) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:41:57.975543 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-b8f1139c-0244-4437-88fb-7848b6448db6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:41:57.976195 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-b8f1139c-0244-4437-88fb-7848b6448db6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:41:57.977724 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1455/2905] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 11:41:57 2022] DELETE /identity/v3/projects/6c52838320ff4ff69996047df672aa4e => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:42:07.194235 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdda631-e613-4764-ab60-4b2412d428af service neutron] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:42:07.195784 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-fbdda631-e613-4764-ab60-4b2412d428af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:42:07.199914 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:42:07.296340 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdda631-e613-4764-ab60-4b2412d428af service neutron] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:42:07.361386 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc884673-7699-42e6-a490-380684d62d14 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad45431e70ff48a9b90905a97d473d81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:42:07.362405 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc884673-7699-42e6-a490-380684d62d14 service placement] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:42:07.362757 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc884673-7699-42e6-a490-380684d62d14 service placement] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:42:07.363027 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc884673-7699-42e6-a490-380684d62d14 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:42:07.364859 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-fc884673-7699-42e6-a490-380684d62d14 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:42:07.377240 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc884673-7699-42e6-a490-380684d62d14 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:42:07.378924 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc884673-7699-42e6-a490-380684d62d14 service placement] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:42:07.389497 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1451/2906] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 24 11:42:07 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:42:07.972353 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:42:08.446759 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77afcf64-4fd3-411c-b0db-4113b678126f None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:42:08.447051 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77afcf64-4fd3-411c-b0db-4113b678126f None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:42:08.447351 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77afcf64-4fd3-411c-b0db-4113b678126f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:42:08.468147 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-77afcf64-4fd3-411c-b0db-4113b678126f None None] MFA Rules not processed for user `a5915030f01941fc89f92228ff57c7f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:42:08.469321 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-77afcf64-4fd3-411c-b0db-4113b678126f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:42:08.528389 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1456/2907] 10.222.0.27 () {58 vars in 967 bytes} [Wed Aug 24 11:42:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:42:08.540686 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc884673-7699-42e6-a490-380684d62d14 service placement] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:42:08.542304 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-fc884673-7699-42e6-a490-380684d62d14 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:42:08.613766 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc884673-7699-42e6-a490-380684d62d14 service placement] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:42:08.619820 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dbfcfe-3b1e-47fd-9e54-62991028dcd4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1069558c085449f9e4c9f06013b2a85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317f54a463cb48ab86648c6dcec5db0f', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:42:08.620434 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dbfcfe-3b1e-47fd-9e54-62991028dcd4 service swift] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:42:08.620714 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dbfcfe-3b1e-47fd-9e54-62991028dcd4 service swift] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:42:08.620987 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dbfcfe-3b1e-47fd-9e54-62991028dcd4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:42:08.629653 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dbfcfe-3b1e-47fd-9e54-62991028dcd4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:42:08.631312 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dbfcfe-3b1e-47fd-9e54-62991028dcd4 service swift] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:42:08.639542 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1452/2908] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Aug 24 11:42:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 11:42:15.147733 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77afcf64-4fd3-411c-b0db-4113b678126f None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:42:15.149358 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-77afcf64-4fd3-411c-b0db-4113b678126f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:42:15.225871 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77afcf64-4fd3-411c-b0db-4113b678126f None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:42:15.231048 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a91abc-a485-410f-985c-a662a5598efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:42:15.231732 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a91abc-a485-410f-985c-a662a5598efd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:42:15.232007 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a91abc-a485-410f-985c-a662a5598efd admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:42:15.232273 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a91abc-a485-410f-985c-a662a5598efd admin admin] PATH_INFO: `/v3/users/763facd221624f6dae3192c42b4fcf41` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:42:15.233454 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a91abc-a485-410f-985c-a662a5598efd admin admin] RBAC: Authorizing `identity:delete_user(user_id=763facd221624f6dae3192c42b4fcf41)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:42:15.235421 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a91abc-a485-410f-985c-a662a5598efd admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:42:15.283431 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-87a91abc-a485-410f-985c-a662a5598efd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '763facd221624f6dae3192c42b4fcf41'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:42:15.284020 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-87a91abc-a485-410f-985c-a662a5598efd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '763facd221624f6dae3192c42b4fcf41'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:42:15.284630 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-87a91abc-a485-410f-985c-a662a5598efd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '763facd221624f6dae3192c42b4fcf41'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:42:15.292596 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-87a91abc-a485-410f-985c-a662a5598efd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '763facd221624f6dae3192c42b4fcf41'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:42:15.301141 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-87a91abc-a485-410f-985c-a662a5598efd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '763facd221624f6dae3192c42b4fcf41'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:42:15.321252 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1457/2909] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 11:42:15 2022] DELETE /identity/v3/users/763facd221624f6dae3192c42b4fcf41 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:42:15.522107 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dbfcfe-3b1e-47fd-9e54-62991028dcd4 service swift] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:42:15.529927 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:42:15.535348 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dbfcfe-3b1e-47fd-9e54-62991028dcd4 service swift] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:42:15.600001 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4893f6ea-43de-4a52-8440-0c8d9ae38cb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:42:15.600874 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4893f6ea-43de-4a52-8440-0c8d9ae38cb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:42:15.601236 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4893f6ea-43de-4a52-8440-0c8d9ae38cb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:42:15.601621 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4893f6ea-43de-4a52-8440-0c8d9ae38cb9 admin admin] PATH_INFO: `/v3/projects/d6b83668ac9a4864bd8474321a556e17` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:42:15.603073 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4893f6ea-43de-4a52-8440-0c8d9ae38cb9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6b83668ac9a4864bd8474321a556e17)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:42:15.605068 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4893f6ea-43de-4a52-8440-0c8d9ae38cb9 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:42:15.656378 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-4893f6ea-43de-4a52-8440-0c8d9ae38cb9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6b83668ac9a4864bd8474321a556e17', 'request_id': 'req-4893f6ea-43de-4a52-8440-0c8d9ae38cb9'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:42:15.662730 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-4893f6ea-43de-4a52-8440-0c8d9ae38cb9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6b83668ac9a4864bd8474321a556e17', 'request_id': 'req-4893f6ea-43de-4a52-8440-0c8d9ae38cb9'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:42:15.673389 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-4893f6ea-43de-4a52-8440-0c8d9ae38cb9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6b83668ac9a4864bd8474321a556e17', 'request_id': 'req-4893f6ea-43de-4a52-8440-0c8d9ae38cb9'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:42:15.688216 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-4893f6ea-43de-4a52-8440-0c8d9ae38cb9 admin admin] The token cache is being invalidate because project d6b83668ac9a4864bd8474321a556e17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:42:15.688499 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-4893f6ea-43de-4a52-8440-0c8d9ae38cb9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:42:15.689148 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-4893f6ea-43de-4a52-8440-0c8d9ae38cb9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:42:15.690644 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1453/2910] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 11:42:15 2022] DELETE /identity/v3/projects/d6b83668ac9a4864bd8474321a556e17 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:42:15.694817 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a91abc-a485-410f-985c-a662a5598efd admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:42:15.696336 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-87a91abc-a485-410f-985c-a662a5598efd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:42:15.709309 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a91abc-a485-410f-985c-a662a5598efd admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:42:15.728951 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:42:15.777562 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c085627f-e364-4f05-93c3-a71a67eea803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:42:15.778200 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c085627f-e364-4f05-93c3-a71a67eea803 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:42:15.778512 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c085627f-e364-4f05-93c3-a71a67eea803 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:42:15.778786 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c085627f-e364-4f05-93c3-a71a67eea803 admin admin] PATH_INFO: `/v3/users/4a9927e0e79640cd93f49ad1aaa4b39a` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:42:15.779992 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c085627f-e364-4f05-93c3-a71a67eea803 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a9927e0e79640cd93f49ad1aaa4b39a)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:42:15.782604 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c085627f-e364-4f05-93c3-a71a67eea803 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:42:15.833472 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-c085627f-e364-4f05-93c3-a71a67eea803 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a9927e0e79640cd93f49ad1aaa4b39a'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:42:15.834044 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-c085627f-e364-4f05-93c3-a71a67eea803 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a9927e0e79640cd93f49ad1aaa4b39a'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:42:15.834671 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-c085627f-e364-4f05-93c3-a71a67eea803 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a9927e0e79640cd93f49ad1aaa4b39a'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:42:15.844062 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-c085627f-e364-4f05-93c3-a71a67eea803 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a9927e0e79640cd93f49ad1aaa4b39a'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:42:15.851324 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-c085627f-e364-4f05-93c3-a71a67eea803 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a9927e0e79640cd93f49ad1aaa4b39a'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:42:15.868596 dv-cinder-848899-3-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1458/2911] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 24 11:42:15 2022] DELETE /identity/v3/users/4a9927e0e79640cd93f49ad1aaa4b39a => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:42:16.048431 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4893f6ea-43de-4a52-8440-0c8d9ae38cb9 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:42:16.049930 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-4893f6ea-43de-4a52-8440-0c8d9ae38cb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:42:16.063004 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4893f6ea-43de-4a52-8440-0c8d9ae38cb9 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:42:16.121306 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b38174-b73c-4e19-ba52-088da701666b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e2e9ab325dc4dbf92dd6b59db4a0945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5558cde3f9bd4a779ecb6a225f26878d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:42:16.121942 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b38174-b73c-4e19-ba52-088da701666b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:42:16.122216 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b38174-b73c-4e19-ba52-088da701666b admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:42:16.122502 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b38174-b73c-4e19-ba52-088da701666b admin admin] PATH_INFO: `/v3/projects/db898998d97f45fa88648670a8178687` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:42:16.123784 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b38174-b73c-4e19-ba52-088da701666b admin admin] RBAC: Authorizing `identity:delete_project(project_id=db898998d97f45fa88648670a8178687)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:42:16.125849 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b38174-b73c-4e19-ba52-088da701666b admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:42:16.167292 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:42:16.179450 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-30b38174-b73c-4e19-ba52-088da701666b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db898998d97f45fa88648670a8178687', 'request_id': 'req-30b38174-b73c-4e19-ba52-088da701666b'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:42:16.185666 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-30b38174-b73c-4e19-ba52-088da701666b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db898998d97f45fa88648670a8178687', 'request_id': 'req-30b38174-b73c-4e19-ba52-088da701666b'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:42:16.191306 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-30b38174-b73c-4e19-ba52-088da701666b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db898998d97f45fa88648670a8178687', 'request_id': 'req-30b38174-b73c-4e19-ba52-088da701666b'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:42:16.205157 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-30b38174-b73c-4e19-ba52-088da701666b admin admin] The token cache is being invalidate because project db898998d97f45fa88648670a8178687 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:42:16.205442 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-30b38174-b73c-4e19-ba52-088da701666b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:42:16.206067 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-30b38174-b73c-4e19-ba52-088da701666b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:42:16.207568 dv-cinder-848899-3-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1454/2912] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 24 11:42:16 2022] DELETE /identity/v3/projects/db898998d97f45fa88648670a8178687 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:42:25.865457 dv-cinder-848899-3-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=42,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:42:26.202429 dv-cinder-848899-3-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=11,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}